2023-12-13T22:03:41.193 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T22:03:41.193 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/orig.config.yaml 2023-12-13T22:03:41.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:03:41.322 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529 branch: wip-yuri10-testing-2023-12-12-1229 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7490529' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri10-testing-2023-12-12-1229 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-12-12-1229 sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8548 sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri10-testing-2023-12-12-1229 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAnY8NZ8rmG2fQtWRB96YYhFduGIFCtjp3tlo7ef+U/+RYsWnnoGH3a9C225VwUAJyfAd2a/pDKcjBH9rM9tQI= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAQegAzKZeY9WGY5Wo7dp/9hw6qdPMo5p6ZZJY4vLjPGWufyxKJFGkt6UARQVfEnBrlfPACkfQ6Rf6p8t68/C2Y= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-13_20:38:28 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-13T22:03:41.322 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa; will attempt to use it 2023-12-13T22:03:41.322 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks 2023-12-13T22:03:41.323 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-13T22:03:41.324 INFO:teuthology.task.internal:Checking packages... 2023-12-13T22:03:41.348 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '021ac1670a21c19759080c6da90baaeb42e7d175' 2023-12-13T22:03:41.348 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-13T22:03:41.348 INFO:teuthology.packaging:ref: None 2023-12-13T22:03:41.348 INFO:teuthology.packaging:tag: None 2023-12-13T22:03:41.348 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-12-12-1229 2023-12-13T22:03:41.348 INFO:teuthology.packaging:sha1: 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:03:41.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri10-testing-2023-12-12-1229 2023-12-13T22:03:41.731 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-157-g021ac167-1jammy 2023-12-13T22:03:41.732 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-13T22:03:41.738 INFO:teuthology.task.internal:no buildpackages task found 2023-12-13T22:03:41.739 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-13T22:03:41.746 INFO:teuthology.task.internal:Saving configuration 2023-12-13T22:03:41.764 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-13T22:03:41.769 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:03:41.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:57:45.090675', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICqU6y1WVn6EwIg5TF5iJwgTLOj00ZgFsy77pCua1ZCN'} 2023-12-13T22:03:41.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:57:45.092504', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID2VlQ+vPP8uF+Ahs0cFzYdpde7QuQbBemPX58yqJVt6'} 2023-12-13T22:03:41.817 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-13T22:03:41.822 INFO:teuthology.task.internal:roles: ubuntu@smithi091.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-13T22:03:41.822 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-13T22:03:41.822 INFO:teuthology.run_tasks:Running task console_log... 2023-12-13T22:03:41.967 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f99a6f50ca0>, signals=[15]) 2023-12-13T22:03:41.968 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-13T22:03:41.973 INFO:teuthology.task.internal:Opening connections... 2023-12-13T22:03:41.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:03:41.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:03:42.050 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:03:42.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:03:42.124 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-13T22:03:42.130 DEBUG:teuthology.orchestra.run.smithi091:> uname -m 2023-12-13T22:03:42.135 INFO:teuthology.orchestra.run.smithi091.stdout:x86_64 2023-12-13T22:03:42.136 DEBUG:teuthology.orchestra.run.smithi091:> cat /etc/os-release 2023-12-13T22:03:42.184 INFO:teuthology.orchestra.run.smithi091.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-13T22:03:42.184 INFO:teuthology.orchestra.run.smithi091.stdout:NAME="Ubuntu" 2023-12-13T22:03:42.184 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_ID="22.04" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:VERSION_CODENAME=jammy 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:ID=ubuntu 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:ID_LIKE=debian 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-13T22:03:42.185 INFO:teuthology.orchestra.run.smithi091.stdout:UBUNTU_CODENAME=jammy 2023-12-13T22:03:42.186 INFO:teuthology.lock.ops:Updating smithi091.front.sepia.ceph.com on lock server 2023-12-13T22:03:42.211 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-13T22:03:42.216 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-13T22:03:42.216 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-13T22:03:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy 2023-12-13T22:03:42.263 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-13T22:03:42.286 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-13T22:03:42.294 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-13T22:03:42.309 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-13T22:03:42.309 DEBUG:teuthology.orchestra.run.smithi091:> test '!' -e /home/ubuntu/cephtest 2023-12-13T22:03:42.312 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-12-13T22:03:42.316 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-13T22:03:42.322 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-13T22:03:42.322 DEBUG:teuthology.orchestra.run.smithi091:> test -z $(ls -A /var/lib/ceph) 2023-12-13T22:03:42.361 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-12-13T22:03:42.375 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-13T22:03:42.429 INFO:teuthology.run_tasks:Running task kernel... 2023-12-13T22:03:42.444 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-13T22:03:42.444 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-13T22:03:42.444 DEBUG:teuthology.orchestra.run.smithi091:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-13T22:03:42.445 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-13T22:03:42.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:03:42.449 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-12-13T22:03:42.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:03:42.450 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-13T22:03:42.496 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-56-generic 2023-12-13T22:03:42.496 INFO:teuthology.task.kernel:Running kernel on smithi091: 5.15.0-56-generic 2023-12-13T22:03:42.496 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-12-13T22:03:42.498 INFO:teuthology.orchestra.run.smithi152.stdout:5.15.0-56-generic 2023-12-13T22:03:42.498 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.15.0-56-generic 2023-12-13T22:03:42.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get clean 2023-12-13T22:03:42.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2023-12-13T22:03:42.647 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-12-13T22:03:42.792 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-12-13T22:03:42.806 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:03:42.806 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-12-13T22:03:42.806 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-12-13T22:03:42.898 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-12-13T22:03:42.906 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:03:42.991 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-12-13T22:03:43.026 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [382 kB] 2023-12-13T22:03:43.028 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [382 kB] 2023-12-13T22:03:43.102 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [546 kB] 2023-12-13T22:03:43.109 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,047 kB] 2023-12-13T22:03:43.112 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,047 kB] 2023-12-13T22:03:43.172 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [198 kB] 2023-12-13T22:03:43.184 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [198 kB] 2023-12-13T22:03:43.184 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-12-13T22:03:43.184 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,222 kB] 2023-12-13T22:03:43.190 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-12-13T22:03:43.192 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-12-13T22:03:43.193 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,222 kB] 2023-12-13T22:03:43.223 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,260 kB] 2023-12-13T22:03:43.226 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-12-13T22:03:43.227 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [199 kB] 2023-12-13T22:03:43.235 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-12-13T22:03:43.235 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [577 kB] 2023-12-13T22:03:43.241 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [199 kB] 2023-12-13T22:03:43.250 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-12-13T22:03:43.250 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [577 kB] 2023-12-13T22:03:43.262 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [815 kB] 2023-12-13T22:03:43.272 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [815 kB] 2023-12-13T22:03:43.278 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [152 kB] 2023-12-13T22:03:43.279 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-12-13T22:03:43.279 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-12-13T22:03:43.279 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-12-13T22:03:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [152 kB] 2023-12-13T22:03:43.302 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-12-13T22:03:43.302 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-12-13T22:03:43.303 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-12-13T22:03:43.304 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-12-13T22:03:43.307 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-12-13T22:03:43.308 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-12-13T22:03:43.312 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-12-13T22:03:43.313 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [259 kB] 2023-12-13T22:03:43.320 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-12-13T22:03:43.320 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-12-13T22:03:43.321 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,246 kB] 2023-12-13T22:03:43.355 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [203 kB] 2023-12-13T22:03:43.358 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-12-13T22:03:43.359 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-12-13T22:03:43.359 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,018 kB] 2023-12-13T22:03:43.377 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [675 kB] 2023-12-13T22:03:43.388 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [226 kB] 2023-12-13T22:03:43.391 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-12-13T22:03:43.392 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-12-13T22:03:43.392 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-12-13T22:03:43.393 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-12-13T22:03:43.398 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-12-13T22:03:43.399 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-12-13T22:03:43.399 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-12-13T22:03:43.423 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-12-13T22:03:43.423 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-12-13T22:03:43.423 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-12-13T22:03:43.424 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-12-13T22:03:43.424 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2023-12-13T22:03:43.426 INFO:teuthology.orchestra.run.smithi152.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-12-13T22:03:43.499 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,260 kB] 2023-12-13T22:03:43.792 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [546 kB] 2023-12-13T22:03:43.833 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [259 kB] 2023-12-13T22:03:43.850 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-12-13T22:03:43.850 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.8 kB] 2023-12-13T22:03:43.853 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,246 kB] 2023-12-13T22:03:43.908 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [203 kB] 2023-12-13T22:03:43.914 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-12-13T22:03:44.078 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [675 kB] 2023-12-13T22:03:44.787 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,018 kB] 2023-12-13T22:03:45.027 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [226 kB] 2023-12-13T22:03:45.058 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-12-13T22:03:45.060 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-12-13T22:03:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-12-13T22:03:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-12-13T22:03:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-12-13T22:03:45.066 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-12-13T22:03:45.068 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-12-13T22:03:45.071 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-12-13T22:03:48.115 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-12-13T22:03:48.201 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-12-13T22:03:48.238 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-12-13T22:03:48.370 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2023-12-13T22:03:48.419 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-12-13T22:03:48.567 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 10.7 MB in 2s (6,793 kB/s) 2023-12-13T22:03:49.953 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:03:49.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-13T22:03:50.030 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:03:50.205 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2023-12-13T22:03:50.206 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout: python2.7-minimal 2023-12-13T22:03:50.349 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:03:50.350 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2023-12-13T22:03:50.350 INFO:teuthology.orchestra.run.smithi152.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-13T22:03:50.350 INFO:teuthology.orchestra.run.smithi152.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2023-12-13T22:03:50.351 INFO:teuthology.orchestra.run.smithi152.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2023-12-13T22:03:50.352 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2023-12-13T22:03:50.352 INFO:teuthology.orchestra.run.smithi152.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-12-13T22:03:50.352 INFO:teuthology.orchestra.run.smithi152.stdout:Recommended packages: 2023-12-13T22:03:50.352 INFO:teuthology.orchestra.run.smithi152.stdout: thermald 2023-12-13T22:03:50.403 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2023-12-13T22:03:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-13T22:03:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2023-12-13T22:03:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: linux-modules-extra-5.15.0-91-generic 2023-12-13T22:03:50.404 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2023-12-13T22:03:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-13T22:03:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:3 upgraded, 5 newly installed, 0 to remove and 277 not upgraded. 2023-12-13T22:03:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 113 MB of archives. 2023-12-13T22:03:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 582 MB of additional disk space will be used. 2023-12-13T22:03:50.498 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2023-12-13T22:03:50.915 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2023-12-13T22:03:50.998 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2023-12-13T22:03:51.772 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2023-12-13T22:03:51.772 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2023-12-13T22:03:51.773 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2023-12-13T22:03:51.890 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2023-12-13T22:03:51.911 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2023-12-13T22:03:52.308 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 113 MB in 2s (71.9 MB/s) 2023-12-13T22:03:52.509 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2023-12-13T22:03:52.856 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 10.7 MB in 6s (1,885 kB/s) 2023-12-13T22:03:54.100 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:03:54.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-13T22:03:54.175 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:03:54.364 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-12-13T22:03:54.365 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout: python2.7-minimal 2023-12-13T22:03:54.527 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:03:54.528 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-12-13T22:03:54.528 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-13T22:03:54.528 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2023-12-13T22:03:54.529 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2023-12-13T22:03:54.529 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-12-13T22:03:54.529 INFO:teuthology.orchestra.run.smithi091.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-12-13T22:03:54.530 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-12-13T22:03:54.530 INFO:teuthology.orchestra.run.smithi091.stdout: thermald 2023-12-13T22:03:54.537 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-12-13T22:03:54.542 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:03:54.576 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-12-13T22:03:54.576 INFO:teuthology.orchestra.run.smithi091.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2023-12-13T22:03:54.576 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2023-12-13T22:03:54.576 INFO:teuthology.orchestra.run.smithi091.stdout: linux-modules-extra-5.15.0-91-generic 2023-12-13T22:03:54.577 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-12-13T22:03:54.578 INFO:teuthology.orchestra.run.smithi091.stdout: linux-generic linux-headers-generic linux-image-generic 2023-12-13T22:03:54.672 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:03:54.756 INFO:teuthology.orchestra.run.smithi091.stdout:3 upgraded, 5 newly installed, 0 to remove and 277 not upgraded. 2023-12-13T22:03:54.756 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 113 MB of archives. 2023-12-13T22:03:54.757 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 582 MB of additional disk space will be used. 2023-12-13T22:03:54.757 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2023-12-13T22:03:56.145 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2023-12-13T22:03:56.496 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2023-12-13T22:03:57.057 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2023-12-13T22:03:57.066 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:03:57.148 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:03:57.692 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2023-12-13T22:03:57.713 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:03:57.983 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:03:58.726 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2023-12-13T22:03:58.726 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2023-12-13T22:03:58.727 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2023-12-13T22:03:59.338 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2023-12-13T22:03:59.443 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2023-12-13T22:03:59.837 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 113 MB in 5s (23.3 MB/s) 2023-12-13T22:04:00.012 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2023-12-13T22:04:02.085 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-12-13T22:04:02.089 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:04:02.176 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:04.460 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2023-12-13T22:04:04.481 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:04:04.579 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:04.656 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:04.781 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:05.063 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2023-12-13T22:04:05.073 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:05.084 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:04:05.138 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:05.201 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:05.495 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2023-12-13T22:04:05.507 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2023-12-13T22:04:05.545 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-13T22:04:11.211 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2023-12-13T22:04:11.248 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:04:11.294 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:11.996 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:12.149 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:12.489 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:12.594 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:12.905 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2023-12-13T22:04:12.916 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2023-12-13T22:04:12.955 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-13T22:04:14.730 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:14.849 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:15.283 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-13T22:04:15.413 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:15.547 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2023-12-13T22:04:15.676 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:17.031 INFO:teuthology.orchestra.run.smithi152.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:17.031 INFO:teuthology.orchestra.run.smithi152.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:17.031 INFO:teuthology.orchestra.run.smithi152.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:17.031 INFO:teuthology.orchestra.run.smithi152.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:17.187 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:18.605 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2023-12-13T22:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:19.503 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2023-12-13T22:04:19.539 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2023-12-13T22:04:19.577 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:20.608 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up linux-generic (5.15.0.91.88) ... 2023-12-13T22:04:20.768 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:20.825 INFO:teuthology.orchestra.run.smithi152.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-13T22:04:20.825 INFO:teuthology.orchestra.run.smithi152.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:22.226 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2023-12-13T22:04:22.348 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2023-12-13T22:04:22.706 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2023-12-13T22:04:22.811 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:22.928 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2023-12-13T22:04:23.078 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:24.402 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:24.402 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:24.402 INFO:teuthology.orchestra.run.smithi091.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:24.402 INFO:teuthology.orchestra.run.smithi091.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:24.550 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:25.976 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2023-12-13T22:04:26.102 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:27.512 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up linux-generic (5.15.0.91.88) ... 2023-12-13T22:04:27.655 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2023-12-13T22:04:27.717 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-13T22:04:27.717 INFO:teuthology.orchestra.run.smithi091.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:35.837 INFO:teuthology.orchestra.run.smithi152.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-13T22:04:35.837 INFO:teuthology.orchestra.run.smithi152.stdout:Sourcing file `/etc/default/grub' 2023-12-13T22:04:35.863 INFO:teuthology.orchestra.run.smithi152.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-13T22:04:35.884 INFO:teuthology.orchestra.run.smithi152.stdout:Generating grub configuration file ... 2023-12-13T22:04:36.290 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:36.315 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:36.675 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:36.681 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:36.746 INFO:teuthology.orchestra.run.smithi152.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-13T22:04:36.752 INFO:teuthology.orchestra.run.smithi152.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-13T22:04:36.909 INFO:teuthology.orchestra.run.smithi152.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-13T22:04:36.910 INFO:teuthology.orchestra.run.smithi152.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-12-13T22:04:36.910 INFO:teuthology.orchestra.run.smithi152.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-13T22:04:36.947 INFO:teuthology.orchestra.run.smithi152.stdout:done 2023-12-13T22:04:37.393 DEBUG:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic 2023-12-13T22:04:37.412 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic 2023-12-13T22:04:37.412 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 20 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 5.15.0.91.88 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image 2023-12-13T22:04:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image 2023-12-13T22:04:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: available. 2023-12-13T22:04:37.414 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2023-12-13T22:04:37.414 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-13T22:04:37.414 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-13T22:04:37.414 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-13T22:04:37.414 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2023-12-13T22:04:37.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get clean 2023-12-13T22:04:37.582 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2023-12-13T22:04:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-13T22:04:37.824 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:04:37.905 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-13T22:04:38.005 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-13T22:04:39.127 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:04:39.145 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-13T22:04:39.197 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:04:39.366 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2023-12-13T22:04:39.366 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:04:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:04:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:04:39.516 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:04:39.554 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 0 newly installed, 0 to remove and 277 not upgraded. 2023-12-13T22:04:39.556 DEBUG:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 20 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team 2023-12-13T22:04:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 5.15.0.91.88 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image 2023-12-13T22:04:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image 2023-12-13T22:04:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: available. 2023-12-13T22:04:39.615 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-12-13T22:04:39.657 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.wRBk1FvIly 2023-12-13T22:04:39.657 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wRBk1FvIly 2023-12-13T22:04:39.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.wRBk1FvIly 2023-12-13T22:04:39.832 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.wRBk1FvIly is 10KB 2023-12-13T22:04:39.844 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.wRBk1FvIly 2023-12-13T22:04:39.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-13T22:04:39.905 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:04:39.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-13T22:04:39.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-13T22:04:39.971 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2023-12-13T22:04:39.972 DEBUG:teuthology.orchestra.run.smithi152:> sudo update-grub 2023-12-13T22:04:41.232 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub' 2023-12-13T22:04:41.233 INFO:teuthology.orchestra.run.smithi152.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-13T22:04:41.236 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2023-12-13T22:04:41.424 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:41.430 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:41.673 INFO:teuthology.orchestra.run.smithi091.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-13T22:04:41.673 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub' 2023-12-13T22:04:41.700 INFO:teuthology.orchestra.run.smithi091.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-13T22:04:41.720 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:41.725 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:41.728 INFO:teuthology.orchestra.run.smithi091.stdout:Generating grub configuration file ... 2023-12-13T22:04:41.769 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-13T22:04:41.775 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-13T22:04:41.899 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-13T22:04:41.899 INFO:teuthology.orchestra.run.smithi152.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-13T22:04:41.899 INFO:teuthology.orchestra.run.smithi152.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-13T22:04:41.911 INFO:teuthology.orchestra.run.smithi152.stderr:done 2023-12-13T22:04:41.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2023-12-13T22:04:42.059 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:42.077 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:42.472 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:42.478 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:42.553 INFO:teuthology.orchestra.run.smithi091.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-13T22:04:42.561 INFO:teuthology.orchestra.run.smithi091.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-13T22:04:42.745 INFO:teuthology.orchestra.run.smithi091.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-13T22:04:42.746 INFO:teuthology.orchestra.run.smithi091.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-12-13T22:04:42.746 INFO:teuthology.orchestra.run.smithi091.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-13T22:04:42.786 INFO:teuthology.orchestra.run.smithi091.stdout:done 2023-12-13T22:04:43.274 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-12-13T22:04:43.295 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.91.88 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-12-13T22:04:43.296 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-12-13T22:04:43.296 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2023-12-13T22:04:43.296 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-13T22:04:43.296 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-13T22:04:43.297 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-13T22:04:43.297 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi091.front.sepia.ceph.com, path=None, version=distro) 2023-12-13T22:04:43.297 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get clean 2023-12-13T22:04:43.456 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-12-13T22:04:43.562 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:04:43.573 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-13T22:04:43.589 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-13T22:04:43.687 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-13T22:04:44.860 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:04:44.877 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-12-13T22:04:44.936 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:04:45.123 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-12-13T22:04:45.124 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:04:45.290 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:04:45.291 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:04:45.291 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:04:45.329 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 0 newly installed, 0 to remove and 277 not upgraded. 2023-12-13T22:04:45.331 DEBUG:teuthology.orchestra.run.smithi091:> dpkg -s linux-image-generic 2023-12-13T22:04:45.342 INFO:teuthology.orchestra.run.smithi091.stdout:Package: linux-image-generic 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Status: install ok installed 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Priority: optional 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Section: kernel 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Installed-Size: 20 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Maintainer: Ubuntu Kernel Team 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Architecture: amd64 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Source: linux-meta 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Version: 5.15.0.91.88 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Recommends: thermald 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout:Description: Generic Linux kernel image 2023-12-13T22:04:45.343 INFO:teuthology.orchestra.run.smithi091.stdout: This package will always depend on the latest generic kernel image 2023-12-13T22:04:45.344 INFO:teuthology.orchestra.run.smithi091.stdout: available. 2023-12-13T22:04:45.344 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-12-13T22:04:45.391 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.7C0CJbsjqP 2023-12-13T22:04:45.391 DEBUG:teuthology.orchestra.run.smithi091:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7C0CJbsjqP 2023-12-13T22:04:45.447 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.7C0CJbsjqP 2023-12-13T22:04:45.562 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.7C0CJbsjqP is 10KB 2023-12-13T22:04:45.575 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.7C0CJbsjqP 2023-12-13T22:04:45.580 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-13T22:04:45.634 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:04:45.634 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-13T22:04:45.634 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-13T22:04:45.712 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2023-12-13T22:04:45.712 DEBUG:teuthology.orchestra.run.smithi091:> sudo update-grub 2023-12-13T22:04:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub' 2023-12-13T22:04:46.968 INFO:teuthology.orchestra.run.smithi091.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-13T22:04:46.970 INFO:teuthology.orchestra.run.smithi091.stderr:Generating grub configuration file ... 2023-12-13T22:04:47.215 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2023-12-13T22:04:47.221 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2023-12-13T22:04:47.543 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-13T22:04:47.548 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-13T22:04:47.594 INFO:teuthology.orchestra.run.smithi091.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-13T22:04:47.600 INFO:teuthology.orchestra.run.smithi091.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-13T22:04:47.716 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-13T22:04:47.717 INFO:teuthology.orchestra.run.smithi091.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-13T22:04:47.717 INFO:teuthology.orchestra.run.smithi091.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-13T22:04:47.729 INFO:teuthology.orchestra.run.smithi091.stderr:done 2023-12-13T22:04:47.738 DEBUG:teuthology.orchestra.run.smithi091:> sudo shutdown -r now 2023-12-13T22:05:11.950 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-13T22:05:11.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:05:11.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:05:17.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-13T22:05:17.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:05:17.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:05:30.521 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-13T22:05:36.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-13T22:05:39.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:05:39.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:05:42.581 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-13T22:05:45.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:05:45.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:05:48.209 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.91 2023-12-13T22:05:54.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:05:54.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:06:00.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:06:00.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:06:32.007 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-12-13T22:06:32.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:06:32.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-91-generic"... 2023-12-13T22:06:32.962 DEBUG:teuthology.orchestra.run.smithi091:> uname -r 2023-12-13T22:06:33.011 INFO:teuthology.orchestra.run.smithi091.stdout:5.15.0-91-generic 2023-12-13T22:06:33.011 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2023-12-13T22:06:33.011 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-13T22:06:33.011 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-13T22:06:34.012 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-13T22:06:34.012 DEBUG:teuthology.orchestra.run.smithi091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-13T22:06:34.078 INFO:teuthology.orchestra.run.smithi091.stdout:ttyS1 2023-12-13T22:06:34.108 DEBUG:teuthology.parallel:result is None 2023-12-13T22:06:54.592 DEBUG:teuthology.orchestra.remote:timed out 2023-12-13T22:07:09.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:07:09.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:07:09.814 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-13T22:07:10.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:07:10.397 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-91-generic"... 2023-12-13T22:07:10.397 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-13T22:07:10.444 INFO:teuthology.orchestra.run.smithi152.stdout:5.15.0-91-generic 2023-12-13T22:07:10.444 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2023-12-13T22:07:10.444 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-13T22:07:10.444 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-13T22:07:11.445 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-13T22:07:11.445 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-13T22:07:11.807 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2023-12-13T22:07:11.834 DEBUG:teuthology.parallel:result is None 2023-12-13T22:07:11.835 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-13T22:07:11.842 INFO:teuthology.task.internal:Creating test directory... 2023-12-13T22:07:11.842 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-13T22:07:11.845 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-13T22:07:11.852 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-13T22:07:11.861 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-13T22:07:11.871 INFO:teuthology.task.internal:Creating archive directory... 2023-12-13T22:07:11.873 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-13T22:07:11.896 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-13T22:07:11.922 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-13T22:07:11.928 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-13T22:07:11.928 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-13T22:07:11.956 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-13T22:07:11.973 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-13T22:07:11.977 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-13T22:07:11.982 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-13T22:07:11.985 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-13T22:07:11.987 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-13T22:07:11.994 INFO:teuthology.task.internal:Configuring sudo... 2023-12-13T22:07:11.994 DEBUG:teuthology.orchestra.run.smithi091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-13T22:07:12.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-13T22:07:12.041 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-13T22:07:12.052 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-13T22:07:12.052 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-13T22:07:12.084 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-13T22:07:12.089 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-13T22:07:12.134 DEBUG:teuthology.orchestra.run.smithi091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-13T22:07:12.183 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:07:12.183 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-13T22:07:12.262 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-13T22:07:12.267 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-13T22:07:12.316 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:07:12.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-13T22:07:12.373 DEBUG:teuthology.orchestra.run.smithi091:> sudo service rsyslog restart 2023-12-13T22:07:12.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-12-13T22:07:12.456 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-13T22:07:12.464 INFO:teuthology.task.internal:Starting timer... 2023-12-13T22:07:12.464 INFO:teuthology.run_tasks:Running task pcp... 2023-12-13T22:07:12.476 INFO:teuthology.run_tasks:Running task selinux... 2023-12-13T22:07:12.484 DEBUG:teuthology.task.selinux:Excluding smithi091: OS 'ubuntu' does not support SELinux 2023-12-13T22:07:12.485 DEBUG:teuthology.task.selinux:Excluding smithi152: OS 'ubuntu' does not support SELinux 2023-12-13T22:07:12.485 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-13T22:07:12.485 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-13T22:07:12.485 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-13T22:07:12.485 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-13T22:07:12.502 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-13T22:07:12.502 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-13T22:07:12.521 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-13T22:07:12.522 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi091.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-13T22:15:11.086 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi091.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2023-12-13T22:15:11.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:15:11.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:15:11.166 DEBUG:teuthology.orchestra.run.smithi091:> true 2023-12-13T22:15:11.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi091.front.sepia.ceph.com' 2023-12-13T22:15:11.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:15:11.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T22:15:11.325 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-13T22:15:11.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-13T22:15:11.406 INFO:teuthology.run_tasks:Running task clock... 2023-12-13T22:15:11.416 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-13T22:15:11.416 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-13T22:15:11.417 DEBUG:teuthology.orchestra.run.smithi091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T22:15:11.419 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-13T22:15:11.419 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T22:15:11.445 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Command line: ntpd -gq 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: ---------------------------------------------------- 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: ntp-4 is maintained by Network Time Foundation, 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: corporation. Support and training for ntp-4 are 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: available at https://www.nwtime.org/support 2023-12-13T22:15:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: ---------------------------------------------------- 2023-12-13T22:15:11.447 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: proto: precision = 0.061 usec (-24) 2023-12-13T22:15:11.448 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: basedate set to 2022-02-04 2023-12-13T22:15:11.448 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: gps base set to 2022-02-06 (week 2196) 2023-12-13T22:15:11.448 INFO:teuthology.orchestra.run.smithi091.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-13T22:15:11.449 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-13T22:15:11.449 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: restrict ::: KOD does nothing without LIMITED. 2023-12-13T22:15:11.449 INFO:teuthology.orchestra.run.smithi091.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen and drop on 0 v6wildcard [::]:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen normally on 2 lo 127.0.0.1:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen normally on 3 enp3s0f1 172.21.15.91:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen normally on 4 lo [::1]:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d5%5]:123 2023-12-13T22:15:11.450 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:11 ntpd[28002]: Listening on routing socket on fd #22 for interface updates 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Command line: ntpd -gq 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: ---------------------------------------------------- 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: ntp-4 is maintained by Network Time Foundation, 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: corporation. Support and training for ntp-4 are 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: available at https://www.nwtime.org/support 2023-12-13T22:15:11.473 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: ---------------------------------------------------- 2023-12-13T22:15:11.474 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: proto: precision = 0.071 usec (-24) 2023-12-13T22:15:11.474 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: basedate set to 2022-02-04 2023-12-13T22:15:11.474 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: gps base set to 2022-02-06 (week 2196) 2023-12-13T22:15:11.474 INFO:teuthology.orchestra.run.smithi152.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-13T22:15:11.475 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-13T22:15:11.475 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: restrict ::: KOD does nothing without LIMITED. 2023-12-13T22:15:11.475 INFO:teuthology.orchestra.run.smithi152.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen and drop on 0 v6wildcard [::]:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen normally on 2 lo 127.0.0.1:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen normally on 3 enp3s0f1 172.21.15.152:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen normally on 4 lo [::1]:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de3%5]:123 2023-12-13T22:15:11.476 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:11 ntpd[27977]: Listening on routing socket on fd #22 for interface updates 2023-12-13T22:15:12.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:12.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:12 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:12 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:13.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:13.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:13.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:13.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:13.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:13.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:13 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:14.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:14 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:14.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:14.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:14 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:15.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:15.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:15.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:15.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:15.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:15.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:15 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:15.473 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:15.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:15 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.448 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:16.448 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:16 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:16.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:16.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:16 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:17.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:17.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:17 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:17.473 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:17.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:17 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:18.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.446 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stdout:13 Dec 22:15:18 ntpd[28002]: ntpd: time slew -0.001166 s 2023-12-13T22:15:18.447 INFO:teuthology.orchestra.run.smithi091.stdout:ntpd: time slew -0.001166s 2023-12-13T22:15:18.448 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-13T22:15:18.448 INFO:teuthology.orchestra.run.smithi091.stderr:13 Dec 22:15:18 ntpd[28002]: can't open /var/log/ntpstats/loopstats.20231213: Permission denied 2023-12-13T22:15:18.473 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.473 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: can't open /var/log/ntpstats/rawstats.20231213: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: can't open /var/log/ntpstats/peerstats.20231213: Permission denied 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:13 Dec 22:15:18 ntpd[27977]: ntpd: time slew -0.002048 s 2023-12-13T22:15:18.474 INFO:teuthology.orchestra.run.smithi152.stdout:ntpd: time slew -0.002048s 2023-12-13T22:15:18.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-13T22:15:18.475 INFO:teuthology.orchestra.run.smithi152.stderr:13 Dec 22:15:18 ntpd[27977]: can't open /var/log/ntpstats/loopstats.20231213: Permission denied 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.499 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.538 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-13T22:15:18.539 INFO:teuthology.run_tasks:Running task install... 2023-12-13T22:15:18.550 DEBUG:teuthology.task.install:project ceph 2023-12-13T22:15:18.550 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}} 2023-12-13T22:15:18.550 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'} 2023-12-13T22:15:18.550 INFO:teuthology.task.install:Using flavor: default 2023-12-13T22:15:18.556 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-13T22:15:18.556 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-13T22:15:18.556 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-key list | grep Ceph 2023-12-13T22:15:18.557 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-key list | grep Ceph 2023-12-13T22:15:18.616 INFO:teuthology.orchestra.run.smithi091.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-13T22:15:18.638 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-13T22:15:18.643 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-13T22:15:18.643 INFO:teuthology.orchestra.run.smithi091.stdout:uid [ unknown] Ceph.com (release key) 2023-12-13T22:15:18.643 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-13T22:15:18.643 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-13T22:15:18.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:15:18.667 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-13T22:15:18.667 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph.com (release key) 2023-12-13T22:15:18.668 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-13T22:15:18.668 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-13T22:15:18.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:15:18.789 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default/ 2023-12-13T22:15:18.789 INFO:teuthology.task.install.deb:Package version is 19.0.0-157-g021ac167-1jammy 2023-12-13T22:15:18.889 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default/ 2023-12-13T22:15:18.889 INFO:teuthology.task.install.deb:Package version is 19.0.0-157-g021ac167-1jammy 2023-12-13T22:15:19.089 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:15:19.089 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-13T22:15:19.098 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:15:19.098 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-13T22:15:19.103 DEBUG:teuthology.orchestra.run.smithi091:> sudo apt-get update 2023-12-13T22:15:19.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2023-12-13T22:15:19.292 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-13T22:15:19.292 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:15:19.299 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-13T22:15:19.327 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-13T22:15:19.362 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-13T22:15:19.395 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-13T22:15:19.479 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-13T22:15:19.501 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy InRelease 2023-12-13T22:15:19.563 INFO:teuthology.orchestra.run.smithi091.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-13T22:15:19.574 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-12-13T22:15:19.613 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy InRelease 2023-12-13T22:15:19.653 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-13T22:15:19.712 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-12-13T22:15:19.734 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-12-13T22:15:19.792 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-13T22:15:19.802 INFO:teuthology.orchestra.run.smithi091.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-13T22:15:19.858 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-12-13T22:15:19.906 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 27.8 kB in 1s (46.5 kB/s) 2023-12-13T22:15:19.936 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-12-13T22:15:20.022 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 27.8 kB in 1s (38.1 kB/s) 2023-12-13T22:15:20.853 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:15:20.870 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-157-g021ac167-1jammy cephadm=19.0.0-157-g021ac167-1jammy ceph-mds=19.0.0-157-g021ac167-1jammy ceph-mgr=19.0.0-157-g021ac167-1jammy ceph-common=19.0.0-157-g021ac167-1jammy ceph-fuse=19.0.0-157-g021ac167-1jammy ceph-test=19.0.0-157-g021ac167-1jammy ceph-volume=19.0.0-157-g021ac167-1jammy radosgw=19.0.0-157-g021ac167-1jammy python3-rados=19.0.0-157-g021ac167-1jammy python3-rgw=19.0.0-157-g021ac167-1jammy python3-cephfs=19.0.0-157-g021ac167-1jammy python3-rbd=19.0.0-157-g021ac167-1jammy libcephfs2=19.0.0-157-g021ac167-1jammy libcephfs-dev=19.0.0-157-g021ac167-1jammy librados2=19.0.0-157-g021ac167-1jammy librbd1=19.0.0-157-g021ac167-1jammy rbd-fuse=19.0.0-157-g021ac167-1jammy ceph-common-dbg=19.0.0-157-g021ac167-1jammy ceph-fuse-dbg=19.0.0-157-g021ac167-1jammy ceph-mds-dbg=19.0.0-157-g021ac167-1jammy ceph-mgr-dbg=19.0.0-157-g021ac167-1jammy ceph-mon-dbg=19.0.0-157-g021ac167-1jammy ceph-osd-dbg=19.0.0-157-g021ac167-1jammy ceph-test-dbg=19.0.0-157-g021ac167-1jammy libcephfs2-dbg=19.0.0-157-g021ac167-1jammy librados2-dbg=19.0.0-157-g021ac167-1jammy libradosstriper1-dbg=19.0.0-157-g021ac167-1jammy librbd1-dbg=19.0.0-157-g021ac167-1jammy librgw2-dbg=19.0.0-157-g021ac167-1jammy radosgw-dbg=19.0.0-157-g021ac167-1jammy rbd-fuse-dbg=19.0.0-157-g021ac167-1jammy rbd-mirror-dbg=19.0.0-157-g021ac167-1jammy rbd-nbd-dbg=19.0.0-157-g021ac167-1jammy python3-cephfs=19.0.0-157-g021ac167-1jammy cephfs-shell=19.0.0-157-g021ac167-1jammy cephfs-top=19.0.0-157-g021ac167-1jammy cephfs-mirror=19.0.0-157-g021ac167-1jammy 2023-12-13T22:15:20.930 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:15:20.977 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:15:20.993 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-157-g021ac167-1jammy cephadm=19.0.0-157-g021ac167-1jammy ceph-mds=19.0.0-157-g021ac167-1jammy ceph-mgr=19.0.0-157-g021ac167-1jammy ceph-common=19.0.0-157-g021ac167-1jammy ceph-fuse=19.0.0-157-g021ac167-1jammy ceph-test=19.0.0-157-g021ac167-1jammy ceph-volume=19.0.0-157-g021ac167-1jammy radosgw=19.0.0-157-g021ac167-1jammy python3-rados=19.0.0-157-g021ac167-1jammy python3-rgw=19.0.0-157-g021ac167-1jammy python3-cephfs=19.0.0-157-g021ac167-1jammy python3-rbd=19.0.0-157-g021ac167-1jammy libcephfs2=19.0.0-157-g021ac167-1jammy libcephfs-dev=19.0.0-157-g021ac167-1jammy librados2=19.0.0-157-g021ac167-1jammy librbd1=19.0.0-157-g021ac167-1jammy rbd-fuse=19.0.0-157-g021ac167-1jammy ceph-common-dbg=19.0.0-157-g021ac167-1jammy ceph-fuse-dbg=19.0.0-157-g021ac167-1jammy ceph-mds-dbg=19.0.0-157-g021ac167-1jammy ceph-mgr-dbg=19.0.0-157-g021ac167-1jammy ceph-mon-dbg=19.0.0-157-g021ac167-1jammy ceph-osd-dbg=19.0.0-157-g021ac167-1jammy ceph-test-dbg=19.0.0-157-g021ac167-1jammy libcephfs2-dbg=19.0.0-157-g021ac167-1jammy librados2-dbg=19.0.0-157-g021ac167-1jammy libradosstriper1-dbg=19.0.0-157-g021ac167-1jammy librbd1-dbg=19.0.0-157-g021ac167-1jammy librgw2-dbg=19.0.0-157-g021ac167-1jammy radosgw-dbg=19.0.0-157-g021ac167-1jammy rbd-fuse-dbg=19.0.0-157-g021ac167-1jammy rbd-mirror-dbg=19.0.0-157-g021ac167-1jammy rbd-nbd-dbg=19.0.0-157-g021ac167-1jammy python3-cephfs=19.0.0-157-g021ac167-1jammy cephfs-shell=19.0.0-157-g021ac167-1jammy cephfs-top=19.0.0-157-g021ac167-1jammy cephfs-mirror=19.0.0-157-g021ac167-1jammy 2023-12-13T22:15:21.054 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:15:21.123 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2023-12-13T22:15:21.123 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2023-12-13T22:15:21.242 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-12-13T22:15:21.243 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:15:21.287 INFO:teuthology.orchestra.run.smithi152.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:15:21.288 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-13T22:15:21.289 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-13T22:15:21.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-13T22:15:21.291 INFO:teuthology.orchestra.run.smithi152.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout:Recommended packages: 2023-12-13T22:15:21.292 INFO:teuthology.orchestra.run.smithi152.stdout: btrfs-tools 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:15:21.415 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-13T22:15:21.417 INFO:teuthology.orchestra.run.smithi091.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-13T22:15:21.418 INFO:teuthology.orchestra.run.smithi091.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2023-12-13T22:15:21.419 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-12-13T22:15:21.419 INFO:teuthology.orchestra.run.smithi091.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-13T22:15:21.419 INFO:teuthology.orchestra.run.smithi091.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-13T22:15:21.419 INFO:teuthology.orchestra.run.smithi091.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout:Recommended packages: 2023-12-13T22:15:21.420 INFO:teuthology.orchestra.run.smithi091.stdout: btrfs-tools 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-13T22:15:21.422 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-13T22:15:21.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-13T22:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-13T22:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-13T22:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-12-13T22:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-12-13T22:15:21.424 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2023-12-13T22:15:21.478 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 142 newly installed, 0 to remove and 265 not upgraded. 2023-12-13T22:15:21.478 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 3,015 MB of archives. 2023-12-13T22:15:21.479 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 3,958 MB of additional disk space will be used. 2023-12-13T22:15:21.479 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-13T22:15:21.496 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-13T22:15:21.505 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-13T22:15:21.546 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-12-13T22:15:21.548 INFO:teuthology.orchestra.run.smithi091.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2023-12-13T22:15:21.549 INFO:teuthology.orchestra.run.smithi091.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2023-12-13T22:15:21.549 INFO:teuthology.orchestra.run.smithi091.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-13T22:15:21.549 INFO:teuthology.orchestra.run.smithi091.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-13T22:15:21.550 INFO:teuthology.orchestra.run.smithi091.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-13T22:15:21.551 INFO:teuthology.orchestra.run.smithi091.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-13T22:15:21.551 INFO:teuthology.orchestra.run.smithi091.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-13T22:15:21.551 INFO:teuthology.orchestra.run.smithi091.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2023-12-13T22:15:21.551 INFO:teuthology.orchestra.run.smithi091.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2023-12-13T22:15:21.551 INFO:teuthology.orchestra.run.smithi091.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2023-12-13T22:15:21.567 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-13T22:15:21.569 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-13T22:15:21.580 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-13T22:15:21.628 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-13T22:15:21.631 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-13T22:15:21.642 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-13T22:15:21.643 INFO:teuthology.orchestra.run.smithi091.stdout:0 upgraded, 142 newly installed, 0 to remove and 265 not upgraded. 2023-12-13T22:15:21.643 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 3,015 MB of archives. 2023-12-13T22:15:21.643 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 3,958 MB of additional disk space will be used. 2023-12-13T22:15:21.644 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-13T22:15:21.646 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-13T22:15:21.646 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-13T22:15:21.654 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-13T22:15:21.657 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-13T22:15:21.658 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-13T22:15:21.660 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-13T22:15:21.660 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-13T22:15:21.664 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-13T22:15:21.666 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-13T22:15:21.674 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-13T22:15:21.679 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-13T22:15:21.680 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-13T22:15:21.680 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-13T22:15:21.681 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-13T22:15:21.682 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-13T22:15:21.682 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-13T22:15:21.682 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-13T22:15:21.683 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-13T22:15:21.688 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-13T22:15:21.698 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-13T22:15:21.698 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-13T22:15:21.715 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-13T22:15:21.715 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-13T22:15:21.716 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-13T22:15:21.716 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-13T22:15:21.717 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-13T22:15:21.717 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-13T22:15:21.718 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-13T22:15:21.719 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-13T22:15:21.732 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-13T22:15:21.732 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-13T22:15:21.748 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-13T22:15:21.748 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-13T22:15:21.749 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-13T22:15:21.749 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-13T22:15:21.750 INFO:teuthology.orchestra.run.smithi152.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-13T22:15:21.752 INFO:teuthology.orchestra.run.smithi152.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-13T22:15:21.753 INFO:teuthology.orchestra.run.smithi152.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-13T22:15:21.754 INFO:teuthology.orchestra.run.smithi152.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-13T22:15:21.763 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-13T22:15:21.765 INFO:teuthology.orchestra.run.smithi152.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-13T22:15:21.768 INFO:teuthology.orchestra.run.smithi152.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-157-g021ac167-1jammy [3,465 kB] 2023-12-13T22:15:21.769 INFO:teuthology.orchestra.run.smithi152.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-13T22:15:21.781 INFO:teuthology.orchestra.run.smithi152.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-13T22:15:21.783 INFO:teuthology.orchestra.run.smithi152.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-13T22:15:21.786 INFO:teuthology.orchestra.run.smithi152.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-13T22:15:21.799 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-13T22:15:21.813 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-13T22:15:21.833 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-13T22:15:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-13T22:15:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-13T22:15:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-13T22:15:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-13T22:15:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-13T22:15:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-13T22:15:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-13T22:15:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-13T22:15:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-13T22:15:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-13T22:15:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-13T22:15:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-13T22:15:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-13T22:15:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-13T22:15:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-13T22:15:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-13T22:15:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-13T22:15:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-13T22:15:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-13T22:15:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-13T22:15:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-13T22:15:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-13T22:15:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-13T22:15:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-13T22:15:21.919 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-13T22:15:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-13T22:15:21.924 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-13T22:15:21.926 INFO:teuthology.orchestra.run.smithi152.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-13T22:15:21.927 INFO:teuthology.orchestra.run.smithi152.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-13T22:15:21.939 INFO:teuthology.orchestra.run.smithi152.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-13T22:15:21.939 INFO:teuthology.orchestra.run.smithi152.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-13T22:15:21.940 INFO:teuthology.orchestra.run.smithi152.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-13T22:15:21.940 INFO:teuthology.orchestra.run.smithi152.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-13T22:15:21.942 INFO:teuthology.orchestra.run.smithi152.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-13T22:15:21.942 INFO:teuthology.orchestra.run.smithi152.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-13T22:15:21.943 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-13T22:15:21.948 INFO:teuthology.orchestra.run.smithi152.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-13T22:15:21.949 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-13T22:15:21.950 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-13T22:15:21.956 INFO:teuthology.orchestra.run.smithi152.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-13T22:15:21.956 INFO:teuthology.orchestra.run.smithi152.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-13T22:15:21.958 INFO:teuthology.orchestra.run.smithi152.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-13T22:15:21.962 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-13T22:15:21.968 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-13T22:15:21.972 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-13T22:15:21.973 INFO:teuthology.orchestra.run.smithi152.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-13T22:15:21.975 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-13T22:15:21.975 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-13T22:15:22.017 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-13T22:15:22.019 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-13T22:15:22.022 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-13T22:15:22.023 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-13T22:15:22.023 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-13T22:15:22.025 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-13T22:15:22.026 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-13T22:15:22.026 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-13T22:15:22.027 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-13T22:15:22.038 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-157-g021ac167-1jammy [3,465 kB] 2023-12-13T22:15:22.045 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-13T22:15:22.053 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-13T22:15:22.053 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-13T22:15:22.058 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-13T22:15:22.059 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-13T22:15:22.060 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-13T22:15:22.060 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-13T22:15:22.062 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-13T22:15:22.063 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-13T22:15:22.071 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-13T22:15:22.100 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-13T22:15:22.102 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-13T22:15:22.103 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-13T22:15:22.113 INFO:teuthology.orchestra.run.smithi091.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-13T22:15:22.114 INFO:teuthology.orchestra.run.smithi091.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-13T22:15:22.115 INFO:teuthology.orchestra.run.smithi091.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-13T22:15:22.116 INFO:teuthology.orchestra.run.smithi091.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-13T22:15:22.118 INFO:teuthology.orchestra.run.smithi091.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-13T22:15:22.122 INFO:teuthology.orchestra.run.smithi091.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-13T22:15:22.138 INFO:teuthology.orchestra.run.smithi091.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-13T22:15:22.140 INFO:teuthology.orchestra.run.smithi091.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-13T22:15:22.142 INFO:teuthology.orchestra.run.smithi091.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-13T22:15:22.167 INFO:teuthology.orchestra.run.smithi091.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-13T22:15:22.168 INFO:teuthology.orchestra.run.smithi091.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-13T22:15:22.169 INFO:teuthology.orchestra.run.smithi091.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-13T22:15:22.176 INFO:teuthology.orchestra.run.smithi091.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-13T22:15:22.270 INFO:teuthology.orchestra.run.smithi091.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-13T22:15:22.271 INFO:teuthology.orchestra.run.smithi091.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-13T22:15:22.273 INFO:teuthology.orchestra.run.smithi091.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-13T22:15:22.274 INFO:teuthology.orchestra.run.smithi091.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-13T22:15:22.275 INFO:teuthology.orchestra.run.smithi091.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-13T22:15:22.325 INFO:teuthology.orchestra.run.smithi091.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-13T22:15:22.328 INFO:teuthology.orchestra.run.smithi091.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-13T22:15:22.328 INFO:teuthology.orchestra.run.smithi091.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-13T22:15:22.429 INFO:teuthology.orchestra.run.smithi091.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-13T22:15:22.430 INFO:teuthology.orchestra.run.smithi091.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-13T22:15:22.431 INFO:teuthology.orchestra.run.smithi091.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-13T22:15:22.432 INFO:teuthology.orchestra.run.smithi091.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-13T22:15:22.434 INFO:teuthology.orchestra.run.smithi091.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-13T22:15:22.435 INFO:teuthology.orchestra.run.smithi091.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-13T22:15:22.436 INFO:teuthology.orchestra.run.smithi091.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-13T22:15:22.437 INFO:teuthology.orchestra.run.smithi091.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-13T22:15:22.444 INFO:teuthology.orchestra.run.smithi091.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-13T22:15:22.451 INFO:teuthology.orchestra.run.smithi091.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-13T22:15:22.469 INFO:teuthology.orchestra.run.smithi091.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-13T22:15:22.470 INFO:teuthology.orchestra.run.smithi091.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-13T22:15:22.477 INFO:teuthology.orchestra.run.smithi091.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-13T22:15:22.482 INFO:teuthology.orchestra.run.smithi091.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-13T22:15:22.483 INFO:teuthology.orchestra.run.smithi091.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-13T22:15:22.485 INFO:teuthology.orchestra.run.smithi091.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-13T22:15:22.486 INFO:teuthology.orchestra.run.smithi091.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-13T22:15:22.495 INFO:teuthology.orchestra.run.smithi091.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-13T22:15:22.496 INFO:teuthology.orchestra.run.smithi091.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-13T22:15:22.512 INFO:teuthology.orchestra.run.smithi091.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-13T22:15:22.513 INFO:teuthology.orchestra.run.smithi091.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-13T22:15:22.540 INFO:teuthology.orchestra.run.smithi091.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-13T22:15:22.540 INFO:teuthology.orchestra.run.smithi091.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-13T22:15:22.543 INFO:teuthology.orchestra.run.smithi091.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-13T22:15:22.544 INFO:teuthology.orchestra.run.smithi091.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-13T22:15:22.557 INFO:teuthology.orchestra.run.smithi091.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-13T22:15:22.557 INFO:teuthology.orchestra.run.smithi091.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-13T22:15:22.557 INFO:teuthology.orchestra.run.smithi091.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-13T22:15:22.560 INFO:teuthology.orchestra.run.smithi091.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-13T22:15:22.563 INFO:teuthology.orchestra.run.smithi091.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-13T22:15:23.090 INFO:teuthology.orchestra.run.smithi152.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-157-g021ac167-1jammy [3,110 kB] 2023-12-13T22:15:23.989 INFO:teuthology.orchestra.run.smithi152.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-157-g021ac167-1jammy [689 kB] 2023-12-13T22:15:24.050 INFO:teuthology.orchestra.run.smithi091.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-157-g021ac167-1jammy [3,110 kB] 2023-12-13T22:15:24.192 INFO:teuthology.orchestra.run.smithi152.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-157-g021ac167-1jammy [357 kB] 2023-12-13T22:15:24.323 INFO:teuthology.orchestra.run.smithi152.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-157-g021ac167-1jammy [32.8 kB] 2023-12-13T22:15:24.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-157-g021ac167-1jammy [180 kB] 2023-12-13T22:15:24.397 INFO:teuthology.orchestra.run.smithi152.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-157-g021ac167-1jammy [63.5 kB] 2023-12-13T22:15:24.400 INFO:teuthology.orchestra.run.smithi152.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-157-g021ac167-1jammy [330 kB] 2023-12-13T22:15:24.478 INFO:teuthology.orchestra.run.smithi152.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-157-g021ac167-1jammy [6,210 kB] 2023-12-13T22:15:24.840 INFO:teuthology.orchestra.run.smithi091.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-157-g021ac167-1jammy [689 kB] 2023-12-13T22:15:24.985 INFO:teuthology.orchestra.run.smithi091.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-157-g021ac167-1jammy [357 kB] 2023-12-13T22:15:25.045 INFO:teuthology.orchestra.run.smithi091.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-157-g021ac167-1jammy [32.8 kB] 2023-12-13T22:15:25.048 INFO:teuthology.orchestra.run.smithi091.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-157-g021ac167-1jammy [180 kB] 2023-12-13T22:15:25.086 INFO:teuthology.orchestra.run.smithi091.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-157-g021ac167-1jammy [63.5 kB] 2023-12-13T22:15:25.101 INFO:teuthology.orchestra.run.smithi091.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-157-g021ac167-1jammy [330 kB] 2023-12-13T22:15:25.170 INFO:teuthology.orchestra.run.smithi091.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-157-g021ac167-1jammy [6,210 kB] 2023-12-13T22:15:25.988 INFO:teuthology.orchestra.run.smithi091.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-157-g021ac167-1jammy [112 kB] 2023-12-13T22:15:26.000 INFO:teuthology.orchestra.run.smithi091.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-157-g021ac167-1jammy [439 kB] 2023-12-13T22:15:26.030 INFO:teuthology.orchestra.run.smithi152.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-157-g021ac167-1jammy [112 kB] 2023-12-13T22:15:26.036 INFO:teuthology.orchestra.run.smithi091.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-157-g021ac167-1jammy [22.5 MB] 2023-12-13T22:15:26.043 INFO:teuthology.orchestra.run.smithi152.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-157-g021ac167-1jammy [439 kB] 2023-12-13T22:15:26.094 INFO:teuthology.orchestra.run.smithi152.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-157-g021ac167-1jammy [22.5 MB] 2023-12-13T22:15:27.915 INFO:teuthology.orchestra.run.smithi091.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-157-g021ac167-1jammy [6,900 kB] 2023-12-13T22:15:28.406 INFO:teuthology.orchestra.run.smithi091.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-157-g021ac167-1jammy [238 kB] 2023-12-13T22:15:28.414 INFO:teuthology.orchestra.run.smithi091.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-157-g021ac167-1jammy [124 kB] 2023-12-13T22:15:28.444 INFO:teuthology.orchestra.run.smithi091.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-157-g021ac167-1jammy [1,495 kB] 2023-12-13T22:15:28.553 INFO:teuthology.orchestra.run.smithi091.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-157-g021ac167-1jammy [9,954 kB] 2023-12-13T22:15:28.803 INFO:teuthology.orchestra.run.smithi152.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-157-g021ac167-1jammy [6,900 kB] 2023-12-13T22:15:29.358 INFO:teuthology.orchestra.run.smithi091.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-157-g021ac167-1jammy [31.8 MB] 2023-12-13T22:15:29.445 INFO:teuthology.orchestra.run.smithi152.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-157-g021ac167-1jammy [238 kB] 2023-12-13T22:15:29.466 INFO:teuthology.orchestra.run.smithi152.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-157-g021ac167-1jammy [124 kB] 2023-12-13T22:15:29.474 INFO:teuthology.orchestra.run.smithi152.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-157-g021ac167-1jammy [1,495 kB] 2023-12-13T22:15:29.637 INFO:teuthology.orchestra.run.smithi152.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-157-g021ac167-1jammy [9,954 kB] 2023-12-13T22:15:30.719 INFO:teuthology.orchestra.run.smithi152.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-157-g021ac167-1jammy [31.8 MB] 2023-12-13T22:15:32.085 INFO:teuthology.orchestra.run.smithi091.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-157-g021ac167-1jammy [14.1 kB] 2023-12-13T22:15:32.086 INFO:teuthology.orchestra.run.smithi091.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-157-g021ac167-1jammy [839 kB] 2023-12-13T22:15:32.102 INFO:teuthology.orchestra.run.smithi091.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-157-g021ac167-1jammy [2,143 kB] 2023-12-13T22:15:32.284 INFO:teuthology.orchestra.run.smithi091.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-157-g021ac167-1jammy [828 kB] 2023-12-13T22:15:32.357 INFO:teuthology.orchestra.run.smithi091.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-157-g021ac167-1jammy [139 kB] 2023-12-13T22:15:32.365 INFO:teuthology.orchestra.run.smithi091.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-157-g021ac167-1jammy [1,905 kB] 2023-12-13T22:15:32.529 INFO:teuthology.orchestra.run.smithi091.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-157-g021ac167-1jammy [8,625 kB] 2023-12-13T22:15:33.287 INFO:teuthology.orchestra.run.smithi091.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-157-g021ac167-1jammy [14.2 kB] 2023-12-13T22:15:33.288 INFO:teuthology.orchestra.run.smithi091.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-157-g021ac167-1jammy [48.7 MB] 2023-12-13T22:15:33.882 INFO:teuthology.orchestra.run.smithi152.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-157-g021ac167-1jammy [14.1 kB] 2023-12-13T22:15:33.883 INFO:teuthology.orchestra.run.smithi152.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-157-g021ac167-1jammy [839 kB] 2023-12-13T22:15:33.900 INFO:teuthology.orchestra.run.smithi152.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-157-g021ac167-1jammy [2,143 kB] 2023-12-13T22:15:34.033 INFO:teuthology.orchestra.run.smithi152.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-157-g021ac167-1jammy [828 kB] 2023-12-13T22:15:34.120 INFO:teuthology.orchestra.run.smithi152.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-157-g021ac167-1jammy [139 kB] 2023-12-13T22:15:34.127 INFO:teuthology.orchestra.run.smithi152.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-157-g021ac167-1jammy [1,905 kB] 2023-12-13T22:15:34.313 INFO:teuthology.orchestra.run.smithi152.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-157-g021ac167-1jammy [8,625 kB] 2023-12-13T22:15:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-157-g021ac167-1jammy [14.2 kB] 2023-12-13T22:15:34.967 INFO:teuthology.orchestra.run.smithi152.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-157-g021ac167-1jammy [48.7 MB] 2023-12-13T22:15:38.156 INFO:teuthology.orchestra.run.smithi091.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-157-g021ac167-1jammy [121 kB] 2023-12-13T22:15:38.159 INFO:teuthology.orchestra.run.smithi091.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-157-g021ac167-1jammy [226 kB] 2023-12-13T22:15:38.163 INFO:teuthology.orchestra.run.smithi091.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-157-g021ac167-1jammy [34.0 kB] 2023-12-13T22:15:38.164 INFO:teuthology.orchestra.run.smithi091.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-157-g021ac167-1jammy [23.4 kB] 2023-12-13T22:15:38.166 INFO:teuthology.orchestra.run.smithi091.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-157-g021ac167-1jammy [38.3 kB] 2023-12-13T22:15:38.167 INFO:teuthology.orchestra.run.smithi091.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-157-g021ac167-1jammy [12.3 MB] 2023-12-13T22:15:39.185 INFO:teuthology.orchestra.run.smithi091.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-157-g021ac167-1jammy [91.4 kB] 2023-12-13T22:15:39.187 INFO:teuthology.orchestra.run.smithi091.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-157-g021ac167-1jammy [3,048 kB] 2023-12-13T22:15:39.359 INFO:teuthology.orchestra.run.smithi091.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-157-g021ac167-1jammy [180 kB] 2023-12-13T22:15:39.363 INFO:teuthology.orchestra.run.smithi091.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-157-g021ac167-1jammy [691 MB] 2023-12-13T22:15:39.488 INFO:teuthology.orchestra.run.smithi152.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-157-g021ac167-1jammy [121 kB] 2023-12-13T22:15:39.490 INFO:teuthology.orchestra.run.smithi152.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-157-g021ac167-1jammy [226 kB] 2023-12-13T22:15:39.496 INFO:teuthology.orchestra.run.smithi152.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-157-g021ac167-1jammy [34.0 kB] 2023-12-13T22:15:39.497 INFO:teuthology.orchestra.run.smithi152.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-157-g021ac167-1jammy [23.4 kB] 2023-12-13T22:15:39.498 INFO:teuthology.orchestra.run.smithi152.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-157-g021ac167-1jammy [38.3 kB] 2023-12-13T22:15:39.499 INFO:teuthology.orchestra.run.smithi152.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-157-g021ac167-1jammy [12.3 MB] 2023-12-13T22:15:39.990 INFO:teuthology.orchestra.run.smithi152.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-157-g021ac167-1jammy [91.4 kB] 2023-12-13T22:15:39.992 INFO:teuthology.orchestra.run.smithi152.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-157-g021ac167-1jammy [3,048 kB] 2023-12-13T22:15:40.131 INFO:teuthology.orchestra.run.smithi152.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-157-g021ac167-1jammy [180 kB] 2023-12-13T22:15:40.138 INFO:teuthology.orchestra.run.smithi152.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-157-g021ac167-1jammy [691 MB] 2023-12-13T22:16:15.426 INFO:teuthology.orchestra.run.smithi152.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-157-g021ac167-1jammy [17.3 MB] 2023-12-13T22:16:16.082 INFO:teuthology.orchestra.run.smithi152.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-157-g021ac167-1jammy [75.6 MB] 2023-12-13T22:16:19.851 INFO:teuthology.orchestra.run.smithi152.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-157-g021ac167-1jammy [39.9 MB] 2023-12-13T22:16:21.428 INFO:teuthology.orchestra.run.smithi152.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-157-g021ac167-1jammy [47.7 MB] 2023-12-13T22:16:23.408 INFO:teuthology.orchestra.run.smithi152.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-157-g021ac167-1jammy [247 MB] 2023-12-13T22:16:35.315 INFO:teuthology.orchestra.run.smithi152.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-157-g021ac167-1jammy [916 MB] 2023-12-13T22:17:32.401 INFO:teuthology.orchestra.run.smithi152.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-157-g021ac167-1jammy [15.6 MB] 2023-12-13T22:17:33.086 INFO:teuthology.orchestra.run.smithi152.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-157-g021ac167-1jammy [79.1 MB] 2023-12-13T22:17:36.774 INFO:teuthology.orchestra.run.smithi152.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-157-g021ac167-1jammy [10.5 MB] 2023-12-13T22:17:37.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-157-g021ac167-1jammy [98.4 MB] 2023-12-13T22:17:41.486 INFO:teuthology.orchestra.run.smithi152.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-157-g021ac167-1jammy [166 MB] 2023-12-13T22:17:50.021 INFO:teuthology.orchestra.run.smithi152.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-157-g021ac167-1jammy [323 MB] 2023-12-13T22:17:53.263 INFO:teuthology.orchestra.run.smithi091.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-157-g021ac167-1jammy [17.3 MB] 2023-12-13T22:17:54.317 INFO:teuthology.orchestra.run.smithi091.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-157-g021ac167-1jammy [75.6 MB] 2023-12-13T22:18:00.449 INFO:teuthology.orchestra.run.smithi091.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-157-g021ac167-1jammy [39.9 MB] 2023-12-13T22:18:05.305 INFO:teuthology.orchestra.run.smithi091.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-157-g021ac167-1jammy [47.7 MB] 2023-12-13T22:18:10.539 INFO:teuthology.orchestra.run.smithi152.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-157-g021ac167-1jammy [1,684 kB] 2023-12-13T22:18:10.571 INFO:teuthology.orchestra.run.smithi152.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-157-g021ac167-1jammy [93.5 MB] 2023-12-13T22:18:10.841 INFO:teuthology.orchestra.run.smithi091.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-157-g021ac167-1jammy [247 MB] 2023-12-13T22:18:15.446 INFO:teuthology.orchestra.run.smithi152.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-157-g021ac167-1jammy [2,947 kB] 2023-12-13T22:18:16.106 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 3,015 MB in 2min 54s (17.3 MB/s) 2023-12-13T22:18:16.240 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-13T22:18:16.318 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2023-12-13T22:18:16.323 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-13T22:18:16.364 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-13T22:18:16.633 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-13T22:18:16.660 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-13T22:18:16.700 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-13T22:18:16.995 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cmd2. 2023-12-13T22:18:17.021 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-13T22:18:17.061 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-13T22:18:17.407 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-13T22:18:17.433 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-13T22:18:17.515 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-13T22:18:17.861 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-13T22:18:17.887 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-13T22:18:17.927 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-13T22:18:18.256 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-13T22:18:18.282 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-13T22:18:18.314 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-13T22:18:18.743 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-13T22:18:18.770 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:18:18.818 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:18:19.255 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-13T22:18:19.281 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:18:19.321 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:18:19.650 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-13T22:18:19.677 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:18:19.708 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:18:20.062 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-13T22:18:20.088 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-13T22:18:20.128 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-13T22:18:20.465 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librados2. 2023-12-13T22:18:20.492 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../010-librados2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:20.531 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librados2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:20.959 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librbd1. 2023-12-13T22:18:20.975 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../011-librbd1_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:21.009 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librbd1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:21.463 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs2. 2023-12-13T22:18:21.489 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:21.529 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rados. 2023-12-13T22:18:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../013-python3-rados_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rados (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:22.185 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-13T22:18:22.208 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:22.243 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-argparse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:22.463 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cephfs. 2023-12-13T22:18:22.478 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:22.521 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cephfs (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:22.833 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-13T22:18:22.859 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:22.899 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:23.202 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-prettytable. 2023-12-13T22:18:23.229 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-13T22:18:23.269 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-13T22:18:23.530 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rbd. 2023-12-13T22:18:23.546 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:23.580 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:23.900 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-13T22:18:23.927 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-13T22:18:23.967 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-13T22:18:24.253 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-13T22:18:24.280 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-13T22:18:24.320 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-13T22:18:24.640 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-13T22:18:24.655 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-13T22:18:24.690 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-13T22:18:25.060 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua5.1. 2023-12-13T22:18:25.087 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-13T22:18:25.135 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-13T22:18:25.489 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-any. 2023-12-13T22:18:25.515 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-13T22:18:25.563 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-13T22:18:25.816 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package zip. 2023-12-13T22:18:25.832 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-13T22:18:25.875 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking zip (3.0-12build2) ... 2023-12-13T22:18:26.228 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package unzip. 2023-12-13T22:18:26.255 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-13T22:18:26.303 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-13T22:18:26.782 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package luarocks. 2023-12-13T22:18:26.809 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-13T22:18:26.849 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-13T22:18:27.225 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librgw2. 2023-12-13T22:18:27.251 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../027-librgw2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:27.291 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librgw2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:27.844 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rgw. 2023-12-13T22:18:27.871 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:27.919 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:28.339 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-13T22:18:28.366 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-13T22:18:28.414 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-13T22:18:28.725 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libradosstriper1. 2023-12-13T22:18:28.752 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:28.792 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libradosstriper1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:29.312 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-common. 2023-12-13T22:18:29.339 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../031-ceph-common_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:29.387 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:30.627 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-base. 2023-12-13T22:18:30.653 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../032-ceph-base_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:30.702 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-base (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:31.406 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-13T22:18:31.433 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-13T22:18:31.473 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-13T22:18:31.809 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cheroot. 2023-12-13T22:18:31.836 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-13T22:18:31.884 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-13T22:18:32.271 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-13T22:18:32.298 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-13T22:18:32.346 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-13T22:18:32.699 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-13T22:18:32.726 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-13T22:18:32.766 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-13T22:18:33.052 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-13T22:18:33.079 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-13T22:18:33.119 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-13T22:18:33.481 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempora. 2023-12-13T22:18:33.508 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-13T22:18:33.556 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-13T22:18:33.892 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-portend. 2023-12-13T22:18:33.919 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-13T22:18:33.959 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-13T22:18:34.262 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-13T22:18:34.290 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-13T22:18:34.328 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-13T22:18:34.682 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-13T22:18:34.709 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-13T22:18:34.757 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-13T22:18:35.078 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-natsort. 2023-12-13T22:18:35.105 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-13T22:18:35.136 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-13T22:18:35.415 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-logutils. 2023-12-13T22:18:35.441 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-13T22:18:35.481 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-13T22:18:35.809 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-13T22:18:35.836 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-13T22:18:35.892 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-13T22:18:36.179 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-mako. 2023-12-13T22:18:36.206 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-13T22:18:36.245 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-13T22:18:36.533 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-13T22:18:36.548 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-13T22:18:36.582 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-13T22:18:36.861 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-13T22:18:36.888 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-13T22:18:36.927 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-13T22:18:37.230 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webob. 2023-12-13T22:18:37.257 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-13T22:18:37.305 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-13T22:18:37.659 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-waitress. 2023-12-13T22:18:37.686 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-13T22:18:37.728 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-13T22:18:38.029 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempita. 2023-12-13T22:18:38.055 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-13T22:18:38.103 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-13T22:18:38.483 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-paste. 2023-12-13T22:18:38.509 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-13T22:18:38.557 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-13T22:18:38.860 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-13T22:18:38.876 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-13T22:18:38.918 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-13T22:18:39.313 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-13T22:18:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-13T22:18:39.388 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-13T22:18:39.692 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webtest. 2023-12-13T22:18:39.719 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-13T22:18:39.758 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-13T22:18:40.070 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pecan. 2023-12-13T22:18:40.096 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-13T22:18:40.136 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-13T22:18:40.500 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-certifi. 2023-12-13T22:18:40.527 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-13T22:18:40.567 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-13T22:18:40.870 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-idna. 2023-12-13T22:18:40.896 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-13T22:18:40.928 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-13T22:18:40.935 INFO:teuthology.orchestra.run.smithi091.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-157-g021ac167-1jammy [916 MB] 2023-12-13T22:18:41.207 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-urllib3. 2023-12-13T22:18:41.233 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-13T22:18:41.273 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-13T22:18:41.577 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-requests. 2023-12-13T22:18:41.603 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-13T22:18:41.643 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-13T22:18:41.947 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-13T22:18:41.973 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-13T22:18:42.013 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-13T22:18:42.310 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-13T22:18:42.325 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:42.382 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-modules-core (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:42.782 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-13T22:18:42.809 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:42.840 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:43.151 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-13T22:18:43.178 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-13T22:18:43.218 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-13T22:18:43.521 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-openssl. 2023-12-13T22:18:43.547 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-13T22:18:43.587 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-13T22:18:43.957 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr. 2023-12-13T22:18:43.984 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:44.023 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:44.386 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mon. 2023-12-13T22:18:44.412 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:44.452 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mon (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:45.397 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-osd. 2023-12-13T22:18:45.424 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:45.463 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-osd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:47.501 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph. 2023-12-13T22:18:47.527 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../068-ceph_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:47.567 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:47.845 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-fuse. 2023-12-13T22:18:47.871 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:47.911 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:48.281 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mds. 2023-12-13T22:18:48.308 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:48.347 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mds (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:48.734 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephadm. 2023-12-13T22:18:48.761 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../071-cephadm_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:18:48.800 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:49.129 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-13T22:18:49.155 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-13T22:18:49.186 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-13T22:18:49.506 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-13T22:18:49.534 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-13T22:18:49.572 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-13T22:18:50.545 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-babel. 2023-12-13T22:18:50.572 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-13T22:18:50.611 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-13T22:18:50.939 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jinja2. 2023-12-13T22:18:50.966 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-13T22:18:51.006 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-13T22:18:51.359 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-13T22:18:51.386 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:51.425 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:51.746 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-13T22:18:51.772 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-13T22:18:51.812 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-13T22:18:52.065 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-routes. 2023-12-13T22:18:52.092 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-13T22:18:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-13T22:18:52.443 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-13T22:18:52.470 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:52.510 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-dashboard (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:52.905 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-13T22:18:52.920 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-13T22:18:52.963 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-13T22:18:53.493 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-joblib. 2023-12-13T22:18:53.520 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-13T22:18:53.550 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-13T22:18:53.912 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-13T22:18:53.939 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-13T22:18:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-13T22:18:54.351 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn. 2023-12-13T22:18:54.378 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-13T22:18:54.408 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-13T22:18:55.094 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-13T22:18:55.122 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:55.160 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:56.163 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cachetools. 2023-12-13T22:18:56.190 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-13T22:18:56.230 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-13T22:18:56.491 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-13T22:18:56.506 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-13T22:18:56.541 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-13T22:18:56.853 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-13T22:18:56.880 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-13T22:18:56.919 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-13T22:18:57.214 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rsa. 2023-12-13T22:18:57.241 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-13T22:18:57.281 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-13T22:18:57.601 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-google-auth. 2023-12-13T22:18:57.629 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-13T22:18:57.668 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-13T22:18:57.954 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-13T22:18:57.970 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-13T22:18:58.004 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-13T22:18:58.258 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-websocket. 2023-12-13T22:18:58.285 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-13T22:18:58.324 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-13T22:18:58.644 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-13T22:18:58.671 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-13T22:18:58.711 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-13T22:18:59.333 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-13T22:18:59.349 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:18:59.383 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:18:59.703 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-13T22:18:59.730 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-13T22:18:59.769 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-13T22:19:00.115 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-13T22:19:00.142 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-13T22:19:00.180 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-13T22:19:00.408 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package jq. 2023-12-13T22:19:00.424 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-13T22:19:00.458 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-13T22:19:00.695 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package socat. 2023-12-13T22:19:00.722 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-13T22:19:00.761 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-13T22:19:01.073 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package xmlstarlet. 2023-12-13T22:19:01.088 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-13T22:19:01.131 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-13T22:19:01.494 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-test. 2023-12-13T22:19:01.521 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../099-ceph-test_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:01.560 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-test (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:03.981 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-volume. 2023-12-13T22:19:04.008 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:19:04.047 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-volume (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:04.419 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-13T22:19:04.446 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:04.485 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:04.746 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-colorama. 2023-12-13T22:19:04.762 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-13T22:19:04.805 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-13T22:19:05.057 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-shell. 2023-12-13T22:19:05.084 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:19:05.124 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-shell (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:05.377 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-top. 2023-12-13T22:19:05.392 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:19:05.435 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-top (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:05.713 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-13T22:19:05.740 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:05.779 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs-dev (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:06.099 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-13T22:19:06.126 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-13T22:19:06.165 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-13T22:19:06.487 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-13T22:19:06.514 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-13T22:19:06.553 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-13T22:19:06.915 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package nvme-cli. 2023-12-13T22:19:06.943 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-13T22:19:06.982 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-13T22:19:07.412 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package pkg-config. 2023-12-13T22:19:07.440 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-13T22:19:07.479 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-13T22:19:07.724 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-13T22:19:07.751 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-13T22:19:07.790 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-13T22:19:08.185 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-13T22:19:08.213 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-13T22:19:08.252 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-13T22:19:08.555 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastescript. 2023-12-13T22:19:08.582 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-13T22:19:08.621 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-13T22:19:08.941 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pluggy. 2023-12-13T22:19:08.968 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-13T22:19:09.033 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-13T22:19:09.336 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-psutil. 2023-12-13T22:19:09.364 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-13T22:19:09.402 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-13T22:19:09.731 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-py. 2023-12-13T22:19:09.758 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-13T22:19:09.797 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-13T22:19:10.101 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pygments. 2023-12-13T22:19:10.128 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-13T22:19:10.167 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-13T22:19:10.622 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-13T22:19:10.649 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-13T22:19:10.688 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-13T22:19:11.002 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-toml. 2023-12-13T22:19:11.027 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-13T22:19:11.065 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-13T22:19:11.319 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pytest. 2023-12-13T22:19:11.346 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-13T22:19:11.377 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-13T22:19:11.705 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplejson. 2023-12-13T22:19:11.721 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-13T22:19:11.780 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-13T22:19:12.058 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-13T22:19:12.085 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-13T22:19:12.124 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-13T22:19:12.862 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package radosgw. 2023-12-13T22:19:12.890 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../122-radosgw_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:12.928 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking radosgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:13.690 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-fuse. 2023-12-13T22:19:13.718 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:13.756 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:14.051 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-mirror. 2023-12-13T22:19:14.080 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:14.109 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:14.520 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-nbd. 2023-12-13T22:19:14.537 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-nbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:14.849 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-common-dbg. 2023-12-13T22:19:14.876 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:14.915 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-common-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:22.010 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-12-13T22:19:22.026 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:22.060 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:22.521 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-12-13T22:19:22.549 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:22.587 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mds-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:23.556 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-12-13T22:19:23.584 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:23.648 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:24.309 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-12-13T22:19:24.325 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:24.367 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mon-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:25.320 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-12-13T22:19:25.336 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:25.377 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-osd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:28.538 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-test-dbg. 2023-12-13T22:19:28.555 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:28.597 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-test-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:37.905 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-12-13T22:19:37.918 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:37.954 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:38.357 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librados2-dbg. 2023-12-13T22:19:38.373 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:38.423 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librados2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:39.443 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-12-13T22:19:39.459 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:39.501 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libradosstriper1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:39.903 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librbd1-dbg. 2023-12-13T22:19:39.919 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:39.953 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librbd1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:41.198 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librgw2-dbg. 2023-12-13T22:19:41.226 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:41.264 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librgw2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:43.075 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package radosgw-dbg. 2023-12-13T22:19:43.091 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:43.133 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking radosgw-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:46.469 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-12-13T22:19:46.485 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:46.527 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:46.780 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-12-13T22:19:46.796 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:46.830 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-mirror-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:47.991 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-12-13T22:19:48.019 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:19:48.049 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-nbd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:48.380 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-13T22:19:48.638 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-13T22:19:48.756 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-13T22:19:49.013 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-13T22:19:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-13T22:19:49.807 INFO:teuthology.orchestra.run.smithi152.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-13T22:19:49.875 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:50.443 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user cephadm....done 2023-12-13T22:19:50.566 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-13T22:19:50.834 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-13T22:19:51.094 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-13T22:19:51.211 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-13T22:19:51.462 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-13T22:19:51.713 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-13T22:19:51.839 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-13T22:19:52.149 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-13T22:19:52.501 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-13T22:19:52.769 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-13T22:19:53.020 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-13T22:19:53.296 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-13T22:19:53.547 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-13T22:19:53.798 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-13T22:19:54.145 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-13T22:19:54.426 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-argparse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:19:54.685 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-13T22:19:54.811 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-13T22:19:54.937 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-13T22:19:55.188 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-13T22:19:55.314 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-13T22:19:55.581 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-13T22:19:55.976 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-13T22:19:56.012 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-13T22:19:56.076 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-13T22:19:56.202 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-13T22:19:56.570 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-13T22:19:56.671 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-13T22:19:56.947 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-13T22:19:57.214 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-13T22:19:57.524 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up zip (3.0-12build2) ... 2023-12-13T22:19:57.650 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-13T22:19:58.344 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-13T22:19:58.595 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-13T22:19:58.720 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-13T22:19:58.846 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-13T22:19:59.164 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-13T22:19:59.549 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-13T22:19:59.800 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-13T22:20:00.178 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-13T22:20:00.461 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-13T22:20:00.765 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-13T22:20:01.105 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-13T22:20:01.364 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-13T22:20:01.473 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:01.749 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-idna (3.3-1) ... 2023-12-13T22:20:02.050 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-13T22:20:03.156 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-13T22:20:03.416 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:03.567 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-13T22:20:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-13T22:20:03.952 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-13T22:20:04.078 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-13T22:20:04.371 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-13T22:20:04.630 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-13T22:20:04.873 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:04.999 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-13T22:20:05.300 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-13T22:20:05.551 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-13T22:20:05.836 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-13T22:20:06.086 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-13T22:20:06.346 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-13T22:20:06.613 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-13T22:20:06.739 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-13T22:20:07.015 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-13T22:20:07.133 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-13T22:20:07.434 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-13T22:20:07.735 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-13T22:20:07.969 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-13T22:20:08.095 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-13T22:20:08.222 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-13T22:20:08.311 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-13T22:20:08.564 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-13T22:20:08.691 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-13T22:20:09.076 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-13T22:20:09.335 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-13T22:20:09.461 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-13T22:20:09.728 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:09.854 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-13T22:20:10.180 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-13T22:20:10.464 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-13T22:20:10.724 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-13T22:20:10.935 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-13T22:20:11.195 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-13T22:20:11.488 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-13T22:20:11.764 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-13T22:20:12.166 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-13T22:20:12.467 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-13T22:20:12.803 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-13T22:20:12.929 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librados2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:13.055 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libsqlite3-mod-ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:13.181 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-13T22:20:13.517 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:13.634 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libradosstriper1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:13.744 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-13T22:20:14.278 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librados2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:14.404 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librbd1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:14.530 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:14.631 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-modules-core (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:14.732 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:14.934 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-13T22:20:14.934 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-13T22:20:15.450 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libradosstriper1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:15.585 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs-dev (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:16.061 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:16.187 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rados (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:16.313 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librgw2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:16.439 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-top (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:16.565 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-13T22:20:17.727 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librbd1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:17.793 INFO:teuthology.orchestra.run.smithi091.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-157-g021ac167-1jammy [15.6 MB] 2023-12-13T22:20:17.852 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:17.978 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librgw2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.104 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.230 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-nbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.356 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.482 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cephfs (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.616 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-nbd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.725 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-shell (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.786 INFO:teuthology.orchestra.run.smithi091.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-157-g021ac167-1jammy [79.1 MB] 2023-12-13T22:20:18.827 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:18.978 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:19.520 INFO:teuthology.orchestra.run.smithi152.stdout:Adding group ceph....done 2023-12-13T22:20:19.913 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user ceph....done 2023-12-13T22:20:20.140 INFO:teuthology.orchestra.run.smithi152.stdout:Setting system user ceph properties....done 2023-12-13T22:20:20.160 INFO:teuthology.orchestra.run.smithi152.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-13T22:20:20.296 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-13T22:20:20.633 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-13T22:20:21.137 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-13T22:20:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-13T22:20:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-test (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:21.964 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up radosgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:22.438 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-13T22:20:22.438 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-13T22:20:22.915 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-base (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:23.258 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-13T22:20:23.447 INFO:teuthology.orchestra.run.smithi091.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-157-g021ac167-1jammy [10.5 MB] 2023-12-13T22:20:23.697 INFO:teuthology.orchestra.run.smithi091.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-157-g021ac167-1jammy [98.4 MB] 2023-12-13T22:20:23.759 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mds (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:23.953 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-13T22:20:23.953 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-13T22:20:24.453 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-common-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:24.578 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:24.789 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-13T22:20:24.789 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-13T22:20:25.280 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:25.498 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-13T22:20:25.498 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-13T22:20:26.006 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mds-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:26.107 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up radosgw-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:26.216 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-test-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:26.342 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-osd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:26.619 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-13T22:20:26.620 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-13T22:20:27.118 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.244 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-osd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.370 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-mirror-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.403 INFO:teuthology.orchestra.run.smithi091.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-157-g021ac167-1jammy [166 MB] 2023-12-13T22:20:27.496 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-k8sevents (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.622 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.756 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mon (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:27.951 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-13T22:20:27.951 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-13T22:20:28.449 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:28.575 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:28.701 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-dashboard (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:28.852 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mon-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:29.011 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-volume (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:29.364 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-13T22:20:29.524 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-13T22:20:29.668 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-13T22:20:30.752 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-13T22:20:31.404 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-13T22:20:31.407 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-13T22:20:31.460 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2023-12-13T22:20:31.649 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2023-12-13T22:20:31.650 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2023-12-13T22:20:31.818 INFO:teuthology.orchestra.run.smithi152.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:20:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-13T22:20:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-13T22:20:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-13T22:20:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-13T22:20:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-13T22:20:31.822 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2023-12-13T22:20:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-13T22:20:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-13T22:20:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: libengine-pkcs11-openssl 2023-12-13T22:20:31.861 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2023-12-13T22:20:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-13T22:20:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-13T22:20:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-13T22:20:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-13T22:20:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-13T22:20:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-13T22:20:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-13T22:20:31.864 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2023-12-13T22:20:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: libssl3 2023-12-13T22:20:31.933 INFO:teuthology.orchestra.run.smithi152.stdout:1 upgraded, 39 newly installed, 0 to remove and 264 not upgraded. 2023-12-13T22:20:31.933 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 54.6 MB of archives. 2023-12-13T22:20:31.934 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-13T22:20:31.934 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-13T22:20:32.033 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-13T22:20:32.096 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-13T22:20:32.109 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-13T22:20:32.110 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-13T22:20:32.113 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-13T22:20:32.114 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-13T22:20:32.115 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-13T22:20:32.117 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-13T22:20:32.118 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-13T22:20:32.119 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-13T22:20:32.119 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-13T22:20:32.134 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-13T22:20:32.463 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-13T22:20:32.465 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-13T22:20:32.465 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-13T22:20:32.468 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-13T22:20:32.494 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-13T22:20:32.500 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-13T22:20:32.502 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-13T22:20:32.511 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-13T22:20:32.511 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-13T22:20:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-13T22:20:32.539 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-13T22:20:32.551 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-13T22:20:32.572 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-13T22:20:32.574 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-13T22:20:32.575 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-13T22:20:32.575 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-13T22:20:32.576 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-13T22:20:32.586 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-13T22:20:32.588 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-13T22:20:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-13T22:20:32.812 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-13T22:20:32.812 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-13T22:20:33.215 INFO:teuthology.orchestra.run.smithi152.stdout:Preconfiguring packages ... 2023-12-13T22:20:33.368 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 54.6 MB in 1s (58.0 MB/s) 2023-12-13T22:20:33.516 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package flex. 2023-12-13T22:20:33.617 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2023-12-13T22:20:33.622 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-13T22:20:33.626 INFO:teuthology.orchestra.run.smithi091.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-157-g021ac167-1jammy [323 MB] 2023-12-13T22:20:33.664 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-13T22:20:34.233 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-13T22:20:34.403 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-13T22:20:34.965 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:20:35.514 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package bison. 2023-12-13T22:20:35.617 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2023-12-13T22:20:35.623 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-13T22:20:35.674 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-13T22:20:36.075 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-13T22:20:36.102 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-13T22:20:36.133 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-13T22:20:36.436 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package dump. 2023-12-13T22:20:36.464 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-13T22:20:36.502 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking dump (0.4b47-3) ... 2023-12-13T22:20:36.789 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package indent. 2023-12-13T22:20:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:36.847 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-13T22:20:37.116 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-13T22:20:37.132 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-13T22:20:37.174 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-13T22:20:37.478 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-13T22:20:37.505 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-13T22:20:37.536 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-13T22:20:37.796 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-13T22:20:37.813 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-13T22:20:37.855 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-13T22:20:38.183 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-13T22:20:38.211 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-13T22:20:38.250 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-13T22:20:38.502 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-13T22:20:38.518 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-13T22:20:38.560 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-13T22:20:38.771 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjson-perl. 2023-12-13T22:20:38.787 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-13T22:20:38.829 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-13T22:20:39.173 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-13T22:20:39.201 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-13T22:20:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-13T22:20:40.902 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-13T22:20:40.930 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-13T22:20:40.968 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:20:41.212 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-13T22:20:41.229 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-13T22:20:41.262 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:20:41.556 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-13T22:20:41.585 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-13T22:20:41.623 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:20:41.978 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-13T22:20:42.005 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-13T22:20:42.044 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-13T22:20:42.355 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-13T22:20:42.383 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-13T22:20:42.414 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-13T22:20:42.757 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-13T22:20:42.786 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:42.824 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:20:43.177 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-13T22:20:43.204 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:43.243 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:20:43.554 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-13T22:20:43.582 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:43.620 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:20:43.830 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-13T22:20:43.847 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-13T22:20:43.880 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:20:44.401 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-13T22:20:44.428 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-13T22:20:44.475 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-13T22:20:45.282 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package modemmanager. 2023-12-13T22:20:45.309 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-13T22:20:45.354 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:20:45.867 INFO:teuthology.orchestra.run.smithi091.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-157-g021ac167-1jammy [1,684 kB] 2023-12-13T22:20:45.899 INFO:teuthology.orchestra.run.smithi091.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-157-g021ac167-1jammy [93.5 MB] 2023-12-13T22:20:45.985 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package network-manager. 2023-12-13T22:20:46.013 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-13T22:20:46.068 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-13T22:20:46.708 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ppp. 2023-12-13T22:20:46.736 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-13T22:20:47.024 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-13T22:20:47.354 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package pptp-linux. 2023-12-13T22:20:47.370 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-13T22:20:47.404 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-13T22:20:47.631 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-13T22:20:47.648 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-13T22:20:47.681 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-13T22:20:47.959 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-13T22:20:47.987 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-13T22:20:48.025 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client-common (238) ... 2023-12-13T22:20:48.329 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-13T22:20:48.357 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:48.395 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:20:48.958 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-common. 2023-12-13T22:20:48.987 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-13T22:20:49.035 INFO:teuthology.orchestra.run.smithi152.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-13T22:20:49.065 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-common (238) ... 2023-12-13T22:20:49.532 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-14. 2023-12-13T22:20:49.560 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:20:49.601 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:20:51.068 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql. 2023-12-13T22:20:51.085 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-13T22:20:51.118 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql (14+238) ... 2023-12-13T22:20:51.503 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-client. 2023-12-13T22:20:51.531 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-13T22:20:51.572 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-client (14+238) ... 2023-12-13T22:20:51.814 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-13T22:20:51.830 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-13T22:20:51.872 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-13T22:20:52.216 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package tcl8.6. 2023-12-13T22:20:52.245 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-13T22:20:52.282 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-13T22:20:52.543 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package tcl. 2023-12-13T22:20:52.571 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-13T22:20:52.607 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-13T22:20:52.938 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package wpasupplicant. 2023-12-13T22:20:52.966 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-13T22:20:53.004 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-13T22:20:53.358 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-13T22:20:53.386 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-13T22:20:53.425 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-13T22:20:53.751 INFO:teuthology.orchestra.run.smithi091.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-12-12-1229/021ac1670a21c19759080c6da90baaeb42e7d175/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-157-g021ac167-1jammy [2,947 kB] 2023-12-13T22:20:53.761 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-13T22:20:53.790 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-13T22:20:53.836 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-13T22:20:54.107 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client-common (238) ... 2023-12-13T22:20:54.317 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-13T22:20:54.443 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-13T22:20:54.514 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 3,015 MB in 5min 32s (9,072 kB/s) 2023-12-13T22:20:54.569 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:20:54.648 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-13T22:20:54.694 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-13T22:20:54.744 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2023-12-13T22:20:54.749 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-13T22:20:54.796 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-13T22:20:54.804 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-13T22:20:54.913 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:20:55.074 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-13T22:20:55.100 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-13T22:20:55.141 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-13T22:20:55.410 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cmd2. 2023-12-13T22:20:55.417 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-13T22:20:55.436 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-13T22:20:55.468 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-13T22:20:55.485 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-13T22:20:55.780 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-13T22:20:55.806 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-13T22:20:55.880 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-13T22:20:55.898 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-13T22:20:55.898 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-13T22:20:56.233 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-13T22:20:56.259 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-13T22:20:56.300 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-13T22:20:56.405 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-13T22:20:56.539 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:20:56.636 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-13T22:20:56.662 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-13T22:20:56.664 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-13T22:20:56.703 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-13T22:20:56.791 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-13T22:20:56.916 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-13T22:20:57.042 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-13T22:20:57.139 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-13T22:20:57.165 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:20:57.177 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-13T22:20:57.214 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:57.559 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-13T22:20:57.585 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:20:57.650 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:57.756 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-13T22:20:57.882 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up dump (0.4b47-3) ... 2023-12-13T22:20:57.977 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-13T22:20:57.981 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-13T22:20:58.005 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-13T22:20:58.042 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:20:58.045 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:20:58.177 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-13T22:20:58.303 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-13T22:20:58.382 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-13T22:20:58.408 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-13T22:20:58.429 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-13T22:20:58.448 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-13T22:20:58.538 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-13T22:20:58.612 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-13T22:20:58.664 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-13T22:20:58.717 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librados2. 2023-12-13T22:20:58.733 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../010-librados2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:20:58.767 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:58.790 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-13T22:20:59.008 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-13T22:20:59.134 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:20:59.229 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librbd1. 2023-12-13T22:20:59.255 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../011-librbd1_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:20:59.269 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-13T22:20:59.295 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:20:59.437 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-client (14+238) ... 2023-12-13T22:20:59.562 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-13T22:20:59.706 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2. 2023-12-13T22:20:59.733 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:20:59.764 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout:which means they are currently configured by ifupdown: 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout:- enp3s0f1 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout:remove their configuration from /etc/network/interfaces. 2023-12-13T22:21:00.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:00.025 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rados. 2023-12-13T22:21:00.040 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../013-python3-rados_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:00.083 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rados (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:00.137 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-13T22:21:00.403 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-13T22:21:00.429 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:00.445 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-13T22:21:00.469 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-argparse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:00.730 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cephfs. 2023-12-13T22:21:00.756 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:00.761 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-13T22:21:00.788 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cephfs (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:01.083 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-13T22:21:01.109 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:01.149 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:01.273 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:21:01.424 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-13T22:21:01.477 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-prettytable. 2023-12-13T22:21:01.504 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-13T22:21:01.544 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-13T22:21:01.550 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-13T22:21:01.735 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-common (238) ... 2023-12-13T22:21:01.805 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rbd. 2023-12-13T22:21:01.831 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:01.873 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:02.208 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-13T22:21:02.234 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-13T22:21:02.266 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-13T22:21:02.655 INFO:teuthology.orchestra.run.smithi152.stdout:Adding user postgres to group ssl-cert 2023-12-13T22:21:02.718 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-13T22:21:02.744 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-13T22:21:02.785 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-13T22:21:02.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:02.880 INFO:teuthology.orchestra.run.smithi152.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-13T22:21:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-13T22:21:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:Removing obsolete dictionary files: 2023-12-13T22:21:03.087 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-13T22:21:03.103 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-13T22:21:03.146 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-13T22:21:03.474 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package lua5.1. 2023-12-13T22:21:03.500 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-13T22:21:03.540 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-13T22:21:03.607 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-13T22:21:03.818 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package lua-any. 2023-12-13T22:21:03.833 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-13T22:21:03.885 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-13T22:21:03.994 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:21:04.112 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package zip. 2023-12-13T22:21:04.128 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-13T22:21:04.171 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking zip (3.0-12build2) ... 2023-12-13T22:21:04.316 INFO:teuthology.orchestra.run.smithi152.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-13T22:21:04.334 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-13T22:21:04.385 INFO:teuthology.orchestra.run.smithi152.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-13T22:21:04.385 INFO:teuthology.orchestra.run.smithi152.stdout:This user must also own the server process. 2023-12-13T22:21:04.385 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:04.385 INFO:teuthology.orchestra.run.smithi152.stdout:The database cluster will be initialized with locale "en_US". 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:The default text search configuration will be set to "english". 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:Data page checksums are disabled. 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:creating subdirectories ... ok 2023-12-13T22:21:04.386 INFO:teuthology.orchestra.run.smithi152.stdout:selecting dynamic shared memory implementation ... posix 2023-12-13T22:21:04.401 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default max_connections ... 100 2023-12-13T22:21:04.421 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default shared_buffers ... 128MB 2023-12-13T22:21:04.428 INFO:teuthology.orchestra.run.smithi152.stdout:selecting default time zone ... Etc/UTC 2023-12-13T22:21:04.428 INFO:teuthology.orchestra.run.smithi152.stdout:creating configuration files ... ok 2023-12-13T22:21:04.516 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package unzip. 2023-12-13T22:21:04.541 INFO:teuthology.orchestra.run.smithi152.stdout:running bootstrap script ... ok 2023-12-13T22:21:04.542 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-13T22:21:04.582 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-13T22:21:04.969 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package luarocks. 2023-12-13T22:21:04.995 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-13T22:21:05.036 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-13T22:21:05.180 INFO:teuthology.orchestra.run.smithi152.stdout:performing post-bootstrap initialization ... ok 2023-12-13T22:21:05.427 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2. 2023-12-13T22:21:05.453 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../027-librgw2_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:05.493 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:05.897 INFO:teuthology.orchestra.run.smithi152.stdout:syncing data to disk ... ok 2023-12-13T22:21:06.021 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rgw. 2023-12-13T22:21:06.047 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:06.087 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:06.295 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-13T22:21:06.373 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-13T22:21:06.389 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-13T22:21:06.432 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-13T22:21:06.743 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1. 2023-12-13T22:21:06.770 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:06.809 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:07.213 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common. 2023-12-13T22:21:07.239 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../031-ceph-common_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:07.279 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:08.484 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-base. 2023-12-13T22:21:08.511 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../032-ceph-base_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:08.551 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-base (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:09.074 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:21:09.209 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-13T22:21:09.230 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-13T22:21:09.257 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-13T22:21:09.296 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-13T22:21:09.318 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up postgresql (14+238) ... 2023-12-13T22:21:09.419 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:21:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:21:09.599 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cheroot. 2023-12-13T22:21:09.626 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-13T22:21:09.666 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-13T22:21:09.772 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-13T22:21:09.772 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-13T22:21:10.011 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-13T22:21:10.037 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-13T22:21:10.077 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-13T22:21:10.323 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-13T22:21:10.380 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-13T22:21:10.407 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-13T22:21:10.446 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-13T22:21:10.692 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-13T22:21:10.749 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-13T22:21:10.776 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-13T22:21:10.816 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-13T22:21:10.868 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-13T22:21:11.093 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempora. 2023-12-13T22:21:11.120 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-13T22:21:11.160 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-13T22:21:11.446 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-portend. 2023-12-13T22:21:11.473 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-13T22:21:11.514 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-13T22:21:11.815 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-13T22:21:11.842 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-13T22:21:11.882 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-13T22:21:12.185 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-13T22:21:12.211 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-13T22:21:12.251 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-13T22:21:12.570 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-13T22:21:12.599 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-natsort. 2023-12-13T22:21:12.626 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-13T22:21:12.661 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-13T22:21:12.665 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-13T22:21:12.960 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-logutils. 2023-12-13T22:21:12.987 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-13T22:21:13.026 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-13T22:21:13.172 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-13T22:21:13.177 DEBUG:teuthology.parallel:result is None 2023-12-13T22:21:13.279 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-13T22:21:13.306 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-13T22:21:13.346 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-13T22:21:13.657 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-mako. 2023-12-13T22:21:13.684 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-13T22:21:13.723 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-13T22:21:13.993 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-13T22:21:14.017 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-13T22:21:14.051 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-13T22:21:14.363 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-13T22:21:14.390 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-13T22:21:14.429 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-13T22:21:14.732 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webob. 2023-12-13T22:21:14.759 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-13T22:21:14.798 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-13T22:21:15.143 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-waitress. 2023-12-13T22:21:15.170 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-13T22:21:15.213 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-13T22:21:15.521 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-tempita. 2023-12-13T22:21:15.548 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-13T22:21:15.588 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-13T22:21:15.849 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-paste. 2023-12-13T22:21:15.876 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-13T22:21:15.915 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-13T22:21:16.235 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-13T22:21:16.251 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-13T22:21:16.293 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-13T22:21:16.579 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-13T22:21:16.606 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-13T22:21:16.646 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-13T22:21:16.932 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-webtest. 2023-12-13T22:21:16.959 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-13T22:21:16.999 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-13T22:21:17.310 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pecan. 2023-12-13T22:21:17.337 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-13T22:21:17.376 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-13T22:21:17.731 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-certifi. 2023-12-13T22:21:17.759 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-13T22:21:17.798 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-13T22:21:18.077 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-idna. 2023-12-13T22:21:18.102 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-13T22:21:18.142 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-13T22:21:18.453 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-urllib3. 2023-12-13T22:21:18.480 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-13T22:21:18.520 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-13T22:21:18.873 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests. 2023-12-13T22:21:18.900 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-13T22:21:18.940 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-13T22:21:19.251 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-13T22:21:19.277 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-13T22:21:19.317 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-13T22:21:19.620 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-13T22:21:19.636 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:19.678 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-modules-core (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:20.067 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-13T22:21:20.094 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:20.133 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:20.436 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-13T22:21:20.463 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-13T22:21:20.502 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-13T22:21:20.789 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-openssl. 2023-12-13T22:21:20.812 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-13T22:21:20.847 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-13T22:21:21.158 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr. 2023-12-13T22:21:21.185 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:21.225 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:21.611 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon. 2023-12-13T22:21:21.638 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:21.678 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:22.615 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd. 2023-12-13T22:21:22.641 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:22.681 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:24.417 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph. 2023-12-13T22:21:24.432 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../068-ceph_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:24.484 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:24.803 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse. 2023-12-13T22:21:24.829 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:24.869 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:25.257 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds. 2023-12-13T22:21:25.283 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:25.322 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:25.659 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephadm. 2023-12-13T22:21:25.675 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../071-cephadm_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:25.708 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:26.028 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-13T22:21:26.055 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-13T22:21:26.094 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-13T22:21:26.381 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-13T22:21:26.396 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-13T22:21:26.430 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-13T22:21:27.369 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-babel. 2023-12-13T22:21:27.385 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-13T22:21:27.419 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-13T22:21:27.722 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-jinja2. 2023-12-13T22:21:27.750 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-13T22:21:27.789 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-13T22:21:28.134 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-13T22:21:28.161 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:28.200 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:28.545 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-13T22:21:28.572 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-13T22:21:28.612 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-13T22:21:28.931 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-routes. 2023-12-13T22:21:28.959 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-13T22:21:28.998 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-13T22:21:29.360 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-13T22:21:29.386 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:29.426 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dashboard (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:29.854 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-13T22:21:29.882 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-13T22:21:29.921 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-13T22:21:30.416 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-joblib. 2023-12-13T22:21:30.443 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-13T22:21:30.482 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-13T22:21:30.869 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-13T22:21:30.896 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-13T22:21:31.021 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-13T22:21:31.324 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-sklearn. 2023-12-13T22:21:31.351 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-13T22:21:31.390 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-13T22:21:32.166 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-13T22:21:32.193 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:32.232 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:33.210 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-cachetools. 2023-12-13T22:21:33.238 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-13T22:21:33.277 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-13T22:21:33.838 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-13T22:21:33.865 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-13T22:21:33.904 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-13T22:21:34.200 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-13T22:21:34.227 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-13T22:21:34.258 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-13T22:21:34.527 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-rsa. 2023-12-13T22:21:34.555 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-13T22:21:34.594 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-13T22:21:34.914 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-google-auth. 2023-12-13T22:21:34.942 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-13T22:21:34.981 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-13T22:21:35.301 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-13T22:21:35.328 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-13T22:21:35.367 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-13T22:21:35.662 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-websocket. 2023-12-13T22:21:35.689 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-13T22:21:35.720 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-13T22:21:36.040 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-13T22:21:36.067 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-13T22:21:36.106 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-13T22:21:36.812 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-13T22:21:36.828 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:36.879 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:37.173 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-13T22:21:37.201 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-13T22:21:37.239 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-13T22:21:37.576 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-13T22:21:37.603 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-13T22:21:37.642 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-13T22:21:37.903 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package jq. 2023-12-13T22:21:37.919 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-13T22:21:37.961 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-13T22:21:38.173 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package socat. 2023-12-13T22:21:38.200 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-13T22:21:38.231 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-13T22:21:38.517 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package xmlstarlet. 2023-12-13T22:21:38.533 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-13T22:21:38.575 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-13T22:21:38.913 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test. 2023-12-13T22:21:38.929 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../099-ceph-test_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:38.963 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:41.217 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-volume. 2023-12-13T22:21:41.244 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:41.283 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-volume (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:41.679 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-13T22:21:41.707 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:41.746 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:42.057 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-colorama. 2023-12-13T22:21:42.084 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-13T22:21:42.123 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-13T22:21:42.376 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-shell. 2023-12-13T22:21:42.392 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:42.434 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-shell (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:42.678 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package cephfs-top. 2023-12-13T22:21:42.694 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-157-g021ac167-1jammy_all.deb ... 2023-12-13T22:21:42.728 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking cephfs-top (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:42.964 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-13T22:21:42.980 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:43.022 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs-dev (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:43.342 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-13T22:21:43.369 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-13T22:21:43.408 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-13T22:21:43.763 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-13T22:21:43.790 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-13T22:21:43.829 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-13T22:21:44.133 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package nvme-cli. 2023-12-13T22:21:44.160 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-13T22:21:44.199 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-13T22:21:44.605 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package pkg-config. 2023-12-13T22:21:44.632 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-13T22:21:44.663 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-13T22:21:44.916 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-13T22:21:44.943 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-13T22:21:44.982 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-13T22:21:45.377 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-13T22:21:45.404 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-13T22:21:45.443 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-13T22:21:45.755 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pastescript. 2023-12-13T22:21:45.782 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-13T22:21:45.821 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-13T22:21:46.149 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pluggy. 2023-12-13T22:21:46.177 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-13T22:21:46.216 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-13T22:21:46.510 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-psutil. 2023-12-13T22:21:46.538 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-13T22:21:46.577 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-13T22:21:46.930 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-py. 2023-12-13T22:21:46.957 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-13T22:21:47.005 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-13T22:21:47.341 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pygments. 2023-12-13T22:21:47.369 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-13T22:21:47.408 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-13T22:21:47.853 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-13T22:21:47.878 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-13T22:21:47.911 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-13T22:21:48.214 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-toml. 2023-12-13T22:21:48.242 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-13T22:21:48.281 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-13T22:21:48.584 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-pytest. 2023-12-13T22:21:48.611 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-13T22:21:48.650 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-13T22:21:48.970 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package python3-simplejson. 2023-12-13T22:21:48.998 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-13T22:21:49.036 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-13T22:21:49.308 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-13T22:21:49.335 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-13T22:21:49.374 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-13T22:21:50.112 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw. 2023-12-13T22:21:50.140 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../122-radosgw_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:50.178 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:50.939 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse. 2023-12-13T22:21:50.955 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:50.989 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:51.325 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-mirror. 2023-12-13T22:21:51.353 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:51.392 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:51.778 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-nbd. 2023-12-13T22:21:51.793 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:51.836 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-nbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:52.080 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-common-dbg. 2023-12-13T22:21:52.108 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:52.146 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-common-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:58.892 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-fuse-dbg. 2023-12-13T22:21:58.907 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:58.941 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:21:59.644 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mds-dbg. 2023-12-13T22:21:59.672 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:21:59.710 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mds-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:00.679 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mgr-dbg. 2023-12-13T22:22:00.708 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:00.746 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mgr-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:01.415 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-mon-dbg. 2023-12-13T22:22:01.443 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:01.481 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-mon-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:02.417 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-osd-dbg. 2023-12-13T22:22:02.433 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:02.467 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-osd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:05.537 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ceph-test-dbg. 2023-12-13T22:22:05.564 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:05.603 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ceph-test-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:14.460 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libcephfs2-dbg. 2023-12-13T22:22:14.476 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:14.518 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libcephfs2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:14.937 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librados2-dbg. 2023-12-13T22:22:14.953 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:14.995 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librados2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:15.973 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libradosstriper1-dbg. 2023-12-13T22:22:15.989 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:16.031 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libradosstriper1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:16.400 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librbd1-dbg. 2023-12-13T22:22:16.428 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:16.466 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librbd1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:17.678 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package librgw2-dbg. 2023-12-13T22:22:17.706 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:17.736 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking librgw2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:19.538 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package radosgw-dbg. 2023-12-13T22:22:19.566 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:19.604 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking radosgw-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:22.782 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-fuse-dbg. 2023-12-13T22:22:22.798 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:22.840 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:23.143 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-mirror-dbg. 2023-12-13T22:22:23.171 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:23.209 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-mirror-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:24.361 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package rbd-nbd-dbg. 2023-12-13T22:22:24.377 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-157-g021ac167-1jammy_amd64.deb ... 2023-12-13T22:22:24.419 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking rbd-nbd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:24.758 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-13T22:22:25.000 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-13T22:22:25.126 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-13T22:22:25.392 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-13T22:22:25.776 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-13T22:22:26.219 INFO:teuthology.orchestra.run.smithi091.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-13T22:22:26.363 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:27.361 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user cephadm....done 2023-12-13T22:22:27.659 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-13T22:22:27.995 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-13T22:22:28.246 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-13T22:22:28.372 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-13T22:22:28.624 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-13T22:22:28.875 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-13T22:22:29.001 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-13T22:22:29.302 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-13T22:22:29.662 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-13T22:22:29.922 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-13T22:22:30.173 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-13T22:22:30.475 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-13T22:22:30.809 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-13T22:22:31.069 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-13T22:22:31.328 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-13T22:22:31.579 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-argparse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:31.839 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-13T22:22:31.965 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-13T22:22:32.099 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-13T22:22:32.359 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-13T22:22:32.485 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-13T22:22:32.811 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-13T22:22:33.350 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-13T22:22:33.384 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-13T22:22:33.447 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-13T22:22:33.548 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-13T22:22:33.908 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-13T22:22:34.051 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-13T22:22:34.319 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-13T22:22:34.586 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-13T22:22:34.896 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up zip (3.0-12build2) ... 2023-12-13T22:22:35.022 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-13T22:22:35.715 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-13T22:22:35.984 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-13T22:22:36.109 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-13T22:22:36.644 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-13T22:22:36.945 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-13T22:22:37.321 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-13T22:22:37.580 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-13T22:22:37.949 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-13T22:22:38.233 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-13T22:22:38.543 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-13T22:22:38.894 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-13T22:22:39.146 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-13T22:22:39.271 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:39.573 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-idna (3.3-1) ... 2023-12-13T22:22:39.932 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-13T22:22:41.121 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-13T22:22:41.390 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:22:41.524 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-13T22:22:41.792 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-13T22:22:41.918 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-13T22:22:42.044 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-13T22:22:42.337 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-13T22:22:42.571 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-13T22:22:42.814 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:22:42.949 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-13T22:22:43.250 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-13T22:22:43.501 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-13T22:22:43.769 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-13T22:22:44.029 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-13T22:22:44.279 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-13T22:22:44.539 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-13T22:22:44.682 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-13T22:22:44.958 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-13T22:22:45.084 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-13T22:22:45.385 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-13T22:22:45.695 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-13T22:22:45.938 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-13T22:22:46.055 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-13T22:22:46.165 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-13T22:22:46.262 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-13T22:22:46.500 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-13T22:22:46.626 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-13T22:22:47.019 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-13T22:22:47.270 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-13T22:22:47.379 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-13T22:22:47.639 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-13T22:22:47.765 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-13T22:22:48.091 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-13T22:22:48.442 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-13T22:22:48.718 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-13T22:22:48.930 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-13T22:22:49.181 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-13T22:22:49.449 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-13T22:22:49.709 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-13T22:22:50.094 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-13T22:22:50.354 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-13T22:22:50.681 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-13T22:22:50.807 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:50.933 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libsqlite3-mod-ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:51.059 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-13T22:22:51.362 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:51.488 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:51.614 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-13T22:22:51.899 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librados2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:52.025 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:52.151 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:52.277 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-modules-core (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:52.395 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:52.590 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-13T22:22:52.591 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-13T22:22:53.130 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libradosstriper1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:53.273 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libcephfs-dev (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:53.700 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:53.825 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rados (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:53.951 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2 (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:54.078 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-top (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:54.187 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-13T22:22:55.449 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librbd1-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:55.575 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:55.701 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up librgw2-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:55.827 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:55.945 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-nbd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.046 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-rgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.172 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up python3-cephfs (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.298 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-nbd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.424 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-shell (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.550 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-fuse-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:56.676 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:57.194 INFO:teuthology.orchestra.run.smithi091.stdout:Adding group ceph....done 2023-12-13T22:22:57.546 INFO:teuthology.orchestra.run.smithi091.stdout:Adding system user ceph....done 2023-12-13T22:22:57.873 INFO:teuthology.orchestra.run.smithi091.stdout:Setting system user ceph properties....done 2023-12-13T22:22:57.892 INFO:teuthology.orchestra.run.smithi091.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-13T22:22:58.037 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-13T22:22:58.381 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-13T22:22:58.878 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up cephfs-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:59.106 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-13T22:22:59.106 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-13T22:22:59.596 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:22:59.722 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:00.195 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-13T22:23:00.196 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-13T22:23:00.649 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-base (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:00.976 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-13T22:23:01.459 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:01.680 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-13T22:23:01.680 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-13T22:23:02.160 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-common-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:02.354 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-mirror (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:02.561 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-13T22:23:02.561 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2023-12-13T22:23:03.080 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:03.299 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-13T22:23:03.300 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-13T22:23:03.816 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mds-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:03.926 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up radosgw-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:04.052 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-test-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:04.178 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:04.460 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-13T22:23:04.460 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-13T22:23:04.954 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.080 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-osd-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.206 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up rbd-mirror-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.341 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-k8sevents (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.467 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.618 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:05.829 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-13T22:23:05.829 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-13T22:23:06.327 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-cephadm (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:06.470 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:06.596 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mgr-dashboard (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:06.747 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-mon-dbg (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:06.874 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ceph-volume (19.0.0-157-g021ac167-1jammy) ... 2023-12-13T22:23:07.226 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-13T22:23:07.344 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-13T22:23:07.847 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-13T22:23:08.939 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-13T22:23:09.578 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-13T22:23:09.582 DEBUG:teuthology.orchestra.run.smithi091:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-13T22:23:09.634 INFO:teuthology.orchestra.run.smithi091.stdout:Reading package lists... 2023-12-13T22:23:09.823 INFO:teuthology.orchestra.run.smithi091.stdout:Building dependency tree... 2023-12-13T22:23:09.824 INFO:teuthology.orchestra.run.smithi091.stdout:Reading state information... 2023-12-13T22:23:09.993 INFO:teuthology.orchestra.run.smithi091.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-13T22:23:09.993 INFO:teuthology.orchestra.run.smithi091.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-13T22:23:09.993 INFO:teuthology.orchestra.run.smithi091.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-13T22:23:09.993 INFO:teuthology.orchestra.run.smithi091.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages were automatically installed and are no longer required: 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-13T22:23:09.994 INFO:teuthology.orchestra.run.smithi091.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout:The following additional packages will be installed: 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-13T22:23:09.995 INFO:teuthology.orchestra.run.smithi091.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-13T22:23:09.996 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-13T22:23:09.996 INFO:teuthology.orchestra.run.smithi091.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-13T22:23:09.996 INFO:teuthology.orchestra.run.smithi091.stdout:Suggested packages: 2023-12-13T22:23:09.996 INFO:teuthology.orchestra.run.smithi091.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-13T22:23:09.997 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-13T22:23:09.997 INFO:teuthology.orchestra.run.smithi091.stdout: libengine-pkcs11-openssl 2023-12-13T22:23:10.035 INFO:teuthology.orchestra.run.smithi091.stdout:The following NEW packages will be installed: 2023-12-13T22:23:10.035 INFO:teuthology.orchestra.run.smithi091.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-13T22:23:10.036 INFO:teuthology.orchestra.run.smithi091.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-13T22:23:10.037 INFO:teuthology.orchestra.run.smithi091.stdout:The following packages will be upgraded: 2023-12-13T22:23:10.038 INFO:teuthology.orchestra.run.smithi091.stdout: libssl3 2023-12-13T22:23:10.219 INFO:teuthology.orchestra.run.smithi091.stdout:1 upgraded, 39 newly installed, 0 to remove and 264 not upgraded. 2023-12-13T22:23:10.219 INFO:teuthology.orchestra.run.smithi091.stdout:Need to get 54.6 MB of archives. 2023-12-13T22:23:10.219 INFO:teuthology.orchestra.run.smithi091.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-13T22:23:10.219 INFO:teuthology.orchestra.run.smithi091.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-13T22:23:10.931 INFO:teuthology.orchestra.run.smithi091.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-13T22:23:11.571 INFO:teuthology.orchestra.run.smithi091.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-13T22:23:11.664 INFO:teuthology.orchestra.run.smithi091.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-13T22:23:11.670 INFO:teuthology.orchestra.run.smithi091.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-13T22:23:11.687 INFO:teuthology.orchestra.run.smithi091.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-13T22:23:11.698 INFO:teuthology.orchestra.run.smithi091.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-13T22:23:11.701 INFO:teuthology.orchestra.run.smithi091.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-13T22:23:11.711 INFO:teuthology.orchestra.run.smithi091.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-13T22:23:11.720 INFO:teuthology.orchestra.run.smithi091.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-13T22:23:11.721 INFO:teuthology.orchestra.run.smithi091.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-13T22:23:11.887 INFO:teuthology.orchestra.run.smithi091.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-13T22:23:12.211 INFO:teuthology.orchestra.run.smithi091.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-13T22:23:14.424 INFO:teuthology.orchestra.run.smithi091.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-13T22:23:14.429 INFO:teuthology.orchestra.run.smithi091.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-13T22:23:14.429 INFO:teuthology.orchestra.run.smithi091.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-13T22:23:14.436 INFO:teuthology.orchestra.run.smithi091.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-13T22:23:14.436 INFO:teuthology.orchestra.run.smithi091.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-13T22:23:14.447 INFO:teuthology.orchestra.run.smithi091.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-13T22:23:14.451 INFO:teuthology.orchestra.run.smithi091.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-13T22:23:14.468 INFO:teuthology.orchestra.run.smithi091.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-13T22:23:14.469 INFO:teuthology.orchestra.run.smithi091.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-13T22:23:14.694 INFO:teuthology.orchestra.run.smithi091.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-13T22:23:14.790 INFO:teuthology.orchestra.run.smithi091.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-13T22:23:15.466 INFO:teuthology.orchestra.run.smithi091.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-13T22:23:15.713 INFO:teuthology.orchestra.run.smithi091.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-13T22:23:15.728 INFO:teuthology.orchestra.run.smithi091.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-13T22:23:15.729 INFO:teuthology.orchestra.run.smithi091.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-13T22:23:15.731 INFO:teuthology.orchestra.run.smithi091.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-13T22:23:15.732 INFO:teuthology.orchestra.run.smithi091.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-13T22:23:15.766 INFO:teuthology.orchestra.run.smithi091.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-13T22:23:15.771 INFO:teuthology.orchestra.run.smithi091.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-13T22:23:16.267 INFO:teuthology.orchestra.run.smithi091.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-13T22:23:16.433 INFO:teuthology.orchestra.run.smithi091.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-13T22:23:16.516 INFO:teuthology.orchestra.run.smithi091.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-13T22:23:16.517 INFO:teuthology.orchestra.run.smithi091.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-13T22:23:16.604 INFO:teuthology.orchestra.run.smithi091.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-13T22:23:16.615 INFO:teuthology.orchestra.run.smithi091.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-13T22:23:17.122 INFO:teuthology.orchestra.run.smithi091.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-13T22:23:17.124 INFO:teuthology.orchestra.run.smithi091.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-13T22:23:17.527 INFO:teuthology.orchestra.run.smithi091.stdout:Preconfiguring packages ... 2023-12-13T22:23:17.700 INFO:teuthology.orchestra.run.smithi091.stdout:Fetched 54.6 MB in 7s (7,709 kB/s) 2023-12-13T22:23:17.837 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package flex. 2023-12-13T22:23:17.901 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173894 files and directories currently installed.) 2023-12-13T22:23:17.906 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-13T22:23:17.945 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-13T22:23:18.503 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-13T22:23:18.684 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-13T22:23:19.086 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:23:19.618 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package bison. 2023-12-13T22:23:19.722 INFO:teuthology.orchestra.run.smithi091.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173967 files and directories currently installed.) 2023-12-13T22:23:19.727 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-13T22:23:19.778 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-13T22:23:20.187 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-13T22:23:20.216 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-13T22:23:20.254 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-13T22:23:20.607 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package dump. 2023-12-13T22:23:20.635 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-13T22:23:20.674 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking dump (0.4b47-3) ... 2023-12-13T22:23:20.935 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package indent. 2023-12-13T22:23:20.963 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:20.993 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-13T22:23:21.263 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-13T22:23:21.290 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-13T22:23:21.329 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-13T22:23:21.641 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-13T22:23:21.669 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-13T22:23:21.708 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-13T22:23:21.969 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-13T22:23:21.997 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-13T22:23:22.035 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-13T22:23:22.372 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-13T22:23:22.400 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-13T22:23:22.438 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-13T22:23:22.699 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-13T22:23:22.715 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-13T22:23:22.757 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-13T22:23:23.044 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libjson-perl. 2023-12-13T22:23:23.073 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-13T22:23:23.110 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-13T22:23:23.397 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-13T22:23:23.413 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-13T22:23:23.455 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-13T22:23:25.083 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-13T22:23:25.111 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-13T22:23:25.149 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:23:25.410 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-13T22:23:25.438 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-13T22:23:25.476 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:23:25.804 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-13T22:23:25.832 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-13T22:23:25.870 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:23:26.207 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-13T22:23:26.235 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-13T22:23:26.273 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-13T22:23:26.601 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-13T22:23:26.629 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-13T22:23:26.667 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-13T22:23:27.012 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-13T22:23:27.040 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:27.078 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:27.406 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-13T22:23:27.434 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:27.473 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:23:27.775 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-13T22:23:27.791 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:27.833 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:23:28.077 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-13T22:23:28.105 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-13T22:23:28.262 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:23:28.807 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-13T22:23:28.835 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-13T22:23:28.907 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-13T22:23:29.351 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package modemmanager. 2023-12-13T22:23:29.379 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-13T22:23:29.418 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:23:30.066 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager. 2023-12-13T22:23:30.094 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-13T22:23:30.181 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-13T22:23:30.764 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package ppp. 2023-12-13T22:23:30.791 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-13T22:23:31.078 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-13T22:23:31.427 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package pptp-linux. 2023-12-13T22:23:31.454 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-13T22:23:31.493 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-13T22:23:31.746 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-13T22:23:31.762 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-13T22:23:31.804 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-13T22:23:32.107 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-13T22:23:32.135 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-13T22:23:32.174 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-common (238) ... 2023-12-13T22:23:32.444 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-13T22:23:32.472 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:32.502 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:33.116 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-common. 2023-12-13T22:23:33.143 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-13T22:23:33.200 INFO:teuthology.orchestra.run.smithi091.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-13T22:23:33.238 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-common (238) ... 2023-12-13T22:23:33.697 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-14. 2023-12-13T22:23:33.725 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-13T22:23:33.767 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:35.033 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql. 2023-12-13T22:23:35.050 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-13T22:23:35.083 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql (14+238) ... 2023-12-13T22:23:35.327 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-client. 2023-12-13T22:23:35.344 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-13T22:23:35.385 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-client (14+238) ... 2023-12-13T22:23:35.629 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-13T22:23:35.646 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-13T22:23:35.687 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-13T22:23:36.015 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl8.6. 2023-12-13T22:23:36.043 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-13T22:23:36.081 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-13T22:23:36.352 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package tcl. 2023-12-13T22:23:36.367 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-13T22:23:36.406 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-13T22:23:36.737 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package wpasupplicant. 2023-12-13T22:23:36.766 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-13T22:23:36.803 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-13T22:23:37.174 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-13T22:23:37.203 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-13T22:23:37.241 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-13T22:23:37.619 INFO:teuthology.orchestra.run.smithi091.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-13T22:23:37.647 INFO:teuthology.orchestra.run.smithi091.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-13T22:23:37.693 INFO:teuthology.orchestra.run.smithi091.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-13T22:23:37.989 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-common (238) ... 2023-12-13T22:23:38.191 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-13T22:23:38.317 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-13T22:23:38.877 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:39.003 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-13T22:23:39.129 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-13T22:23:39.255 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:39.741 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-13T22:23:39.819 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-13T22:23:40.204 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-13T22:23:40.204 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-13T22:23:40.713 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-13T22:23:40.839 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-13T22:23:40.965 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-13T22:23:41.091 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-13T22:23:41.217 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-13T22:23:41.343 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-13T22:23:41.461 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-13T22:23:42.141 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-13T22:23:42.267 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up dump (0.4b47-3) ... 2023-12-13T22:23:42.361 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-13T22:23:42.427 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:23:42.536 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-13T22:23:42.662 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-13T22:23:42.788 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-13T22:23:42.914 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-13T22:23:43.003 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-13T22:23:43.074 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-13T22:23:43.219 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-13T22:23:43.393 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-13T22:23:43.519 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:23:43.645 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-13T22:23:43.813 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-client (14+238) ... 2023-12-13T22:23:43.938 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-13T22:23:44.822 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:44.822 INFO:teuthology.orchestra.run.smithi091.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-13T22:23:44.823 INFO:teuthology.orchestra.run.smithi091.stdout:which means they are currently configured by ifupdown: 2023-12-13T22:23:44.823 INFO:teuthology.orchestra.run.smithi091.stdout:- enp3s0f1 2023-12-13T22:23:44.823 INFO:teuthology.orchestra.run.smithi091.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-13T22:23:44.823 INFO:teuthology.orchestra.run.smithi091.stdout:remove their configuration from /etc/network/interfaces. 2023-12-13T22:23:44.823 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:44.940 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-13T22:23:45.284 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-13T22:23:45.632 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-13T22:23:46.141 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-13T22:23:46.293 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-13T22:23:46.419 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-13T22:23:46.536 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-common (238) ... 2023-12-13T22:23:47.439 INFO:teuthology.orchestra.run.smithi091.stdout:Adding user postgres to group ssl-cert 2023-12-13T22:23:47.669 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:47.669 INFO:teuthology.orchestra.run.smithi091.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-13T22:23:47.844 INFO:teuthology.orchestra.run.smithi091.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-13T22:23:47.844 INFO:teuthology.orchestra.run.smithi091.stdout:Removing obsolete dictionary files: 2023-12-13T22:23:48.413 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-13T22:23:48.804 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-13T22:23:49.141 INFO:teuthology.orchestra.run.smithi091.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-13T22:23:49.157 INFO:teuthology.orchestra.run.smithi091.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:This user must also own the server process. 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:The database cluster will be initialized with locale "en_US". 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout:The default text search configuration will be set to "english". 2023-12-13T22:23:49.213 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:49.214 INFO:teuthology.orchestra.run.smithi091.stdout:Data page checksums are disabled. 2023-12-13T22:23:49.214 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:23:49.214 INFO:teuthology.orchestra.run.smithi091.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-13T22:23:49.214 INFO:teuthology.orchestra.run.smithi091.stdout:creating subdirectories ... ok 2023-12-13T22:23:49.214 INFO:teuthology.orchestra.run.smithi091.stdout:selecting dynamic shared memory implementation ... posix 2023-12-13T22:23:49.230 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default max_connections ... 100 2023-12-13T22:23:49.251 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default shared_buffers ... 128MB 2023-12-13T22:23:49.260 INFO:teuthology.orchestra.run.smithi091.stdout:selecting default time zone ... Etc/UTC 2023-12-13T22:23:49.260 INFO:teuthology.orchestra.run.smithi091.stdout:creating configuration files ... ok 2023-12-13T22:23:49.375 INFO:teuthology.orchestra.run.smithi091.stdout:running bootstrap script ... ok 2023-12-13T22:23:50.006 INFO:teuthology.orchestra.run.smithi091.stdout:performing post-bootstrap initialization ... ok 2023-12-13T22:23:50.691 INFO:teuthology.orchestra.run.smithi091.stdout:syncing data to disk ... ok 2023-12-13T22:23:51.077 INFO:teuthology.orchestra.run.smithi091.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-13T22:23:53.861 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:23:53.987 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-13T22:23:54.121 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up postgresql (14+238) ... 2023-12-13T22:23:54.230 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-13T22:23:54.356 INFO:teuthology.orchestra.run.smithi091.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-13T22:23:54.613 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-13T22:23:54.613 INFO:teuthology.orchestra.run.smithi091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-13T22:23:55.167 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-13T22:23:55.461 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-13T22:23:55.629 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-13T22:23:57.009 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-13T22:23:57.117 INFO:teuthology.orchestra.run.smithi091.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-13T22:23:57.606 INFO:teuthology.orchestra.run.smithi091.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-13T22:23:57.612 DEBUG:teuthology.parallel:result is None 2023-12-13T22:23:57.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:23:57.757 DEBUG:teuthology.orchestra.run.smithi091:> dpkg-query -W -f '${Version}' ceph 2023-12-13T22:23:57.774 INFO:teuthology.orchestra.run.smithi091.stdout:19.0.0-157-g021ac167-1jammy 2023-12-13T22:23:57.775 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-157-g021ac167-1jammy 2023-12-13T22:23:57.775 INFO:teuthology.task.install:The correct ceph version 19.0.0-157-g021ac167-1jammy is installed. 2023-12-13T22:23:57.777 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:23:57.994 DEBUG:teuthology.orchestra.run.smithi152:> dpkg-query -W -f '${Version}' ceph 2023-12-13T22:23:58.014 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-157-g021ac167-1jammy 2023-12-13T22:23:58.014 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-157-g021ac167-1jammy 2023-12-13T22:23:58.014 INFO:teuthology.task.install:The correct ceph version 19.0.0-157-g021ac167-1jammy is installed. 2023-12-13T22:23:58.016 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-13T22:23:58.016 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.016 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-13T22:23:58.031 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:58.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-13T22:23:58.070 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-13T22:23:58.070 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.070 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/daemon-helper 2023-12-13T22:23:58.088 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-13T22:23:58.143 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:58.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-12-13T22:23:58.156 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-13T22:23:58.210 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-13T22:23:58.210 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-13T22:23:58.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-13T22:23:58.279 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:58.280 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-13T22:23:58.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-13T22:23:58.346 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-13T22:23:58.346 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.346 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/usr/bin/stdin-killer 2023-12-13T22:23:58.358 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-13T22:23:58.410 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:58.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-12-13T22:23:58.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-13T22:23:58.478 INFO:teuthology.run_tasks:Running task ceph... 2023-12-13T22:23:58.546 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-13T22:23:58.547 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 777 /var/log/ceph 2023-12-13T22:23:58.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2023-12-13T22:23:58.561 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-13T22:23:58.562 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-13T22:23:58.605 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-13T22:23:58.617 INFO:tasks.ceph:Creating extra log directories... 2023-12-13T22:23:58.618 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-13T22:23:58.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-13T22:23:58.681 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-13T22:23:58.681 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-13T22:23:58.681 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-13T22:23:58.682 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.682 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-13T22:23:58.720 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-13T22:23:58.795 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:58.795 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-13T22:23:58.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-13T22:23:58.880 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-13T22:23:58.880 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-13T22:23:58.880 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529', 'branch': 'wip-yuri10-testing-2023-12-12-1229', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7490529', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-12-12-1229'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-12-12-1229', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8548, 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-12-12-1229', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAnY8NZ8rmG2fQtWRB96YYhFduGIFCtjp3tlo7ef+U/+RYsWnnoGH3a9C225VwUAJyfAd2a/pDKcjBH9rM9tQI=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAQegAzKZeY9WGY5Wo7dp/9hw6qdPMo5p6ZZJY4vLjPGWufyxKJFGkt6UARQVfEnBrlfPACkfQ6Rf6p8t68/C2Y='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '021ac1670a21c19759080c6da90baaeb42e7d175', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-13_20:38:28', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-13T22:23:58.881 DEBUG:teuthology.orchestra.run.smithi091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-13T22:23:58.884 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-13T22:23:58.923 DEBUG:teuthology.orchestra.run.smithi091:> sudo install -d -m0777 -- /var/run/ceph 2023-12-13T22:23:58.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2023-12-13T22:23:58.979 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:23:58.979 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/scratch_devs of=/dev/stdout 2023-12-13T22:23:58.992 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-13T22:23:58.992 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_1 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-13 22:11:43.850028362 +0000 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-13 22:11:43.514031360 +0000 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-13 22:11:43.514031360 +0000 2023-12-13T22:23:59.040 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-13T22:23:59.041 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-13T22:23:59.094 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-13T22:23:59.094 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-13T22:23:59.094 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000332321 s, 1.5 MB/s 2023-12-13T22:23:59.096 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-13T22:23:59.146 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_2 2023-12-13T22:23:59.192 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-13T22:23:59.192 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.192 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-12-13T22:23:59.192 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.192 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-13 22:11:44.434023153 +0000 2023-12-13T22:23:59.193 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-13 22:11:44.082026292 +0000 2023-12-13T22:23:59.193 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-13 22:11:44.082026292 +0000 2023-12-13T22:23:59.193 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-13T22:23:59.193 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-13T22:23:59.246 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-13T22:23:59.246 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-13T22:23:59.246 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000320419 s, 1.6 MB/s 2023-12-13T22:23:59.248 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-13T22:23:59.298 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_3 2023-12-13T22:23:59.344 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-13T22:23:59.344 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.344 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 922 Links: 1 2023-12-13T22:23:59.344 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.345 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-13 22:11:45.042017729 +0000 2023-12-13T22:23:59.345 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-13 22:11:44.682020940 +0000 2023-12-13T22:23:59.345 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-13 22:11:44.682020940 +0000 2023-12-13T22:23:59.345 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-13T22:23:59.345 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-13T22:23:59.398 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-13T22:23:59.398 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-13T22:23:59.398 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000335523 s, 1.5 MB/s 2023-12-13T22:23:59.399 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-13T22:23:59.450 DEBUG:teuthology.orchestra.run.smithi091:> stat /dev/vg_nvme/lv_4 2023-12-13T22:23:59.496 INFO:teuthology.orchestra.run.smithi091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-13T22:23:59.496 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 2023-12-13 22:11:45.622012555 +0000 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-13 22:11:45.274015659 +0000 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-13 22:11:45.274015659 +0000 2023-12-13T22:23:59.497 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-13T22:23:59.497 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-13T22:23:59.551 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records in 2023-12-13T22:23:59.551 INFO:teuthology.orchestra.run.smithi091.stderr:1+0 records out 2023-12-13T22:23:59.551 INFO:teuthology.orchestra.run.smithi091.stderr:512 bytes copied, 0.000392542 s, 1.3 MB/s 2023-12-13T22:23:59.552 DEBUG:teuthology.orchestra.run.smithi091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-13T22:23:59.602 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-13T22:23:59.602 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:23:59.602 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-12-13T22:23:59.608 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-13T22:23:59.608 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 883 Links: 1 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-13 22:11:49.867456845 +0000 2023-12-13T22:23:59.655 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-13 22:11:49.527459882 +0000 2023-12-13T22:23:59.656 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-13 22:11:49.527459882 +0000 2023-12-13T22:23:59.656 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-13T22:23:59.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-13T22:23:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-13T22:23:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-13T22:23:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000449397 s, 1.1 MB/s 2023-12-13T22:23:59.711 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-13T22:23:59.760 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-12-13T22:23:59.807 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-13T22:23:59.807 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.807 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-12-13T22:23:59.807 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.807 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-13 22:11:50.439451735 +0000 2023-12-13T22:23:59.808 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-13 22:11:50.099454773 +0000 2023-12-13T22:23:59.808 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-13 22:11:50.099454773 +0000 2023-12-13T22:23:59.808 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-13T22:23:59.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-13T22:23:59.861 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-13T22:23:59.861 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-13T22:23:59.861 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000387822 s, 1.3 MB/s 2023-12-13T22:23:59.863 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-13T22:23:59.912 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-13 22:11:51.011446627 +0000 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-13 22:11:50.683449557 +0000 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-13 22:11:50.683449557 +0000 2023-12-13T22:23:59.959 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-13T22:23:59.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-13T22:24:00.013 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-13T22:24:00.013 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-13T22:24:00.013 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000370066 s, 1.4 MB/s 2023-12-13T22:24:00.015 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-13T22:24:00.064 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-12-13T22:24:00.110 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-13 22:11:51.615441232 +0000 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-13 22:11:51.251444483 +0000 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-13 22:11:51.251444483 +0000 2023-12-13T22:24:00.111 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-13T22:24:00.111 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-13T22:24:00.164 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-13T22:24:00.165 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-13T22:24:00.165 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000338689 s, 1.5 MB/s 2023-12-13T22:24:00.166 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-13T22:24:00.216 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:00.216 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-13T22:24:00.216 INFO:tasks.ceph:Generating config... 2023-12-13T22:24:00.218 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-13T22:24:00.218 INFO:tasks.ceph:[client] debug client = 20 2023-12-13T22:24:00.218 INFO:tasks.ceph:[client] debug ms = 1 2023-12-13T22:24:00.218 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-13T22:24:00.218 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-13T22:24:00.218 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-13T22:24:00.218 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-13T22:24:00.218 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-13T22:24:00.218 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-13T22:24:00.219 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-13T22:24:00.219 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-13T22:24:00.219 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-13T22:24:00.219 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-13T22:24:00.219 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-13T22:24:00.219 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-13T22:24:00.220 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-13T22:24:00.220 INFO:tasks.ceph:Setting up mon.a... 2023-12-13T22:24:00.220 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-13T22:24:00.255 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.keyring 2023-12-13T22:24:00.266 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-13T22:24:00.343 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-13T22:24:00.399 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.91'), ('mon.b', '172.21.15.152'), ('mon.c', '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]')] 2023-12-13T22:24:00.399 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.91,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-13T22:24:00.400 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:00.400 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-13T22:24:00.448 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.91 --add b 172.21.15.152 --addv c '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:00.534 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:00.534 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: generated fsid 94ef47bf-5c6b-4a6a-817c-50fb411636d9 2023-12-13T22:24:00.534 INFO:teuthology.orchestra.run.smithi091.stdout:setting min_mon_release = quincy 2023-12-13T22:24:00.534 INFO:teuthology.orchestra.run.smithi091.stdout:epoch 0 2023-12-13T22:24:00.534 INFO:teuthology.orchestra.run.smithi091.stdout:fsid 94ef47bf-5c6b-4a6a-817c-50fb411636d9 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:last_changed 2023-12-13T22:24:00.537563+0000 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:created 2023-12-13T22:24:00.537563+0000 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:min_mon_release 17 (quincy) 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:election_strategy: 1 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:0: [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] mon.a 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:2: [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] mon.c 2023-12-13T22:24:00.535 INFO:teuthology.orchestra.run.smithi091.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-13T22:24:00.536 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-13T22:24:00.584 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 94ef47bf-5c6b-4a6a-817c-50fb411636d9... 2023-12-13T22:24:00.585 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-13T22:24:00.629 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-13T22:24:00.657 INFO:teuthology.orchestra.run.smithi091.stdout:[global] 2023-12-13T22:24:00.657 INFO:teuthology.orchestra.run.smithi091.stdout: chdir = "" 2023-12-13T22:24:00.657 INFO:teuthology.orchestra.run.smithi091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-13T22:24:00.657 INFO:teuthology.orchestra.run.smithi091.stdout: auth supported = cephx 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: filestore xattr use omap = true 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: mon clock drift allowed = 1.000 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: osd crush chooseleaf type = 0 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: auth debug = true 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on old message = true 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: ms die on bug = true 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: mon pg warn max object skew = 0 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.658 INFO:teuthology.orchestra.run.smithi091.stdout: # disable pg_autoscaler by default for new pools 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default size = 2 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow primary affinity = true 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd allow pg remap = true 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on legacy crush tunables = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on crush straw calc version zero = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on no sortbitwise = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on osd down out interval zero = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon warn on too few osds = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-13T22:24:00.659 INFO:teuthology.orchestra.run.smithi091.stdout: mon_allow_pool_size_one = true 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: osd default data pool replay window = 5 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mon allow pool delete = true 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mon cluster log file level = debug 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: debug asserts on shutdown = true 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mon health detail to clog = false 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mon host = "172.21.15.91,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mds beacon grace = 60 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: mds heartbeat grace = 60 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: osd heartbeat grace = 60 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: fsid = 94ef47bf-5c6b-4a6a-817c-50fb411636d9 2023-12-13T22:24:00.660 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout:[osd] 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd journal size = 100 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub load threshold = 5.0 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd scrub max interval = 600 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd mclock profile = high_recovery_ops 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd recover clone overlap = true 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd recovery max chunk = 1048576 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug shutdown = true 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug op order = true 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug verify stray on activate = true 2023-12-13T22:24:00.661 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug trim objects = true 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: osd open classes on start = true 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug pg log writeout = true 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: osd deep scrub update digest min age = 30 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: osd map max advance = 10 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: journal zero on create = true 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: filestore ondisk finisher threads = 3 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: filestore apply finisher threads = 3 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: bdev debug aio = true 2023-12-13T22:24:00.662 INFO:teuthology.orchestra.run.smithi091.stdout: osd debug misdirected ops = true 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore block size = 96636764160 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: bluestore fsck on mount = True 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluefs = 20 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: debug bluestore = 20 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: debug osd = 20 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: debug rocksdb = 10 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd backfillfull_ratio = 0.85 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd full ratio = 0.9 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd nearfull ratio = 0.8 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: osd failsafe full ratio = 0.95 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: osd fast shutdown = False 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: osd objectstore = bluestore 2023-12-13T22:24:00.663 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr] 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug mgr = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: mgr/telemetry/nag = false 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout:[mon] 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug mon = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug paxos = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: debug auth = 20 2023-12-13T22:24:00.664 INFO:teuthology.orchestra.run.smithi091.stdout: mon data avail warn = 5 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon mgr mkfs grace = 240 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min pgs per osd = 4 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd reporter subtree level = osd 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd prime pg temp = true 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon reweight min bytes per osd = 10 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: auth mon ticket ttl = 660 # 11m 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: auth service ticket ttl = 240 # 4m 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: # don't complain about insecure global_id in the test suite 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.665 INFO:teuthology.orchestra.run.smithi091.stdout: # 1m isn't quite enough 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: mon_down_mkfs_grace = 2m 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: mon_warn_on_filestore_osds = false 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: mon op complaint time = 120 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: mon osd crush smoke test = False 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout:[client] 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: rgw cache enabled = true 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable ops log = true 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: rgw enable usage log = true 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: client mount timeout = 600 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: debug client = 20 2023-12-13T22:24:00.666 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.a] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.b] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mon.c] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.e] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.f] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout:[mds] 2023-12-13T22:24:00.667 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds = 20 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: debug mds balancer = 20 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: debug ms = 1 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug frag = True 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: mds debug scatterstat = True 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: mds op complaint time = 180 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: mds valgrind exit = True 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: mds verify scatter = True 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: osd op complaint time = 180 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: rados mon op timeout = 900 2023-12-13T22:24:00.668 INFO:teuthology.orchestra.run.smithi091.stdout: rados osd op timeout = 900 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2023-12-13T22:24:00.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2023-12-13T22:24:00.670 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.91,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: mds beacon grace = 60 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: mds heartbeat grace = 60 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: osd heartbeat grace = 60 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 94ef47bf-5c6b-4a6a-817c-50fb411636d9 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2023-12-13T22:24:00.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2023-12-13T22:24:00.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2023-12-13T22:24:00.674 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: osd fast shutdown = False 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-12-13T22:24:00.675 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2023-12-13T22:24:00.676 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd crush smoke test = False 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2023-12-13T22:24:00.677 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.e] 2023-12-13T22:24:00.678 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.f] 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: mds valgrind exit = True 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-12-13T22:24:00.679 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-12-13T22:24:00.681 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-13T22:24:00.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-13T22:24:00.771 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-13T22:24:00.772 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:00.772 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-13T22:24:00.777 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:00.777 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-13T22:24:00.826 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:24:00.876 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:00.876 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-13T22:24:00.876 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-13T22:24:00.899 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:00.899 DEBUG:teuthology.orchestra.run.smithi091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:00.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:24:00.949 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:00.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-13T22:24:00.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-13T22:24:00.971 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:00.971 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:01.020 INFO:tasks.ceph:Setting up mon nodes... 2023-12-13T22:24:01.020 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-13T22:24:01.021 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-13T22:24:01.063 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-13T22:24:01.066 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-13T22:24:01.108 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-13T22:24:01.210 INFO:tasks.ceph:Setting up mds nodes... 2023-12-13T22:24:01.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-13T22:24:01.255 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-13T22:24:01.257 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-13T22:24:01.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-13T22:24:01.392 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-13T22:24:01.395 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-13T22:24:01.455 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-13T22:24:01.542 INFO:teuthology.orchestra.run.smithi091.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-13T22:24:01.544 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-13T22:24:01.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-13T22:24:01.649 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-13T22:24:01.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-13T22:24:01.710 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-13T22:24:01.794 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-13T22:24:01.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-13T22:24:01.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-13T22:24:01.936 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-13T22:24:01.939 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-13T22:24:01.994 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-13T22:24:01.994 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-13T22:24:02.029 INFO:teuthology.orchestra.run.smithi091.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-13T22:24:02.038 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-13T22:24:02.039 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-13T22:24:02.039 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-13T22:24:02.093 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:02.093 INFO:tasks.ceph:role: osd.0 2023-12-13T22:24:02.094 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:24:02.094 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-13T22:24:02.154 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:02.154 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:02.154 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:02.154 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:02.155 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:02.611 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-13T22:24:02.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-13T22:24:02.614 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-13T22:24:02.705 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-13T22:24:02.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:02.717 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:02.717 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-13T22:24:02.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:02.774 INFO:tasks.ceph:role: osd.1 2023-12-13T22:24:02.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:24:02.774 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-13T22:24:02.836 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:02.837 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:03.296 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-13T22:24:03.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-13T22:24:03.298 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-13T22:24:03.431 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-13T22:24:03.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:03.443 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:03.443 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-13T22:24:03.500 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:03.500 INFO:tasks.ceph:role: osd.2 2023-12-13T22:24:03.500 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:24:03.500 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:03.563 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:04.048 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-13T22:24:04.050 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-13T22:24:04.050 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-13T22:24:04.186 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-13T22:24:04.197 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:04.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:04.198 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-13T22:24:04.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:04.252 INFO:tasks.ceph:role: osd.3 2023-12-13T22:24:04.252 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:24:04.252 DEBUG:teuthology.orchestra.run.smithi091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:04.316 INFO:teuthology.orchestra.run.smithi091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:04.757 INFO:teuthology.orchestra.run.smithi091.stdout:Discarding blocks...Done. 2023-12-13T22:24:04.759 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi091.front.sepia.ceph.com -o noatime 2023-12-13T22:24:04.760 DEBUG:teuthology.orchestra.run.smithi091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-13T22:24:04.852 DEBUG:teuthology.orchestra.run.smithi091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-13T22:24:04.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:04.861 INFO:teuthology.orchestra.run.smithi091.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:04.861 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:04.995 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:04.994+0000 7f3766fa6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-13T22:24:04.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:04.998+0000 7f3766fa6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-13T22:24:04.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:04.998+0000 7f3766fa6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-13T22:24:04.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:04.998+0000 7f3766fa6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-13T22:24:04.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:04.998+0000 7f3766fa6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-13T22:24:04.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:05.002+0000 7f3766fa6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-13T22:24:08.013 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-13T22:24:08.026 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:08.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.106+0000 7f58acc2a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-13T22:24:08.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.106+0000 7f58acc2a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-13T22:24:08.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.106+0000 7f58acc2a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-13T22:24:08.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.106+0000 7f58acc2a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-13T22:24:08.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.106+0000 7f58acc2a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-13T22:24:08.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:08.110+0000 7f58acc2a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-13T22:24:11.114 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-13T22:24:11.168 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:11.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.250+0000 7f339699e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-13T22:24:11.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.254+0000 7f339699e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-13T22:24:11.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.254+0000 7f339699e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-13T22:24:11.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.254+0000 7f339699e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-13T22:24:11.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.254+0000 7f339699e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-13T22:24:11.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:11.254+0000 7f339699e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-13T22:24:14.255 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-13T22:24:14.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:14.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-13T22:24:14.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-13T22:24:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-13T22:24:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-13T22:24:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-13T22:24:14.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:14.394+0000 7f850af06640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-13T22:24:17.416 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-13T22:24:17.472 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-13T22:24:17.487 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:17.487 INFO:tasks.ceph:role: osd.4 2023-12-13T22:24:17.487 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:24:17.487 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-13T22:24:17.553 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:17.553 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:17.553 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:17.553 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:17.553 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:17.554 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:17.554 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:17.554 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:17.554 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:17.554 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:18.007 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-12-13T22:24:18.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-12-13T22:24:18.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-13T22:24:18.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-13T22:24:18.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:18.122 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:18.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-13T22:24:18.176 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:18.176 INFO:tasks.ceph:role: osd.5 2023-12-13T22:24:18.176 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:24:18.176 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-13T22:24:18.238 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:18.238 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:18.238 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:18.239 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:18.703 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-12-13T22:24:18.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-12-13T22:24:18.706 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-13T22:24:18.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-13T22:24:18.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:18.853 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:18.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-13T22:24:18.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:18.907 INFO:tasks.ceph:role: osd.6 2023-12-13T22:24:18.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:24:18.907 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:19.450 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-12-13T22:24:19.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-12-13T22:24:19.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-13T22:24:19.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-13T22:24:19.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:19.621 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:19.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-13T22:24:19.674 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-13T22:24:19.674 INFO:tasks.ceph:role: osd.7 2023-12-13T22:24:19.675 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:24:19.675 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-13T22:24:19.743 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-13T22:24:19.744 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-13T22:24:20.172 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-12-13T22:24:20.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-12-13T22:24:20.174 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-13T22:24:20.285 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-13T22:24:20.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:24:20.296 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2023-12-13T22:24:20.296 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:20.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.519+0000 7f29366b0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-13T22:24:20.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.523+0000 7f29366b0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-13T22:24:20.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.523+0000 7f29366b0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-13T22:24:20.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.523+0000 7f29366b0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-13T22:24:20.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.523+0000 7f29366b0640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-13T22:24:20.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:20.523+0000 7f29366b0640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-13T22:24:23.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-13T22:24:23.544 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:23.624 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-13T22:24:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-13T22:24:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-13T22:24:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-13T22:24:23.625 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-13T22:24:23.626 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:23.623+0000 7eff21b5d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-13T22:24:26.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-13T22:24:26.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.767+0000 7fa27db98640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-13T22:24:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.767+0000 7fa27db98640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-13T22:24:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.767+0000 7fa27db98640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-13T22:24:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.767+0000 7fa27db98640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-13T22:24:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.767+0000 7fa27db98640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-13T22:24:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:26.771+0000 7fa27db98640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-13T22:24:28.883 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:24:28.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:24:29.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-13T22:24:29.788 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:29.870 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-13T22:24:29.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-13T22:24:29.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-13T22:24:29.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-13T22:24:29.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-13T22:24:29.871 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:29.871+0000 7f18953fd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-13T22:24:32.883 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-13T22:24:32.944 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-13T22:24:32.944 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:32.944 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-13T22:24:32.958 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:32.958 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-13T22:24:33.011 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.011 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-13T22:24:33.067 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.067 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-13T22:24:33.122 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.122 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-13T22:24:33.178 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.178 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-13T22:24:33.234 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.234 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-13T22:24:33.287 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.287 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-13T22:24:33.342 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-13T22:24:33.356 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-13T22:24:33.410 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-13T22:24:33.466 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.466 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-13T22:24:33.522 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-13T22:24:33.577 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-13T22:24:33.630 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-13T22:24:33.686 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:33.686 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-13T22:24:33.742 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:33.743 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-13T22:24:33.748 INFO:tasks.ceph:Adding keys to all mons... 2023-12-13T22:24:33.749 DEBUG:teuthology.orchestra.run.smithi091:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-13T22:24:33.792 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-13T22:24:33.801 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.y] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plPrj/AxAASrJChtdc36q5YRMC3vyb8w== 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.a] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plWz9kDxAAXC7UBTDtu7/EkvzrqFRyUw== 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.c] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plPXGeFxAAYyxkyg5LGz8QHchQwfzCNA== 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.e] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3pl6xeAIBAALlBpgLEpjdhi+95Ttrz1zQ== 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.0] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAEL3pl0ZmBOxAAlSAf/KB4VmAF15Fpp000OQ== 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.1] 2023-12-13T22:24:33.802 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAIL3ploxuRBhAAU6xhxAffjWcgh+exVLfb7Q== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.2] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQALL3plH3UrDxAAvIUc8ELAp6hDO8uyIfmn5w== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.3] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAOL3plytejFxAAttpTQGe4lP/W+4H1jklw4A== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[mgr.x] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plnm2rBhAAYSgMxRaCgUZfBq5uCmgzwA== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.b] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plAnLkJhAAhnEBeIeKteRXUnZWMj0vFw== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.d] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plLoaPLxAAp8F/A5W6hv7y9tBotnIEjg== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[mds.f] 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQABL3plRVcBOBAAdclD2xwPQ0dpbrkEqJCmIA== 2023-12-13T22:24:33.803 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.4] 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAUL3pl/DApHxAApAbj5sHqaSM5/pl2C9VB+Q== 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.5] 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAXL3plSKtwJRAAzF49+KcNWLaXumSakCLQeA== 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.6] 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAaL3plm8MSLhAAxNzPUbQsZJkQnMBAIpc5+Q== 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout:[osd.7] 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQAdL3plJOoXNBAAMbb/8ZGHdZOwsC6GA/zkiQ== 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout:[client.0] 2023-12-13T22:24:33.804 INFO:teuthology.orchestra.run.smithi091.stdout: key = AQACL3plILHyARAAZH3CSJStqdMQRjin7yReKw== 2023-12-13T22:24:33.806 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2023-12-13T22:24:33.806 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plPrj/AxAASrJChtdc36q5YRMC3vyb8w== 2023-12-13T22:24:33.806 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-12-13T22:24:33.806 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plWz9kDxAAXC7UBTDtu7/EkvzrqFRyUw== 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plPXGeFxAAYyxkyg5LGz8QHchQwfzCNA== 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.e] 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3pl6xeAIBAALlBpgLEpjdhi+95Ttrz1zQ== 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2023-12-13T22:24:33.807 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAEL3pl0ZmBOxAAlSAf/KB4VmAF15Fpp000OQ== 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAIL3ploxuRBhAAU6xhxAffjWcgh+exVLfb7Q== 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQALL3plH3UrDxAAvIUc8ELAp6hDO8uyIfmn5w== 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAOL3plytejFxAAttpTQGe4lP/W+4H1jklw4A== 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plnm2rBhAAYSgMxRaCgUZfBq5uCmgzwA== 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-12-13T22:24:33.808 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plAnLkJhAAhnEBeIeKteRXUnZWMj0vFw== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plLoaPLxAAp8F/A5W6hv7y9tBotnIEjg== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.f] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQABL3plRVcBOBAAdclD2xwPQ0dpbrkEqJCmIA== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAUL3pl/DApHxAApAbj5sHqaSM5/pl2C9VB+Q== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAXL3plSKtwJRAAzF49+KcNWLaXumSakCLQeA== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAaL3plm8MSLhAAxNzPUbQsZJkQnMBAIpc5+Q== 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2023-12-13T22:24:33.809 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAdL3plJOoXNBAAMbb/8ZGHdZOwsC6GA/zkiQ== 2023-12-13T22:24:33.810 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2023-12-13T22:24:33.810 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQACL3plILHyARAAZH3CSJStqdMQRjin7yReKw== 2023-12-13T22:24:33.810 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-13T22:24:33.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-13T22:24:33.896 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:33.937 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:33.984 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:33.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.074 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.121 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.203 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.245 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.287 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.375 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.457 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-13T22:24:34.492 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-13T22:24:34.539 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.624 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.713 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-13T22:24:34.760 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.847 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.893 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.936 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:34.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:35.024 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:35.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-13T22:24:35.107 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-13T22:24:35.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-13T22:24:35.199 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-13T22:24:35.199 DEBUG:teuthology.orchestra.run.smithi091:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-13T22:24:35.210 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-13T22:24:35.303 DEBUG:teuthology.orchestra.run.smithi091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-13T22:24:35.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-13T22:24:35.372 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-13T22:24:35.472 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-13T22:24:35.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-13T22:24:35.541 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-13T22:24:35.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-13T22:24:35.645 DEBUG:teuthology.orchestra.run.smithi091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:35.647 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-13T22:24:35.690 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-13T22:24:35.690 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-13T22:24:35.691 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-13T22:24:35.691 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-13T22:24:35.696 INFO:tasks.ceph.mon.a:Started 2023-12-13T22:24:35.697 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-13T22:24:35.697 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-13T22:24:35.697 DEBUG:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-13T22:24:35.736 INFO:tasks.ceph.mon.b:Started 2023-12-13T22:24:35.736 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-13T22:24:35.736 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-13T22:24:35.736 DEBUG:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-13T22:24:35.738 INFO:tasks.ceph.mon.c:Started 2023-12-13T22:24:35.739 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-13T22:24:35.739 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-13T22:24:35.739 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-13T22:24:35.741 INFO:tasks.ceph.mgr.y:Started 2023-12-13T22:24:35.742 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-13T22:24:35.742 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-13T22:24:35.744 INFO:tasks.ceph.mgr.x:Started 2023-12-13T22:24:35.744 INFO:tasks.ceph:Setting crush tunables to default 2023-12-13T22:24:35.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph osd crush tunables default 2023-12-13T22:24:35.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.861+0000 7fc0afce6640 1 Processor -- start 2023-12-13T22:24:35.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.861+0000 7fc0afce6640 1 -- start start 2023-12-13T22:24:35.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0afce6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0afce6640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a815a300 con 0x7fc0a815d300 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0afce6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a81537c0 con 0x7fc0a8072780 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0afce6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc0a81533e0 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0ae283640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc0a815d300 legacy=0x7fc0a80c6370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc0a8072780 legacy=0x7fc0a815cbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 msgr2=0x7fc0a80cc000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:35.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:35.865+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.069+0000 7fc0ae283640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc0a815d300 legacy=0x7fc0a80c6370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.069+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 msgr2=0x7fc0a80cc000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.069+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc0a8072780 legacy=0x7fc0a815cbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:36.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.069+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.473+0000 7fc0ae283640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc0a815d300 legacy=0x7fc0a80c6370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.473+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 msgr2=0x7fc0a80cc000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.473+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc0a8072780 legacy=0x7fc0a815cbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:36.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:36.473+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:37.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:37.277+0000 7fc0ae283640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc0a815d300 legacy=0x7fc0a80c6370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:37.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:37.277+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 msgr2=0x7fc0a80cc000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:37.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:37.277+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc0a8072780 legacy=0x7fc0a815cbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:37.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:37.277+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:38.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 msgr2=0x7fc0a80cc000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:38.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc0a81533e0 0x7fc0a80cc000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:38.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc0a8072780 legacy=0x7fc0a815cbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:38.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc0a815d300 legacy=0x7fc0a80c6370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:38.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c0036b0 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc09f7fe640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c008cb0 con 0x7fc08c006120 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 msgr2=0x7fc08c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc0ad281640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 msgr2=0x7fc08c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:38.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:38.865+0000 7fc0ad281640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:39.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.069+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 msgr2=0x7fc08c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:39.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.069+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:39.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.069+0000 7fc0ad281640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 msgr2=0x7fc08c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:39.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.069+0000 7fc0ad281640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:39.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.473+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 msgr2=0x7fc08c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:39.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.473+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:39.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.473+0000 7fc0ad281640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 msgr2=0x7fc08c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:39.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:39.473+0000 7fc0ad281640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:40.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:40.277+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 msgr2=0x7fc08c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:40.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:40.277+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:40.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:40.277+0000 7fc0ad281640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 msgr2=0x7fc08c0085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:40.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:40.277+0000 7fc0ad281640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 msgr2=0x7fc08c0085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c006120 0x7fc08c0085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 msgr2=0x7fc08c005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0036b0 0x7fc08c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ae283640 1 -- reap_dead start 2023-12-13T22:24:41.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a81596f0 con 0x7fc08c003b20 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c0065d0 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc09f7fe640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c008cb0 con 0x7fc08c00abf0 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 msgr2=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:41.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:41.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c003b20 legacy=0x7fc08c0094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:41.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ae283640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 msgr2=0x7fc08c00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:41.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:41.865+0000 7fc0ae283640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.069+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 msgr2=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.069+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.069+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c003b20 legacy=0x7fc08c0094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.069+0000 7fc0ae283640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 msgr2=0x7fc08c00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:42.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.069+0000 7fc0ae283640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.473+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 msgr2=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.473+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.473+0000 7fc0ae283640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 msgr2=0x7fc08c00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.473+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c003b20 legacy=0x7fc08c0094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:42.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:42.473+0000 7fc0ae283640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:43.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:43.277+0000 7fc0ada82640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 msgr2=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:43.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:43.277+0000 7fc0ada82640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:43.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:43.277+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c003b20 legacy=0x7fc08c0094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:43.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:43.277+0000 7fc0ae283640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 msgr2=0x7fc08c00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3301/0 2023-12-13T22:24:43.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:43.277+0000 7fc0ae283640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 -- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 msgr2=0x7fc08c00d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00abf0 0x7fc08c00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 msgr2=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c0065d0 0x7fc08c008f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c003b20 legacy=0x7fc08c0094d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a815a300 con 0x7fc08c00e2b0 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc09f7fe640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c00d7d0 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc0ad281640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00e2b0 legacy=0x7fc08c0129c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 msgr2=0x7fc08c00dbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:44.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:44.865+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:45.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.069+0000 7fc0ad281640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00e2b0 legacy=0x7fc08c0129c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:45.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.069+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 msgr2=0x7fc08c00dbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:45.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.069+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:45.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.473+0000 7fc0ad281640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00e2b0 legacy=0x7fc08c0129c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:45.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.473+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 msgr2=0x7fc08c00dbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:45.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:45.473+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:45.511 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:00:09.667 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:45.604 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:00:09.709 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:45.604 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:00:09.710 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:46.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:46.277+0000 7fc0ad281640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00e2b0 legacy=0x7fc08c0129c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:46.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:46.277+0000 7fc0ada82640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 msgr2=0x7fc08c00dbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.152:3300/0 2023-12-13T22:24:46.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:46.277+0000 7fc0ada82640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:46.334 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:00:10.490 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:46.438 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:00:10.543 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:46.439 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:00:10.545 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:24:47.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 -- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 msgr2=0x7fc08c00dbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:47.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc08c00d7d0 0x7fc08c00dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:47.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00e2b0 legacy=0x7fc08c0129c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:47.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc0ae283640 1 -- reap_dead start 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a81596f0 con 0x7fc08c00dbe0 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a815a300 con 0x7fc08c0147f0 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc09f7fe640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c005b30 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc0ae283640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:47.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc0ada82640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00dbe0 legacy=0x7fc08c0140e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:47.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc0ae283640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:47.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:47.865+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c0147f0 legacy=0x7fc08c009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:48.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.069+0000 7fc0ada82640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00dbe0 legacy=0x7fc08c0140e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:48.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.069+0000 7fc0ae283640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:48.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.069+0000 7fc0ae283640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:48.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.069+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c0147f0 legacy=0x7fc08c009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.473+0000 7fc0ada82640 1 -- >> v1:172.21.15.91:6789/0 conn(0x7fc08c00dbe0 legacy=0x7fc08c0140e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.91:6789/0 2023-12-13T22:24:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.473+0000 7fc0ae283640 1 -- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.91:3300/0 2023-12-13T22:24:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.473+0000 7fc0ae283640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:48.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:48.473+0000 7fc0ad281640 1 -- >> v1:172.21.15.152:6789/0 conn(0x7fc08c0147f0 legacy=0x7fc08c009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.152:6789/0 2023-12-13T22:24:49.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.293+0000 7fc0ad281640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc08c0147f0 0x7fc08c009fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:49540/0 (socket says 172.21.15.91:49540) 2023-12-13T22:24:49.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.293+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 learned_addr learned my addr 172.21.15.91:0/76481208 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:24:49.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.629+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:49.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.645+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:49.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.645+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:49.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.645+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:49.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:49.645+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:50.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 msgr2=0x7fc08c00a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:50.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.91:3300/0 conn(0x7fc08c005b30 0x7fc08c00a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:50.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 >> v1:172.21.15.152:6789/0 conn(0x7fc08c0147f0 legacy=0x7fc08c009fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:50.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 >> v1:172.21.15.91:6789/0 conn(0x7fc08c00dbe0 legacy=0x7fc08c0140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:50.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:50.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:50.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c00c900 2023-12-13T22:24:50.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c008cb0 con 0x7fc08c00bfe0 2023-12-13T22:24:50.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.869+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:50.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.873+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-13T22:24:50.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.873+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:50.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.873+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:50.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.873+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:50.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.913+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.921+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.921+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:50.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.921+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:50.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:50.921+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:51.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.077+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:51.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.085+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:51.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.085+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:51.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.085+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:51.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.085+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:51.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.261+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:51.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.321+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:51.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.321+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:51.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.321+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:51.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.321+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:51.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.489+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:51.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.493+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:51.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.493+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:51.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.493+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:51.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.493+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:51.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.725+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:51.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.729+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:51.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.729+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:51.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.729+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:51.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:51.729+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-13T22:24:52.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.297+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:52.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.301+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:52.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.301+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:52.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.301+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:52.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.301+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:52.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.597+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.601+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-13T22:24:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.601+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.601+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:52.601+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 msgr2=0x7fc08c00c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c00bfe0 0x7fc08c00c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 msgr2=0x7fc08c00cd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00c900 0x7fc08c00cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 reap_dead start 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a81537c0 con 0x7fc08c00dbe0 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc08c00cd10 2023-12-13T22:24:53.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.865+0000 7fc09f7fe640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c008cb0 con 0x7fc08c005ad0 2023-12-13T22:24:53.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.869+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.873+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc08c013f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-13T22:24:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.873+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc08c013f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:53.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.873+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:53.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:53.873+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:54.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.137+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.141+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 msgr2=0x7fc08c0139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-13T22:24:54.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.141+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 msgr2=0x7fc08c0139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:54.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.141+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:54.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.141+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-13T22:24:54.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.325+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.365+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc08c013f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-13T22:24:54.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.365+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc08c013f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:54.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.365+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:54.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.365+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:54.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.377+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.393+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 msgr2=0x7fc08c0139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-13T22:24:54.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.393+0000 7fc0ad281640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 msgr2=0x7fc08c0139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-13T22:24:54.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.393+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-13T22:24:54.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.393+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-13T22:24:54.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.777+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119257576 0 0) 0x7fc0a81537c0 con 0x7fc08c00dbe0 2023-12-13T22:24:54.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.777+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094003530 con 0x7fc08c00dbe0 2023-12-13T22:24:54.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.805+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545312735 0 0) 0x7fc094003530 con 0x7fc08c00dbe0 2023-12-13T22:24:54.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc08c013f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:54.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc08c013f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 msgr2=0x7fc08c0139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 --2- 172.21.15.91:0/76481208 >> v2:172.21.15.152:3300/0 conn(0x7fc08c00cd10 0x7fc08c0139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c00d350 con 0x7fc08c00dbe0 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fc0a4009490 con 0x7fc08c00dbe0 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 >> v1:172.21.15.91:6789/0 conn(0x7fc08c00dbe0 legacy=0x7fc08c008f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0940039f0 0x7fc094003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc0940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc094004d10 0x7fc094005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a8159430 con 0x7fc0940039f0 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c008cb0 con 0x7fc094004d10 2023-12-13T22:24:54.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.897+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400ba90 con 0x7fc08c005ad0 2023-12-13T22:24:54.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.941+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0940039f0 0x7fc094003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.957+0000 7fc0ae283640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc094004d10 0x7fc094005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.989+0000 7fc0ad281640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc0940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:54.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.993+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 msgr2=0x7fc0940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:54.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.993+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc08c005ad0 0x7fc0940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:54.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.993+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc094004d10 msgr2=0x7fc094005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:54.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.993+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc094004d10 0x7fc094005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:54.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:54.993+0000 7fc0ada82640 1 -- 172.21.15.91:0/76481208 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094003530 con 0x7fc0940039f0 2023-12-13T22:24:55.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.113+0000 7fc0ada82640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0940039f0 0x7fc094003e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4000eb0 tx=0x7fc0a401db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5257241e64ad6760 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.237+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40a7040 con 0x7fc0940039f0 2023-12-13T22:24:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.237+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a40ab600 con 0x7fc0940039f0 2023-12-13T22:24:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.237+0000 7fc0aca80640 1 -- 172.21.15.91:0/76481208 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40ab990 con 0x7fc0940039f0 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.237+0000 7fc0afce6640 1 -- 172.21.15.91:0/76481208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0940039f0 msgr2=0x7fc094003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.237+0000 7fc0afce6640 1 --2- 172.21.15.91:0/76481208 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0940039f0 0x7fc094003e10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4000eb0 tx=0x7fc0a401db50 comp rx=0 tx=0).stop 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0ae283640 1 -- 172.21.15.91:0/76481208 reap_dead start 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- 172.21.15.91:0/76481208 shutdown_connections 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- 172.21.15.91:0/76481208 >> 172.21.15.91:0/76481208 conn(0x7fc0a806b670 msgr2=0x7fc0a806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- 172.21.15.91:0/76481208 shutdown_connections 2023-12-13T22:24:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- 172.21.15.91:0/76481208 wait complete. 2023-12-13T22:24:55.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 Processor -- start 2023-12-13T22:24:55.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- start start 2023-12-13T22:24:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0a814e100 0x7fc0a81f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc0a806aba0 0x7fc0a814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80cb890 con 0x7fc0a814e100 2023-12-13T22:24:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a81ee910 con 0x7fc0a806a7c0 2023-12-13T22:24:55.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.241+0000 7fc0afce6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80c9ed0 con 0x7fc0a806aba0 2023-12-13T22:24:55.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.265+0000 7fc0ae283640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc0a806aba0 0x7fc0a814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:55.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.269+0000 7fc0ada82640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:55.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.269+0000 7fc0ada82640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:46612/0 (socket says 172.21.15.91:46612) 2023-12-13T22:24:55.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.269+0000 7fc0ada82640 1 -- 172.21.15.91:0/2698639907 learned_addr learned my addr 172.21.15.91:0/2698639907 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:24:55.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.273+0000 7fc0ada82640 1 -- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc0a806aba0 msgr2=0x7fc0a814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:55.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.273+0000 7fc0ada82640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc0a806aba0 0x7fc0a814b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:55.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.273+0000 7fc0ada82640 1 -- 172.21.15.91:0/2698639907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0a814e100 msgr2=0x7fc0a81f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:55.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.273+0000 7fc0ada82640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0a814e100 0x7fc0a81f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:55.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.273+0000 7fc0ada82640 1 -- 172.21.15.91:0/2698639907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a81eebb0 con 0x7fc0a806a7c0 2023-12-13T22:24:55.277 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.277+0000 7fc0ada82640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4003b60 tx=0x7fc094005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.357+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40a7020 con 0x7fc0a806a7c0 2023-12-13T22:24:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.357+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4009610 con 0x7fc0a806a7c0 2023-12-13T22:24:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.357+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a81eee90 con 0x7fc0a806a7c0 2023-12-13T22:24:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.357+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4009490 con 0x7fc0a806a7c0 2023-12-13T22:24:55.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.357+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80c9bc0 con 0x7fc0a806a7c0 2023-12-13T22:24:55.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.361+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a8073e70 con 0x7fc0a806a7c0 2023-12-13T22:24:55.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.405+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fc0a40b4980 con 0x7fc0a806a7c0 2023-12-13T22:24:55.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.409+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc0a40c0c50 con 0x7fc0a806a7c0 2023-12-13T22:24:55.461 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:55.459+0000 7f72ece29180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-13T22:24:55.586 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:55.585+0000 7f2ffa4bc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-13T22:24:55.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.625+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fc0a40bc020 con 0x7fc0a806a7c0 2023-12-13T22:24:55.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:55.717+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc0a8071d50 con 0x7fc0a806a7c0 2023-12-13T22:24:56.015 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.015+0000 7f72ece29180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-13T22:24:56.104 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:56.105+0000 7f2ffa4bc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-13T22:24:56.184 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.183+0000 7f72ece29180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-13T22:24:56.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.281+0000 7fc09e7fc640 1 -- 172.21.15.91:0/2698639907 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc0a4009bf0 con 0x7fc0a806a7c0 2023-12-13T22:24:56.283 INFO:teuthology.orchestra.run.smithi091.stderr:adjusted tunables profile to default 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 msgr2=0x7fc0a80cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4003b60 tx=0x7fc094005800 comp rx=0 tx=0).stop 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 shutdown_connections 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc0a806aba0 0x7fc0a814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc0a814e100 0x7fc0a81f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 --2- 172.21.15.91:0/2698639907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc0a806a7c0 0x7fc0a80cb350 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 >> 172.21.15.91:0/2698639907 conn(0x7fc0a806b670 msgr2=0x7fc0a815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 shutdown_connections 2023-12-13T22:24:56.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:24:56.285+0000 7fc0afce6640 1 -- 172.21.15.91:0/2698639907 wait complete. 2023-12-13T22:24:56.285 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:56.285+0000 7f2ffa4bc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-13T22:24:56.305 INFO:tasks.ceph:check_enable_crimson: False 2023-12-13T22:24:56.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-13T22:24:56.306 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:56.306 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-13T22:24:56.318 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:56.318 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-13T22:24:56.369 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:56.369 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-13T22:24:56.421 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:24:56.421 DEBUG:teuthology.orchestra.run.smithi091:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-13T22:24:56.474 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:56.474 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-13T22:24:56.487 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:56.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-13T22:24:56.541 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:56.541 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-13T22:24:56.594 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-13T22:24:56.594 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-13T22:24:56.650 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 5fed0772-ab6b-4bab-ac40-e2979b535120 0 2023-12-13T22:24:56.751 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.751+0000 7f72ece29180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-13T22:24:56.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 Processor -- start 2023-12-13T22:24:56.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 -- start start 2023-12-13T22:24:56.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f134c157ba0 0x7f134c0c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f134c0c4f80 0x7f134c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c0c6920 con 0x7f134c13d010 2023-12-13T22:24:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0c5d30 con 0x7f134c0c4f80 2023-12-13T22:24:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f1351f01640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c06f710 con 0x7f134c157ba0 2023-12-13T22:24:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.803+0000 7f134bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f134c0c4f80 0x7f134c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:56.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.807+0000 7f134bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f134c0c4f80 0x7f134c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.152:36162/0 (socket says 172.21.15.152:36162) 2023-12-13T22:24:56.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.807+0000 7f134bfff640 1 -- 172.21.15.152:0/1117299422 learned_addr learned my addr 172.21.15.152:0/1117299422 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:56.807 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.807+0000 7f72ece29180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-13T22:24:56.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.811+0000 7f134bfff640 1 -- 172.21.15.152:0/1117299422 >> v2:172.21.15.152:3300/0 conn(0x7f134c157ba0 msgr2=0x7f134c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:56.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.811+0000 7f134bfff640 1 --2- 172.21.15.152:0/1117299422 >> v2:172.21.15.152:3300/0 conn(0x7f134c157ba0 0x7f134c0c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.811+0000 7f134bfff640 1 -- 172.21.15.152:0/1117299422 >> v1:172.21.15.91:6789/0 conn(0x7f134c13d010 legacy=0x7f134c06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:56.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.811+0000 7f134bfff640 1 -- 172.21.15.152:0/1117299422 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0c5ff0 con 0x7f134c0c4f80 2023-12-13T22:24:56.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.819+0000 7f134bfff640 1 --2- 172.21.15.152:0/1117299422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c0c7c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f134c06e500 tx=0x7f134401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9616fa1e24a40c2b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:56.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.827+0000 7f134a7fc640 1 -- 172.21.15.152:0/1117299422 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440a5790 con 0x7f134c0c4f80 2023-12-13T22:24:56.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.827+0000 7f134a7fc640 1 -- 172.21.15.152:0/1117299422 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440a58f0 con 0x7f134c0c4f80 2023-12-13T22:24:56.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.827+0000 7f134a7fc640 1 -- 172.21.15.152:0/1117299422 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440a5c80 con 0x7f134c0c4f80 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- 172.21.15.152:0/1117299422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 msgr2=0x7f134c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- 172.21.15.152:0/1117299422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c0c7c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f134c06e500 tx=0x7f134401c8d0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- 172.21.15.152:0/1117299422 shutdown_connections 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- 172.21.15.152:0/1117299422 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c0c7c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- 172.21.15.152:0/1117299422 >> v2:172.21.15.152:3300/0 conn(0x7f134c157ba0 0x7f134c0c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- 172.21.15.152:0/1117299422 >> 172.21.15.152:0/1117299422 conn(0x7f134c0713a0 msgr2=0x7f134c0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- 172.21.15.152:0/1117299422 shutdown_connections 2023-12-13T22:24:56.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- 172.21.15.152:0/1117299422 wait complete. 2023-12-13T22:24:56.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 Processor -- start 2023-12-13T22:24:56.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- start start 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c13d010 0x7f134c1351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c13ff30 con 0x7f134c0c4f80 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c13f3b0 con 0x7f134c13d010 2023-12-13T22:24:56.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.831+0000 7f1351f01640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c140360 con 0x7f134c157ba0 2023-12-13T22:24:56.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.835+0000 7f134bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:56.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.835+0000 7f134affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c13d010 0x7f134c1351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:56.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.835+0000 7f134bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42456/0 (socket says 172.21.15.152:42456) 2023-12-13T22:24:56.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.835+0000 7f134bfff640 1 -- 172.21.15.152:0/461714283 learned_addr learned my addr 172.21.15.152:0/461714283 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:56.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.839+0000 7f134bfff640 1 -- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c13d010 msgr2=0x7f134c1351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:56.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.839+0000 7f134bfff640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c13d010 0x7f134c1351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.839+0000 7f134bfff640 1 -- 172.21.15.152:0/461714283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 msgr2=0x7f134c13d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:56.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.839+0000 7f134bfff640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:56.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.839+0000 7f134bfff640 1 -- 172.21.15.152:0/461714283 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009b30 con 0x7f134c157ba0 2023-12-13T22:24:56.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.843+0000 7f134bfff640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13440af040 tx=0x7f1344019670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440b8670 con 0x7f134c157ba0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440b87d0 con 0x7f134c157ba0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c13d730 con 0x7f134c157ba0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440b8b40 con 0x7f134c157ba0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c153ea0 con 0x7f134c157ba0 2023-12-13T22:24:56.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:56.847+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c153d00 con 0x7f134c157ba0 2023-12-13T22:24:56.865 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:56.865+0000 7f2ffa4bc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-13T22:24:56.866 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.867+0000 7f72ece29180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-13T22:24:56.923 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:56.925+0000 7f2ffa4bc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-13T22:24:56.948 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.947+0000 7f72ece29180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-13T22:24:56.977 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:56.977+0000 7f2ffa4bc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-13T22:24:57.000 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:56.999+0000 7f72ece29180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-13T22:24:57.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.031+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f13440b8ca0 con 0x7f134c157ba0 2023-12-13T22:24:57.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.031+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1344004600 con 0x7f134c157ba0 2023-12-13T22:24:57.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.031+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f134c153d00 con 0x7f134c157ba0 2023-12-13T22:24:57.054 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.053+0000 7f2ffa4bc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-13T22:24:57.080 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:57.079+0000 7f72ece29180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-13T22:24:57.106 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.105+0000 7f2ffa4bc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-13T22:24:57.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.107+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5fed0772-ab6b-4bab-ac40-e2979b535120", "id": 0} v 0) v1 -- 0x7f134c157fd0 con 0x7f134c157ba0 2023-12-13T22:24:57.134 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:57.135+0000 7f72ece29180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-13T22:24:57.183 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.185+0000 7f2ffa4bc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-13T22:24:57.237 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.237+0000 7f2ffa4bc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-13T22:24:57.272 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:57.271+0000 7f72ece29180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-13T22:24:57.333 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:57.331+0000 7f72ece29180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-13T22:24:57.379 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.381+0000 7f2ffa4bc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-13T22:24:57.440 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:57.441+0000 7f2ffa4bc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-13T22:24:57.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1333fff640 1 -- 172.21.15.152:0/461714283 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fed0772-ab6b-4bab-ac40-e2979b535120", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f134c157fd0 con 0x7f134c157ba0 2023-12-13T22:24:57.525 INFO:teuthology.orchestra.run.smithi152.stdout:0 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 msgr2=0x7f134c1f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13440af040 tx=0x7f1344019670 comp rx=0 tx=0).stop 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 shutdown_connections 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f134c157ba0 0x7f134c1f16b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c13d010 0x7f134c1351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 --2- 172.21.15.152:0/461714283 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f134c0c4f80 0x7f134c13d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 >> 172.21.15.152:0/461714283 conn(0x7f134c0713a0 msgr2=0x7f134c156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 shutdown_connections 2023-12-13T22:24:57.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.523+0000 7f1351f01640 1 -- 172.21.15.152:0/461714283 wait complete. 2023-12-13T22:24:57.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new b9b73726-3d11-403e-95c1-8ba6887cb4a7 1 2023-12-13T22:24:57.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 Processor -- start 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 -- start start 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c7660 0x7f2f880c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2f88159380 0x7f2f880c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2f880c6860 0x7f2f88155110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f88158f60 con 0x7f2f880c6860 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880c7f80 con 0x7f2f88159380 2023-12-13T22:24:57.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.695+0000 7f2f8e464640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88156110 con 0x7f2f880c7660 2023-12-13T22:24:57.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.699+0000 7f2f8cc61640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2f88159380 0x7f2f880c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.699+0000 7f2f8cc61640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2f88159380 0x7f2f880c2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37712/0 (socket says 172.21.15.152:37712) 2023-12-13T22:24:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.699+0000 7f2f8d462640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c7660 0x7f2f880c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:57.700 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.699+0000 7f2f8cc61640 1 -- 172.21.15.152:0/2523198723 learned_addr learned my addr 172.21.15.152:0/2523198723 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:57.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.703+0000 7f2f8cc61640 1 -- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c7660 msgr2=0x7f2f880c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.703+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c7660 0x7f2f880c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.703+0000 7f2f8cc61640 1 -- 172.21.15.152:0/2523198723 >> v2:172.21.15.91:3300/0 conn(0x7f2f880c6860 msgr2=0x7f2f88155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.703+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/2523198723 >> v2:172.21.15.91:3300/0 conn(0x7f2f880c6860 0x7f2f88155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.703+0000 7f2f8cc61640 1 -- 172.21.15.152:0/2523198723 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880c3500 con 0x7f2f88159380 2023-12-13T22:24:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.711+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f88159380 0x7f2f880c2fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f8806f4d0 tx=0x7f2f7801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb6d4fa71d81ac4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:57.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f7ffff640 1 -- 172.21.15.152:0/2523198723 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780a89d0 con 0x7f2f88159380 2023-12-13T22:24:57.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f7ffff640 1 -- 172.21.15.152:0/2523198723 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780a8b30 con 0x7f2f88159380 2023-12-13T22:24:57.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f7ffff640 1 -- 172.21.15.152:0/2523198723 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b0440 con 0x7f2f88159380 2023-12-13T22:24:57.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f88159380 msgr2=0x7f2f880c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:57.719 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 --2- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f88159380 0x7f2f880c2fc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f8806f4d0 tx=0x7f2f7801ed30 comp rx=0 tx=0).stop 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- 172.21.15.152:0/2523198723 shutdown_connections 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 --2- 172.21.15.152:0/2523198723 >> v2:172.21.15.91:3300/0 conn(0x7f2f880c6860 0x7f2f88155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 --2- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f88159380 0x7f2f880c2fc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 --2- 172.21.15.152:0/2523198723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c7660 0x7f2f880c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- 172.21.15.152:0/2523198723 >> 172.21.15.152:0/2523198723 conn(0x7f2f8806a560 msgr2=0x7f2f8806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- 172.21.15.152:0/2523198723 shutdown_connections 2023-12-13T22:24:57.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- 172.21.15.152:0/2523198723 wait complete. 2023-12-13T22:24:57.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 Processor -- start 2023-12-13T22:24:57.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.719+0000 7f2f8e464640 1 -- start start 2023-12-13T22:24:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 0x7f2f881effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 0x7f2f881ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f88159380 0x7f2f88148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:57.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881f3040 con 0x7f2f88159380 2023-12-13T22:24:57.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881ef220 con 0x7f2f880c7660 2023-12-13T22:24:57.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8e464640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88072370 con 0x7f2f880c6860 2023-12-13T22:24:57.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8d462640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 0x7f2f881effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8cc61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 0x7f2f881ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8d462640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 0x7f2f881effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42474/0 (socket says 172.21.15.152:42474) 2023-12-13T22:24:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8d462640 1 -- 172.21.15.152:0/1065842296 learned_addr learned my addr 172.21.15.152:0/1065842296 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:57.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.723+0000 7f2f8dc63640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f88159380 0x7f2f88148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:57.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 -- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 msgr2=0x7f2f881effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:57.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 0x7f2f881effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 -- 172.21.15.152:0/1065842296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f88159380 msgr2=0x7f2f88148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:57.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f88159380 0x7f2f88148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:57.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 -- 172.21.15.152:0/1065842296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780094d0 con 0x7f2f880c7660 2023-12-13T22:24:57.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.727+0000 7f2f8cc61640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 0x7f2f881ef6b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f780af000 tx=0x7f2f7801d570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:57.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b0e50 con 0x7f2f880c7660 2023-12-13T22:24:57.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780bb480 con 0x7f2f880c7660 2023-12-13T22:24:57.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780bb830 con 0x7f2f880c7660 2023-12-13T22:24:57.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88072610 con 0x7f2f880c7660 2023-12-13T22:24:57.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f881488c0 con 0x7f2f880c7660 2023-12-13T22:24:57.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.731+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f881ef390 con 0x7f2f880c7660 2023-12-13T22:24:57.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.851+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2f780bbd10 con 0x7f2f880c7660 2023-12-13T22:24:57.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.851+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2f780cf7e0 con 0x7f2f880c7660 2023-12-13T22:24:57.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.851+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f2f780b5070 con 0x7f2f880c7660 2023-12-13T22:24:57.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:57.927+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9b73726-3d11-403e-95c1-8ba6887cb4a7", "id": 1} v 0) v1 -- 0x7f2f8804e8c0 con 0x7f2f880c7660 2023-12-13T22:24:57.948 INFO:tasks.ceph.mgr.x.smithi152.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-13T22:24:57.948 INFO:tasks.ceph.mgr.x.smithi152.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-13T22:24:57.948 INFO:tasks.ceph.mgr.x.smithi152.stderr: from numpy import show_config as show_numpy_config 2023-12-13T22:24:58.002 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:57.999+0000 7f72ece29180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-13T22:24:58.069 INFO:tasks.ceph.mgr.y.smithi091.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-13T22:24:58.069 INFO:tasks.ceph.mgr.y.smithi091.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-13T22:24:58.069 INFO:tasks.ceph.mgr.y.smithi091.stderr: from numpy import show_config as show_numpy_config 2023-12-13T22:24:58.112 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:58.113+0000 7f2ffa4bc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-13T22:24:58.142 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:58.143+0000 7f72ece29180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-13T22:24:58.281 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:58.281+0000 7f2ffa4bc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-13T22:24:58.300 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f7dffb640 1 -- 172.21.15.152:0/1065842296 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9b73726-3d11-403e-95c1-8ba6887cb4a7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f780d30b0 con 0x7f2f880c7660 2023-12-13T22:24:58.300 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 msgr2=0x7f2f881ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 0x7f2f881ef6b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f780af000 tx=0x7f2f7801d570 comp rx=0 tx=0).stop 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 shutdown_connections 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f88159380 0x7f2f88148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f880c7660 0x7f2f881ef6b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 --2- 172.21.15.152:0/1065842296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f880c6860 0x7f2f881effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 >> 172.21.15.152:0/1065842296 conn(0x7f2f8806a560 msgr2=0x7f2f8814e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 shutdown_connections 2023-12-13T22:24:58.302 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.299+0000 7f2f8e464640 1 -- 172.21.15.152:0/1065842296 wait complete. 2023-12-13T22:24:58.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new b7cda291-66eb-4d55-baea-1280ff39ceb1 2 2023-12-13T22:24:58.334 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:58.335+0000 7f72ece29180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-13T22:24:58.404 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:58.403+0000 7f72ece29180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-13T22:24:58.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 Processor -- start 2023-12-13T22:24:58.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 -- start start 2023-12-13T22:24:58.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f47300c8ca0 0x7f4730164e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:58.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4730070010 con 0x7f4730153930 2023-12-13T22:24:58.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4730159ee0 con 0x7f47300c2ac0 2023-12-13T22:24:58.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.431+0000 7f47367ae640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4730153d10 con 0x7f47300c8ca0 2023-12-13T22:24:58.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.435+0000 7f4727fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47300c2ac0 0x7f47300c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60638/0 (socket says 172.21.15.152:60638) 2023-12-13T22:24:58.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.435+0000 7f4727fff640 1 -- 172.21.15.152:0/1035623617 learned_addr learned my addr 172.21.15.152:0/1035623617 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-12-13T22:24:58.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.435+0000 7f4734d4b640 1 --2- 172.21.15.152:0/1035623617 >> v2:172.21.15.91:3300/0 conn(0x7f47300c8ca0 0x7f4730164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:58.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.435+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770668373 0 0) 0x7f4730159ee0 con 0x7f47300c2ac0 2023-12-13T22:24:58.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.435+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f471c003530 con 0x7f47300c2ac0 2023-12-13T22:24:58.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.443+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920184506 0 0) 0x7f471c003530 con 0x7f47300c2ac0 2023-12-13T22:24:58.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.443+0000 7f4734d4b640 1 -- 172.21.15.152:0/1035623617 >> v1:172.21.15.152:6789/0 conn(0x7f47300c2ac0 legacy=0x7f47300c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.443+0000 7f4734d4b640 1 -- 172.21.15.152:0/1035623617 >> v1:172.21.15.91:6789/0 conn(0x7f4730153930 legacy=0x7f473015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.443+0000 7f4734d4b640 1 -- 172.21.15.152:0/1035623617 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300c6730 con 0x7f47300c8ca0 2023-12-13T22:24:58.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.455+0000 7f4734d4b640 1 --2- 172.21.15.152:0/1035623617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47300c8ca0 0x7f4730164e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4728009d90 tx=0x7f472801f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3700593213bf1a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:58.464 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:58.465+0000 7f2ffa4bc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-13T22:24:58.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718001680 con 0x7f47300c8ca0 2023-12-13T22:24:58.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47280a8c10 con 0x7f47300c8ca0 2023-12-13T22:24:58.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f472f7fe640 1 -- 172.21.15.152:0/1035623617 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47280b0440 con 0x7f47300c8ca0 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 -- 172.21.15.152:0/1035623617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47300c8ca0 msgr2=0x7f4730164e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 --2- 172.21.15.152:0/1035623617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47300c8ca0 0x7f4730164e10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4728009d90 tx=0x7f472801f080 comp rx=0 tx=0).stop 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 -- 172.21.15.152:0/1035623617 shutdown_connections 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 --2- 172.21.15.152:0/1035623617 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f47300c8ca0 0x7f4730164e10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 -- 172.21.15.152:0/1035623617 >> 172.21.15.152:0/1035623617 conn(0x7f473006b670 msgr2=0x7f473006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 -- 172.21.15.152:0/1035623617 shutdown_connections 2023-12-13T22:24:58.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.463+0000 7f47367ae640 1 -- 172.21.15.152:0/1035623617 wait complete. 2023-12-13T22:24:58.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 Processor -- start 2023-12-13T22:24:58.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 -- start start 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47300c8ca0 0x7f4730156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4730153930 0x7f47301ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c1500 con 0x7f4730153930 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c3c90 con 0x7f47300c8ca0 2023-12-13T22:24:58.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f47367ae640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47301ef180 con 0x7f47300c2ac0 2023-12-13T22:24:58.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f4727fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47300c8ca0 0x7f4730156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:58.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f472ffff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:58.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f472ffff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42486/0 (socket says 172.21.15.152:42486) 2023-12-13T22:24:58.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.467+0000 7f472ffff640 1 -- 172.21.15.152:0/1136565871 learned_addr learned my addr 172.21.15.152:0/1136565871 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:58.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f4734d4b640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4730153930 0x7f47301ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f472ffff640 1 -- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47300c8ca0 msgr2=0x7f4730156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f472ffff640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47300c8ca0 0x7f4730156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f472ffff640 1 -- 172.21.15.152:0/1136565871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4730153930 msgr2=0x7f47301ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f472ffff640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4730153930 0x7f47301ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:58.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.471+0000 7f472ffff640 1 -- 172.21.15.152:0/1136565871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4728009a70 con 0x7f47300c2ac0 2023-12-13T22:24:58.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.475+0000 7f472ffff640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f472000c3a0 tx=0x7f472000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200052d0 con 0x7f47300c2ac0 2023-12-13T22:24:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720005430 con 0x7f47300c2ac0 2023-12-13T22:24:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720007260 con 0x7f47300c2ac0 2023-12-13T22:24:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300c4eb0 con 0x7f47300c2ac0 2023-12-13T22:24:58.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47300c5400 con 0x7f47300c2ac0 2023-12-13T22:24:58.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.479+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4730073e70 con 0x7f47300c2ac0 2023-12-13T22:24:58.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.483+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f47200067e0 con 0x7f47300c2ac0 2023-12-13T22:24:58.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.483+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4720003c70 con 0x7f47300c2ac0 2023-12-13T22:24:58.531 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:58.533+0000 7f2ffa4bc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-13T22:24:58.539 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:58.539+0000 7f72ece29180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-13T22:24:58.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.583+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f4720020060 con 0x7f47300c2ac0 2023-12-13T22:24:58.655 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:58.657+0000 7f2ffa4bc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-13T22:24:58.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:58.659+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b7cda291-66eb-4d55-baea-1280ff39ceb1", "id": 2} v 0) v1 -- 0x7f4730072b40 con 0x7f47300c2ac0 2023-12-13T22:24:58.952 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:24:58.955 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:24:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.103+0000 7f472d7fa640 1 -- 172.21.15.152:0/1136565871 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7cda291-66eb-4d55-baea-1280ff39ceb1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4720003600 con 0x7f47300c2ac0 2023-12-13T22:24:59.106 INFO:teuthology.orchestra.run.smithi152.stdout:2 2023-12-13T22:24:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 msgr2=0x7f47301557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f472000c3a0 tx=0x7f472000c860 comp rx=0 tx=0).stop 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 shutdown_connections 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4730153930 0x7f47301ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47300c8ca0 0x7f4730156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 --2- 172.21.15.152:0/1136565871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47300c2ac0 0x7f47301557b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 >> 172.21.15.152:0/1136565871 conn(0x7f473006b670 msgr2=0x7f4730152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 shutdown_connections 2023-12-13T22:24:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.107+0000 7f47367ae640 1 -- 172.21.15.152:0/1136565871 wait complete. 2023-12-13T22:24:59.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new a903b56a-614d-4b1d-b0a1-671042c0fa25 3 2023-12-13T22:24:59.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.239+0000 7f39c4060640 1 Processor -- start 2023-12-13T22:24:59.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.239+0000 7f39c4060640 1 -- start start 2023-12-13T22:24:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c4060640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39bc072780 0x7f39bc15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c4060640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c4060640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc15a300 con 0x7f39bc1533e0 2023-12-13T22:24:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c4060640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc15d5c0 con 0x7f39bc072780 2023-12-13T22:24:59.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c4060640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1537c0 con 0x7f39bc15d130 2023-12-13T22:24:59.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c25fd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c25fd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42490/0 (socket says 172.21.15.152:42490) 2023-12-13T22:24:59.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.243+0000 7f39c25fd640 1 -- 172.21.15.152:0/4180078095 learned_addr learned my addr 172.21.15.152:0/4180078095 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:59.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f39c25fd640 1 -- 172.21.15.152:0/4180078095 >> v2:172.21.15.91:3300/0 conn(0x7f39bc072780 msgr2=0x7f39bc15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:59.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f39c25fd640 1 --2- 172.21.15.152:0/4180078095 >> v2:172.21.15.91:3300/0 conn(0x7f39bc072780 0x7f39bc15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f39c25fd640 1 -- 172.21.15.152:0/4180078095 >> v1:172.21.15.91:6789/0 conn(0x7f39bc1533e0 legacy=0x7f39bc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:59.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f39c25fd640 1 -- 172.21.15.152:0/4180078095 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc159430 con 0x7f39bc15d130 2023-12-13T22:24:59.249 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f72ece29180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-13T22:24:59.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.247+0000 7f39c25fd640 1 --2- 172.21.15.152:0/4180078095 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39bc159620 tx=0x7f39ac01c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c905292fbfa6ca0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:59.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c0dfa640 1 -- 172.21.15.152:0/4180078095 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0a5720 con 0x7f39bc15d130 2023-12-13T22:24:59.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c0dfa640 1 -- 172.21.15.152:0/4180078095 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0a5880 con 0x7f39bc15d130 2023-12-13T22:24:59.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c0dfa640 1 -- 172.21.15.152:0/4180078095 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0a5c10 con 0x7f39bc15d130 2023-12-13T22:24:59.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- 172.21.15.152:0/4180078095 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 msgr2=0x7f39bc0c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- 172.21.15.152:0/4180078095 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39bc159620 tx=0x7f39ac01c9b0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- 172.21.15.152:0/4180078095 shutdown_connections 2023-12-13T22:24:59.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- 172.21.15.152:0/4180078095 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc15d130 0x7f39bc0c6370 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- 172.21.15.152:0/4180078095 >> v2:172.21.15.91:3300/0 conn(0x7f39bc072780 0x7f39bc15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- 172.21.15.152:0/4180078095 >> 172.21.15.152:0/4180078095 conn(0x7f39bc06b670 msgr2=0x7f39bc06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:59.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- 172.21.15.152:0/4180078095 shutdown_connections 2023-12-13T22:24:59.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- 172.21.15.152:0/4180078095 wait complete. 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 Processor -- start 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- start start 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 0x7f39bc15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39bc15d130 0x7f39bc148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1472c0 con 0x7f39bc15d130 2023-12-13T22:24:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc070430 con 0x7f39bc072780 2023-12-13T22:24:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.259+0000 7f39c4060640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1f5f90 con 0x7f39bc1533e0 2023-12-13T22:24:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.263+0000 7f39c1dfc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 0x7f39bc15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.263+0000 7f39c15fb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.263+0000 7f39c15fb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42506/0 (socket says 172.21.15.152:42506) 2023-12-13T22:24:59.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.263+0000 7f39c15fb640 1 -- 172.21.15.152:0/942306973 learned_addr learned my addr 172.21.15.152:0/942306973 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c25fd640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39bc15d130 0x7f39bc148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c15fb640 1 -- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 msgr2=0x7f39bc15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c15fb640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 0x7f39bc15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c15fb640 1 -- 172.21.15.152:0/942306973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39bc15d130 msgr2=0x7f39bc148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c15fb640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39bc15d130 0x7f39bc148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c15fb640 1 -- 172.21.15.152:0/942306973 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009b30 con 0x7f39bc1533e0 2023-12-13T22:24:59.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.267+0000 7f39c1dfc640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 0x7f39bc15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T22:24:59.269 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.269+0000 7f2ffa4bc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-13T22:24:59.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.271+0000 7f39c15fb640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b000b550 tx=0x7f39b000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:59.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.271+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0010870 con 0x7f39bc1533e0 2023-12-13T22:24:59.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.271+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc1f6270 con 0x7f39bc1533e0 2023-12-13T22:24:59.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.271+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc147920 con 0x7f39bc1533e0 2023-12-13T22:24:59.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.275+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc073e70 con 0x7f39bc1533e0 2023-12-13T22:24:59.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.275+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b00109d0 con 0x7f39bc1533e0 2023-12-13T22:24:59.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.275+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0010d60 con 0x7f39bc1533e0 2023-12-13T22:24:59.346 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.345+0000 7f2ffa4bc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-13T22:24:59.349 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:59.347+0000 7f72ece29180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-13T22:24:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.407+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f39b0023480 con 0x7f39bc1533e0 2023-12-13T22:24:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.407+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f39b000f870 con 0x7f39bc1533e0 2023-12-13T22:24:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.407+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f39b001e060 con 0x7f39bc1533e0 2023-12-13T22:24:59.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.479+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a903b56a-614d-4b1d-b0a1-671042c0fa25", "id": 3} v 0) v1 -- 0x7f39bc145bd0 con 0x7f39bc1533e0 2023-12-13T22:24:59.516 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.517+0000 7f2ffa4bc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-13T22:24:59.535 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:59.535+0000 7f72ece29180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-13T22:24:59.592 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.593+0000 7f2ffa4bc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-13T22:24:59.615 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:59.615+0000 7f72ece29180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-13T22:24:59.697 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.695+0000 7f39ba7fc640 1 -- 172.21.15.152:0/942306973 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a903b56a-614d-4b1d-b0a1-671042c0fa25", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39b0027020 con 0x7f39bc1533e0 2023-12-13T22:24:59.697 INFO:teuthology.orchestra.run.smithi152.stdout:3 2023-12-13T22:24:59.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.695+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 msgr2=0x7f39bc148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.695+0000 7f39c4060640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b000b550 tx=0x7f39b000ba10 comp rx=0 tx=0).stop 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 shutdown_connections 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39bc15d130 0x7f39bc148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39bc1533e0 0x7f39bc148120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 --2- 172.21.15.152:0/942306973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39bc072780 0x7f39bc15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 >> 172.21.15.152:0/942306973 conn(0x7f39bc06b670 msgr2=0x7f39bc06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 shutdown_connections 2023-12-13T22:24:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.699+0000 7f39c4060640 1 -- 172.21.15.152:0/942306973 wait complete. 2023-12-13T22:24:59.714 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c 4 2023-12-13T22:24:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.827+0000 7ff085a58640 1 Processor -- start 2023-12-13T22:24:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.827+0000 7ff085a58640 1 -- start start 2023-12-13T22:24:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff085a58640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff085a58640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff08006ad60 0x7ff0801571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff085a58640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff080072400 con 0x7ff080072890 2023-12-13T22:24:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff085a58640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff080157cc0 con 0x7ff08006ad60 2023-12-13T22:24:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff085a58640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff080157fa0 con 0x7ff0801513c0 2023-12-13T22:24:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff07effd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff07e7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff08006ad60 0x7ff0801571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff07effd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42512/0 (socket says 172.21.15.152:42512) 2023-12-13T22:24:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.831+0000 7ff07effd640 1 -- 172.21.15.152:0/4151566073 learned_addr learned my addr 172.21.15.152:0/4151566073 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:59.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.835+0000 7ff07effd640 1 -- 172.21.15.152:0/4151566073 >> v2:172.21.15.152:3300/0 conn(0x7ff08006ad60 msgr2=0x7ff0801571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:59.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.835+0000 7ff07effd640 1 --2- 172.21.15.152:0/4151566073 >> v2:172.21.15.152:3300/0 conn(0x7ff08006ad60 0x7ff0801571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.835+0000 7ff07effd640 1 -- 172.21.15.152:0/4151566073 >> v1:172.21.15.152:6789/0 conn(0x7ff080072890 legacy=0x7ff0800c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:24:59.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.835+0000 7ff07effd640 1 -- 172.21.15.152:0/4151566073 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080071db0 con 0x7ff0801513c0 2023-12-13T22:24:59.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.839+0000 7ff07effd640 1 --2- 172.21.15.152:0/4151566073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd10c99abe2e1fe server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:59.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff07dffb640 1 -- 172.21.15.152:0/4151566073 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700a89b0 con 0x7ff0801513c0 2023-12-13T22:24:59.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff07dffb640 1 -- 172.21.15.152:0/4151566073 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0700a8b10 con 0x7ff0801513c0 2023-12-13T22:24:59.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff07dffb640 1 -- 172.21.15.152:0/4151566073 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700a8ea0 con 0x7ff0801513c0 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 -- 172.21.15.152:0/4151566073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 msgr2=0x7ff0800cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 --2- 172.21.15.152:0/4151566073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff070009870 tx=0x7ff07001ecf0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 -- 172.21.15.152:0/4151566073 shutdown_connections 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 --2- 172.21.15.152:0/4151566073 >> v2:172.21.15.152:3300/0 conn(0x7ff08006ad60 0x7ff0801571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 --2- 172.21.15.152:0/4151566073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff0800cb8f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 -- 172.21.15.152:0/4151566073 >> 172.21.15.152:0/4151566073 conn(0x7ff08006b670 msgr2=0x7ff08006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 -- 172.21.15.152:0/4151566073 shutdown_connections 2023-12-13T22:24:59.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.843+0000 7ff085a58640 1 -- 172.21.15.152:0/4151566073 wait complete. 2023-12-13T22:24:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 Processor -- start 2023-12-13T22:24:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 -- start start 2023-12-13T22:24:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff08006ad60 0x7ff080156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff080072890 0x7ff080155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:24:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801556d0 con 0x7ff080072890 2023-12-13T22:24:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801ed5b0 con 0x7ff08006ad60 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff085a58640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0801edaf0 con 0x7ff0801513c0 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff07f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff07effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff08006ad60 0x7ff080156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff07f7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:42518/0 (socket says 172.21.15.152:42518) 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff07f7fe640 1 -- 172.21.15.152:0/4013762916 learned_addr learned my addr 172.21.15.152:0/4013762916 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:24:59.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.847+0000 7ff07e7fc640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff080072890 0x7ff080155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:24:59.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.851+0000 7ff07f7fe640 1 -- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff08006ad60 msgr2=0x7ff080156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.851+0000 7ff07f7fe640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff08006ad60 0x7ff080156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.851+0000 7ff07f7fe640 1 -- 172.21.15.152:0/4013762916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff080072890 msgr2=0x7ff080155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:24:59.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.851+0000 7ff07f7fe640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff080072890 0x7ff080155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:24:59.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.851+0000 7ff07f7fe640 1 -- 172.21.15.152:0/4013762916 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700094d0 con 0x7ff0801513c0 2023-12-13T22:24:59.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.855+0000 7ff07f7fe640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c780 tx=0x7ff07800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:24:59.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078003d90 con 0x7ff0801513c0 2023-12-13T22:24:59.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff080152040 con 0x7ff0801513c0 2023-12-13T22:24:59.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0801ed810 con 0x7ff0801513c0 2023-12-13T22:24:59.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080155840 con 0x7ff0801513c0 2023-12-13T22:24:59.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800ce90 con 0x7ff0801513c0 2023-12-13T22:24:59.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:24:59.859+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078006d60 con 0x7ff0801513c0 2023-12-13T22:24:59.886 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.885+0000 7f2ffa4bc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-13T22:24:59.945 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:24:59.945+0000 7f2ffa4bc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-13T22:24:59.976 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:24:59.975+0000 7f72ece29180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-13T22:25:00.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:00.051+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff078005450 con 0x7ff0801513c0 2023-12-13T22:25:00.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:00.051+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff0780074e0 con 0x7ff0801513c0 2023-12-13T22:25:00.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:00.051+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7ff080155840 con 0x7ff0801513c0 2023-12-13T22:25:00.059 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-12-13T22:25:00.059+0000 7f72ece29180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-13T22:25:00.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:00.127+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c", "id": 4} v 0) v1 -- 0x7ff080073e70 con 0x7ff0801513c0 2023-12-13T22:25:00.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:00.727+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mgrmap(e 2) v1 ==== 43033+0+0 (secure 0 0 0) 0x7ff078007710 con 0x7ff0801513c0 2023-12-13T22:25:01.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff067fff640 1 -- 172.21.15.152:0/4013762916 <== mon.2 v2:172.21.15.152:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff078007280 con 0x7ff0801513c0 2023-12-13T22:25:01.168 INFO:teuthology.orchestra.run.smithi152.stdout:4 2023-12-13T22:25:01.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 msgr2=0x7ff080156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:01.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c780 tx=0x7ff07800cc40 comp rx=0 tx=0).stop 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 shutdown_connections 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0801513c0 0x7ff080156060 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff080072890 0x7ff080155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 --2- 172.21.15.152:0/4013762916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff08006ad60 0x7ff080156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 >> 172.21.15.152:0/4013762916 conn(0x7ff08006b670 msgr2=0x7ff0800c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 shutdown_connections 2023-12-13T22:25:01.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.167+0000 7ff085a58640 1 -- 172.21.15.152:0/4013762916 wait complete. 2023-12-13T22:25:01.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 1b97d340-0bc2-4553-8e25-565240473dfd 5 2023-12-13T22:25:01.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 Processor -- start 2023-12-13T22:25:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 -- start start 2023-12-13T22:25:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4c5c0ce0c0 0x7f4c5c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4c5c0cc3c0 0x7f4c5c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:01.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5c0cd9a0 con 0x7f4c5c0cdb70 2023-12-13T22:25:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c0ca550 con 0x7f4c5c0ce0c0 2023-12-13T22:25:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.315+0000 7f4c647c0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5c0ce9e0 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.319+0000 7f4c61d5b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4c5c0cc3c0 0x7f4c5c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.319+0000 7f4c62d5d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4c5c0cdb70 0x7f4c5c15cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60652/0 (socket says 172.21.15.152:60652) 2023-12-13T22:25:01.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.319+0000 7f4c62d5d640 1 -- 172.21.15.152:0/1465302189 learned_addr learned my addr 172.21.15.152:0/1465302189 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-12-13T22:25:01.321 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.319+0000 7f4c6255c640 1 --2- 172.21.15.152:0/1465302189 >> v2:172.21.15.91:3300/0 conn(0x7f4c5c0ce0c0 0x7f4c5c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.323+0000 7f4c61d5b640 1 -- 172.21.15.152:0/1465302189 >> v2:172.21.15.91:3300/0 conn(0x7f4c5c0ce0c0 msgr2=0x7f4c5c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.323+0000 7f4c61d5b640 1 --2- 172.21.15.152:0/1465302189 >> v2:172.21.15.91:3300/0 conn(0x7f4c5c0ce0c0 0x7f4c5c0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.323+0000 7f4c61d5b640 1 -- 172.21.15.152:0/1465302189 >> v1:172.21.15.152:6789/0 conn(0x7f4c5c0cdb70 legacy=0x7f4c5c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:01.322 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.323+0000 7f4c61d5b640 1 -- 172.21.15.152:0/1465302189 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c1596c0 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.327 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.327+0000 7f4c61d5b640 1 --2- 172.21.15.152:0/1465302189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c159b70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c15dbc0 tx=0x7f4c4c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d9541ac4df3dab server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:01.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c6155a640 1 -- 172.21.15.152:0/1465302189 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0ab660 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c6155a640 1 -- 172.21.15.152:0/1465302189 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0ab7c0 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c6155a640 1 -- 172.21.15.152:0/1465302189 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0abb50 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 -- 172.21.15.152:0/1465302189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 msgr2=0x7f4c5c159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 --2- 172.21.15.152:0/1465302189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c159b70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c15dbc0 tx=0x7f4c4c01c460 comp rx=0 tx=0).stop 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 -- 172.21.15.152:0/1465302189 shutdown_connections 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 --2- 172.21.15.152:0/1465302189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c159b70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 --2- 172.21.15.152:0/1465302189 >> v2:172.21.15.91:3300/0 conn(0x7f4c5c0ce0c0 0x7f4c5c0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 -- 172.21.15.152:0/1465302189 >> 172.21.15.152:0/1465302189 conn(0x7f4c5c0b07c0 msgr2=0x7f4c5c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 -- 172.21.15.152:0/1465302189 shutdown_connections 2023-12-13T22:25:01.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.331+0000 7f4c647c0640 1 -- 172.21.15.152:0/1465302189 wait complete. 2023-12-13T22:25:01.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 Processor -- start 2023-12-13T22:25:01.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 -- start start 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c5c0cdb70 0x7f4c5c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c5c0ce0c0 0x7f4c5c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c155460 con 0x7f4c5c0cdb70 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c155690 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.336 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c647c0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c155950 con 0x7f4c5c0ce0c0 2023-12-13T22:25:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c6255c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c62d5d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c5c0ce0c0 0x7f4c5c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c6255c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37790/0 (socket says 172.21.15.152:37790) 2023-12-13T22:25:01.337 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.335+0000 7f4c6255c640 1 -- 172.21.15.152:0/260321904 learned_addr learned my addr 172.21.15.152:0/260321904 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:25:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.339+0000 7f4c6255c640 1 -- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c5c0ce0c0 msgr2=0x7f4c5c147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.339+0000 7f4c6255c640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c5c0ce0c0 0x7f4c5c147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.339+0000 7f4c6255c640 1 -- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c5c0cdb70 msgr2=0x7f4c5c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.339+0000 7f4c6255c640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c5c0cdb70 0x7f4c5c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:01.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.339+0000 7f4c6255c640 1 -- 172.21.15.152:0/260321904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c009420 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.343+0000 7f4c6255c640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c7f0 tx=0x7f4c5800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:01.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58007820 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c58007980 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58007d30 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c0c8c50 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5c0c9210 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.347+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5c067520 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.355+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 2) v1 ==== 43033+0+0 (secure 0 0 0) 0x7f4c58024480 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.475+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4c58024730 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.475+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f4c58010350 con 0x7f4c5c0cc3c0 2023-12-13T22:25:01.553 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:01.551+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b97d340-0bc2-4553-8e25-565240473dfd", "id": 5} v 0) v1 -- 0x7f4c5c0b1570 con 0x7f4c5c0cc3c0 2023-12-13T22:25:02.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.295+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 3) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f4c58022350 con 0x7f4c5c0cc3c0 2023-12-13T22:25:02.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.295+0000 7f4c52ffd640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 0x7f4c40068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:02.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.295+0000 7f4c61d5b640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 0x7f4c40068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:02.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.299+0000 7f4c61d5b640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 0x7f4c40068d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0af000 tx=0x7f4c4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:02.411 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:25:02.413+0000 7f2fa1c49640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-13T22:25:02.417 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:25:02.417+0000 7f2fa1c49640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-13T22:25:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c52ffd640 1 -- 172.21.15.152:0/260321904 <== mon.1 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b97d340-0bc2-4553-8e25-565240473dfd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c58053b50 con 0x7f4c5c0cc3c0 2023-12-13T22:25:02.864 INFO:teuthology.orchestra.run.smithi152.stdout:5 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 msgr2=0x7f4c40068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 0x7f4c40068d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0af000 tx=0x7f4c4c008040 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 msgr2=0x7f4c5c0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c7f0 tx=0x7f4c5800ccb0 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 shutdown_connections 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4c40066990 0x7f4c40068d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c5c0ce0c0 0x7f4c5c147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4c5c0cdb70 0x7f4c5c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 --2- 172.21.15.152:0/260321904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c5c0cc3c0 0x7f4c5c0b2c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 >> 172.21.15.152:0/260321904 conn(0x7f4c5c0b07c0 msgr2=0x7f4c5c0735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:02.866 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 shutdown_connections 2023-12-13T22:25:02.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:02.863+0000 7f4c647c0640 1 -- 172.21.15.152:0/260321904 wait complete. 2023-12-13T22:25:02.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 207e09a7-b5d9-4ac8-a427-691dc7cb5b7d 6 2023-12-13T22:25:03.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 Processor -- start 2023-12-13T22:25:03.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 -- start start 2023-12-13T22:25:03.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ffae0151340 0x7ffae006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:03.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae006f4a0 con 0x7ffae0151720 2023-12-13T22:25:03.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae0070be0 con 0x7ffae00c40e0 2023-12-13T22:25:03.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae8779640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae0072570 con 0x7ffae0151340 2023-12-13T22:25:03.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae6d16640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ffae00c40e0 0x7ffae00c70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60656/0 (socket says 172.21.15.152:60656) 2023-12-13T22:25:03.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.011+0000 7ffae6d16640 1 -- 172.21.15.152:0/3870358901 learned_addr learned my addr 172.21.15.152:0/3870358901 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-12-13T22:25:03.202 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.199+0000 7ffae6515640 1 --2- 172.21.15.152:0/3870358901 >> v2:172.21.15.91:3300/0 conn(0x7ffae0151340 0x7ffae006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:03.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.259+0000 7ffae6515640 1 -- 172.21.15.152:0/3870358901 >> v1:172.21.15.152:6789/0 conn(0x7ffae00c40e0 legacy=0x7ffae00c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:03.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.259+0000 7ffae6515640 1 -- 172.21.15.152:0/3870358901 >> v1:172.21.15.91:6789/0 conn(0x7ffae0151720 legacy=0x7ffae0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:03.259 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.259+0000 7ffae6515640 1 -- 172.21.15.152:0/3870358901 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0070e80 con 0x7ffae0151340 2023-12-13T22:25:03.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.275+0000 7ffae6515640 1 --2- 172.21.15.152:0/3870358901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae006ee10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0097c0 tx=0x7ffadc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61693164fcb0e41 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:03.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.283+0000 7ffae5513640 1 -- 172.21.15.152:0/3870358901 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0ab650 con 0x7ffae0151340 2023-12-13T22:25:03.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.283+0000 7ffae5513640 1 -- 172.21.15.152:0/3870358901 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc0ab7b0 con 0x7ffae0151340 2023-12-13T22:25:03.284 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.283+0000 7ffae5513640 1 -- 172.21.15.152:0/3870358901 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0abb40 con 0x7ffae0151340 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 -- 172.21.15.152:0/3870358901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 msgr2=0x7ffae006ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 --2- 172.21.15.152:0/3870358901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae006ee10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0097c0 tx=0x7ffadc01c450 comp rx=0 tx=0).stop 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 -- 172.21.15.152:0/3870358901 shutdown_connections 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 --2- 172.21.15.152:0/3870358901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae006ee10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 -- 172.21.15.152:0/3870358901 >> 172.21.15.152:0/3870358901 conn(0x7ffae006c6a0 msgr2=0x7ffae006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 -- 172.21.15.152:0/3870358901 shutdown_connections 2023-12-13T22:25:03.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.287+0000 7ffae8779640 1 -- 172.21.15.152:0/3870358901 wait complete. 2023-12-13T22:25:03.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 Processor -- start 2023-12-13T22:25:03.291 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 -- start start 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffae00c40e0 0x7ffae013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae0151720 0x7ffae00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae01f4050 con 0x7ffae0151340 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae01efc40 con 0x7ffae0151720 2023-12-13T22:25:03.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.291+0000 7ffae8779640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae01f3d70 con 0x7ffae00c40e0 2023-12-13T22:25:03.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.295+0000 7ffae5d14640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:03.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.295+0000 7ffae5d14640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.152:36284/0 (socket says 172.21.15.152:36284) 2023-12-13T22:25:03.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.295+0000 7ffae5d14640 1 -- 172.21.15.152:0/1765328635 learned_addr learned my addr 172.21.15.152:0/1765328635 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:25:03.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.303+0000 7ffae5d14640 1 -- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffae00c40e0 msgr2=0x7ffae013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:03.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.303+0000 7ffae5d14640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffae00c40e0 0x7ffae013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:03.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.303+0000 7ffae5d14640 1 -- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae0151720 msgr2=0x7ffae00c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:03.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.303+0000 7ffae5d14640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae0151720 0x7ffae00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:03.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.303+0000 7ffae5d14640 1 -- 172.21.15.152:0/1765328635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009420 con 0x7ffae0151340 2023-12-13T22:25:03.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.311+0000 7ffae5d14640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c3c0 tx=0x7ffad000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad00052d0 con 0x7ffae0151340 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0005430 con 0x7ffae0151340 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0003840 con 0x7ffae0151340 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae01567f0 con 0x7ffae0151340 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae0156ad0 con 0x7ffae0151340 2023-12-13T22:25:03.328 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.327+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae0156650 con 0x7ffae0151340 2023-12-13T22:25:03.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.671+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 3) v1 ==== 85829+0+0 (secure 0 0 0) 0x7ffad00039a0 con 0x7ffae0151340 2023-12-13T22:25:03.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.671+0000 7ffad6ffd640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 0x7ffac4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:03.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.671+0000 7ffae6515640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 0x7ffac4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:03.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.675+0000 7ffae6515640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 0x7ffac4068b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0af000 tx=0x7ffadc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:03.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.703+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ffad0054ec0 con 0x7ffae0151340 2023-12-13T22:25:03.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.703+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ffad0050b00 con 0x7ffae0151340 2023-12-13T22:25:03.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:03.895+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd new", "uuid": "207e09a7-b5d9-4ac8-a427-691dc7cb5b7d", "id": 6} v 0) v1 -- 0x7ffae0156650 con 0x7ffae0151340 2023-12-13T22:25:04.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.027+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7ffad0050ed0 con 0x7ffae0151340 2023-12-13T22:25:04.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffad6ffd640 1 -- 172.21.15.152:0/1765328635 <== mon.0 v2:172.21.15.91:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "207e09a7-b5d9-4ac8-a427-691dc7cb5b7d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffad0076270 con 0x7ffae0151340 2023-12-13T22:25:04.639 INFO:teuthology.orchestra.run.smithi152.stdout:6 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 msgr2=0x7ffac4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 0x7ffac4068b50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0af000 tx=0x7ffadc008040 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 msgr2=0x7ffae00c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c3c0 tx=0x7ffad000c880 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 shutdown_connections 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ffac4066690 0x7ffac4068b50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffae0151720 0x7ffae00c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ffae0151340 0x7ffae00c7030 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 --2- 172.21.15.152:0/1765328635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffae00c40e0 0x7ffae013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 >> 172.21.15.152:0/1765328635 conn(0x7ffae006c6a0 msgr2=0x7ffae006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:04.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 shutdown_connections 2023-12-13T22:25:04.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.639+0000 7ffae8779640 1 -- 172.21.15.152:0/1765328635 wait complete. 2023-12-13T22:25:04.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new e26377f0-5278-484e-bb33-75f036813b3a 7 2023-12-13T22:25:04.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 Processor -- start 2023-12-13T22:25:04.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 -- start start 2023-12-13T22:25:04.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8d800c3a30 0x7f8d80159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:04.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d80153b70 con 0x7f8d800c5ab0 2023-12-13T22:25:04.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d80153840 con 0x7f8d80153460 2023-12-13T22:25:04.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.791+0000 7f8d86e98640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8015d730 con 0x7f8d800c3a30 2023-12-13T22:25:04.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d85435640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8d800c3a30 0x7f8d80159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:04.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d84c34640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8d80153460 0x7f8d800c7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60664/0 (socket says 172.21.15.152:60664) 2023-12-13T22:25:04.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d84c34640 1 -- 172.21.15.152:0/3507124842 learned_addr learned my addr 172.21.15.152:0/3507124842 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-12-13T22:25:04.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d85435640 1 -- 172.21.15.152:0/3507124842 >> v1:172.21.15.152:6789/0 conn(0x7f8d80153460 legacy=0x7f8d800c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d85435640 1 -- 172.21.15.152:0/3507124842 >> v1:172.21.15.91:6789/0 conn(0x7f8d800c5ab0 legacy=0x7f8d800c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:04.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.795+0000 7f8d85435640 1 -- 172.21.15.152:0/3507124842 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800c5ff0 con 0x7f8d800c3a30 2023-12-13T22:25:04.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.803+0000 7f8d85435640 1 --2- 172.21.15.152:0/3507124842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c3a30 0x7f8d80159ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009d90 tx=0x7f8d7801f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ed4ac197db6a49 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:04.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d777fe640 1 -- 172.21.15.152:0/3507124842 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780af600 con 0x7f8d800c3a30 2023-12-13T22:25:04.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d777fe640 1 -- 172.21.15.152:0/3507124842 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780ab050 con 0x7f8d800c3a30 2023-12-13T22:25:04.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d777fe640 1 -- 172.21.15.152:0/3507124842 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780af980 con 0x7f8d800c3a30 2023-12-13T22:25:04.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- 172.21.15.152:0/3507124842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c3a30 msgr2=0x7f8d80159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 --2- 172.21.15.152:0/3507124842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c3a30 0x7f8d80159ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009d90 tx=0x7f8d7801f100 comp rx=0 tx=0).stop 2023-12-13T22:25:04.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- 172.21.15.152:0/3507124842 shutdown_connections 2023-12-13T22:25:04.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 --2- 172.21.15.152:0/3507124842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c3a30 0x7f8d80159ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- 172.21.15.152:0/3507124842 >> 172.21.15.152:0/3507124842 conn(0x7f8d8006c6a0 msgr2=0x7f8d8006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:04.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- 172.21.15.152:0/3507124842 shutdown_connections 2023-12-13T22:25:04.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- 172.21.15.152:0/3507124842 wait complete. 2023-12-13T22:25:04.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 Processor -- start 2023-12-13T22:25:04.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.807+0000 7f8d86e98640 1 -- start start 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d800c3a30 0x7f8d800c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d80153460 0x7f8d80071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800719b0 con 0x7f8d80153460 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800c9a60 con 0x7f8d800c5ab0 2023-12-13T22:25:04.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d86e98640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800c9cf0 con 0x7f8d800c3a30 2023-12-13T22:25:04.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d77fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:04.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d84c34640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d800c3a30 0x7f8d800c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:04.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d77fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37806/0 (socket says 172.21.15.152:37806) 2023-12-13T22:25:04.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.811+0000 7f8d77fff640 1 -- 172.21.15.152:0/322876602 learned_addr learned my addr 172.21.15.152:0/322876602 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-13T22:25:04.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.815+0000 7f8d77fff640 1 -- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d800c3a30 msgr2=0x7f8d800c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.815+0000 7f8d77fff640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d800c3a30 0x7f8d800c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.815+0000 7f8d77fff640 1 -- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d80153460 msgr2=0x7f8d80071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:04.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.815+0000 7f8d77fff640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d80153460 0x7f8d80071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:04.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.815+0000 7f8d77fff640 1 -- 172.21.15.152:0/322876602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78009a70 con 0x7f8d800c5ab0 2023-12-13T22:25:04.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.819+0000 7f8d77fff640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c410 tx=0x7f8d7000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:04.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70003600 con 0x7f8d800c5ab0 2023-12-13T22:25:04.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70003760 con 0x7f8d800c5ab0 2023-12-13T22:25:04.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70003af0 con 0x7f8d800c5ab0 2023-12-13T22:25:04.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80148130 con 0x7f8d800c5ab0 2023-12-13T22:25:04.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d800c9f00 con 0x7f8d800c5ab0 2023-12-13T22:25:04.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:04.823+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80067520 con 0x7f8d800c5ab0 2023-12-13T22:25:05.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.107+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f8d70003c50 con 0x7f8d800c5ab0 2023-12-13T22:25:05.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.107+0000 7f8d757fa640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 0x7f8d6c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.107+0000 7f8d84c34640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 0x7f8d6c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.107+0000 7f8d84c34640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 0x7f8d6c068c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d800cb920 tx=0x7f8d7c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:05.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.139+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8d700010d0 con 0x7f8d800c5ab0 2023-12-13T22:25:05.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.139+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8d700511b0 con 0x7f8d800c5ab0 2023-12-13T22:25:05.319 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.319+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e26377f0-5278-484e-bb33-75f036813b3a", "id": 7} v 0) v1 -- 0x7f8d800c6d80 con 0x7f8d800c5ab0 2023-12-13T22:25:05.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d757fa640 1 -- 172.21.15.152:0/322876602 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e26377f0-5278-484e-bb33-75f036813b3a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8d70021020 con 0x7f8d800c5ab0 2023-12-13T22:25:05.711 INFO:teuthology.orchestra.run.smithi152.stdout:7 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 msgr2=0x7f8d6c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 0x7f8d6c068c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d800cb920 tx=0x7f8d7c007e90 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 msgr2=0x7f8d800c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c410 tx=0x7f8d7000c8d0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 shutdown_connections 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d6c0667b0 0x7f8d6c068c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d80153460 0x7f8d80071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d800c5ab0 0x7f8d800c4120 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 --2- 172.21.15.152:0/322876602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d800c3a30 0x7f8d800c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 >> 172.21.15.152:0/322876602 conn(0x7f8d8006c6a0 msgr2=0x7f8d80152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:05.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 shutdown_connections 2023-12-13T22:25:05.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-13T22:25:05.711+0000 7f8d86e98640 1 -- 172.21.15.152:0/322876602 wait complete. 2023-12-13T22:25:05.736 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-13T22:25:05.736 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-13T22:25:05.739 INFO:tasks.ceph.osd.0:Started 2023-12-13T22:25:05.739 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-13T22:25:05.739 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-13T22:25:05.741 INFO:tasks.ceph.osd.1:Started 2023-12-13T22:25:05.741 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-13T22:25:05.742 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-13T22:25:05.744 INFO:tasks.ceph.osd.2:Started 2023-12-13T22:25:05.744 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-13T22:25:05.744 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-13T22:25:05.747 INFO:tasks.ceph.osd.3:Started 2023-12-13T22:25:05.747 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-13T22:25:05.747 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-13T22:25:05.749 INFO:tasks.ceph.osd.4:Started 2023-12-13T22:25:05.749 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-13T22:25:05.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-13T22:25:05.751 INFO:tasks.ceph.osd.5:Started 2023-12-13T22:25:05.752 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-13T22:25:05.752 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-13T22:25:05.754 INFO:tasks.ceph.osd.6:Started 2023-12-13T22:25:05.754 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-13T22:25:05.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-13T22:25:05.756 INFO:tasks.ceph.osd.7:Started 2023-12-13T22:25:05.756 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:05.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 Processor -- start 2023-12-13T22:25:05.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 -- start start 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7c600ce0c0 0x7f7c600ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600cd9a0 con 0x7f7c600cc3c0 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c600ca550 con 0x7f7c600ce0c0 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.909+0000 7f7c6662d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600ce9e0 con 0x7f7c6015a280 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:05.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45310/0 (socket says 172.21.15.91:45310) 2023-12-13T22:25:05.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 -- 172.21.15.91:0/240354818 learned_addr learned my addr 172.21.15.91:0/240354818 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:05.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 -- 172.21.15.91:0/240354818 >> v2:172.21.15.91:3300/0 conn(0x7f7c600ce0c0 msgr2=0x7f7c600ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:05.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 --2- 172.21.15.91:0/240354818 >> v2:172.21.15.91:3300/0 conn(0x7f7c600ce0c0 0x7f7c600ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 -- 172.21.15.91:0/240354818 >> v1:172.21.15.91:6789/0 conn(0x7f7c600cc3c0 legacy=0x7f7c60159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:05.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.913+0000 7f7c64bca640 1 -- 172.21.15.91:0/240354818 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c601596c0 con 0x7f7c6015a280 2023-12-13T22:25:05.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.917+0000 7f7c64bca640 1 --2- 172.21.15.91:0/240354818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009870 tx=0x7f7c5001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f7fe9044f376d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:05.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c5effd640 1 -- 172.21.15.91:0/240354818 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500aa620 con 0x7f7c6015a280 2023-12-13T22:25:05.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c5effd640 1 -- 172.21.15.91:0/240354818 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c500aa780 con 0x7f7c6015a280 2023-12-13T22:25:05.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c5effd640 1 -- 172.21.15.91:0/240354818 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500aab10 con 0x7f7c6015a280 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 -- 172.21.15.91:0/240354818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 msgr2=0x7f7c60163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 --2- 172.21.15.91:0/240354818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009870 tx=0x7f7c5001c500 comp rx=0 tx=0).stop 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 -- 172.21.15.91:0/240354818 shutdown_connections 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 --2- 172.21.15.91:0/240354818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c6015a280 0x7f7c60163e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 --2- 172.21.15.91:0/240354818 >> v2:172.21.15.91:3300/0 conn(0x7f7c600ce0c0 0x7f7c600ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 -- 172.21.15.91:0/240354818 >> 172.21.15.91:0/240354818 conn(0x7f7c600b07c0 msgr2=0x7f7c600b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:05.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 -- 172.21.15.91:0/240354818 shutdown_connections 2023-12-13T22:25:05.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.921+0000 7f7c6662d640 1 -- 172.21.15.91:0/240354818 wait complete. 2023-12-13T22:25:05.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 Processor -- start 2023-12-13T22:25:05.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 -- start start 2023-12-13T22:25:05.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ce0c0 0x7f7c601f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6015a280 0x7f7c601f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6014fe00 con 0x7f7c6015a280 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60156d10 con 0x7f7c600ce0c0 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c6662d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601503a0 con 0x7f7c600cc3c0 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:05.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45312/0 (socket says 172.21.15.91:45312) 2023-12-13T22:25:05.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c5ffff640 1 -- 172.21.15.91:0/1971372734 learned_addr learned my addr 172.21.15.91:0/1971372734 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:05.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.925+0000 7f7c64bca640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6015a280 0x7f7c601f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:05.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.929+0000 7f7c5ffff640 1 -- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ce0c0 msgr2=0x7f7c601f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:05.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.929+0000 7f7c5ffff640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ce0c0 0x7f7c601f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.929+0000 7f7c5ffff640 1 -- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6015a280 msgr2=0x7f7c601f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:05.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.929+0000 7f7c5ffff640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6015a280 0x7f7c601f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:05.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.929+0000 7f7c5ffff640 1 -- 172.21.15.91:0/1971372734 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500094d0 con 0x7f7c600cc3c0 2023-12-13T22:25:05.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.933+0000 7f7c5ffff640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800ba50 tx=0x7f7c5800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.937+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800cbe0 con 0x7f7c600cc3c0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.937+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5800cd60 con 0x7f7c600cc3c0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.937+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58014680 con 0x7f7c600cc3c0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.937+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60150830 con 0x7f7c600cc3c0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.937+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6015d610 con 0x7f7c600cc3c0 2023-12-13T22:25:05.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.941+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60067520 con 0x7f7c600cc3c0 2023-12-13T22:25:05.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.957+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f7c5801d3b0 con 0x7f7c600cc3c0 2023-12-13T22:25:05.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.957+0000 7f7c5cff9640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 0x7f7c40068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:05.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.957+0000 7f7c5f7fe640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 0x7f7c40068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:05.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.961+0000 7f7c5f7fe640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 0x7f7c40068c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007fd0 tx=0x7f7c480079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:05.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:05.961+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7c58055b10 con 0x7f7c600cc3c0 2023-12-13T22:25:06.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.209+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7c58051750 con 0x7f7c600cc3c0 2023-12-13T22:25:06.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.361+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c600b1570 con 0x7f7c600cc3c0 2023-12-13T22:25:06.412 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:25:06.411+0000 7f59222a0640 -1 Falling back to public interface 2023-12-13T22:25:06.424 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:25:06.425+0000 7fedd1d91640 -1 Falling back to public interface 2023-12-13T22:25:06.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.453+0000 7f7c5cff9640 1 -- 172.21.15.91:0/1971372734 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7c58019070 con 0x7f7c600cc3c0 2023-12-13T22:25:06.454 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:06.454 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":10,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:05.351199+0000","last_up_change":"0.000000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:06.455 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:25:06.457+0000 7fe76d728640 -1 Falling back to public interface 2023-12-13T22:25:06.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 msgr2=0x7f7c40068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:06.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 0x7f7c40068c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007fd0 tx=0x7f7c480079a0 comp rx=0 tx=0).stop 2023-12-13T22:25:06.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 msgr2=0x7f7c60157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:06.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800ba50 tx=0x7f7c5800bf10 comp rx=0 tx=0).stop 2023-12-13T22:25:06.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 shutdown_connections 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7c400667b0 0x7f7c40068c70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7c6015a280 0x7f7c601f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c600ce0c0 0x7f7c601f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 --2- 172.21.15.91:0/1971372734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c600cc3c0 0x7f7c60157e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 >> 172.21.15.91:0/1971372734 conn(0x7f7c600b07c0 msgr2=0x7f7c600ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 shutdown_connections 2023-12-13T22:25:06.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:06.457+0000 7f7c6662d640 1 -- 172.21.15.91:0/1971372734 wait complete. 2023-12-13T22:25:06.468 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:25:06.467+0000 7fc5a17e5640 -1 Falling back to public interface 2023-12-13T22:25:06.473 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-13T22:25:06.473 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-13T22:25:06.487 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:25:06.487+0000 7fede5900640 -1 Falling back to public interface 2023-12-13T22:25:06.491 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:25:06.493+0000 7f3a5dc39640 -1 Falling back to public interface 2023-12-13T22:25:06.496 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:25:06.495+0000 7f0bc48f9640 -1 Falling back to public interface 2023-12-13T22:25:06.496 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:25:06.497+0000 7fba3afc9640 -1 Falling back to public interface 2023-12-13T22:25:07.277 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:07.394 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.393+0000 7f39af435640 1 Processor -- start 2023-12-13T22:25:07.395 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 -- start start 2023-12-13T22:25:07.395 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a81538d0 0x7f39a80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.395 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39a80cdad0 0x7f39a806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.395 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80c9730 con 0x7f39a80cd580 2023-12-13T22:25:07.395 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80c9a10 con 0x7f39a80cdad0 2023-12-13T22:25:07.396 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39af435640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c9cf0 con 0x7f39a81538d0 2023-12-13T22:25:07.396 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39ad9d2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39a80cdad0 0x7f39a806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:07.396 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39ad9d2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f39a80cdad0 0x7f39a806bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35268/0 (socket says 172.21.15.91:35268) 2023-12-13T22:25:07.396 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.397+0000 7f39ad9d2640 1 -- 172.21.15.91:0/1734893911 learned_addr learned my addr 172.21.15.91:0/1734893911 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:07.399 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.401+0000 7f39ad9d2640 1 -- 172.21.15.91:0/1734893911 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a81538d0 msgr2=0x7f39a80cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:07.399 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.401+0000 7f39ad9d2640 1 --2- 172.21.15.91:0/1734893911 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a81538d0 0x7f39a80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.399 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.401+0000 7f39ad9d2640 1 -- 172.21.15.91:0/1734893911 >> v1:172.21.15.152:6789/0 conn(0x7f39a80cd580 legacy=0x7f39a80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:07.399 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.401+0000 7f39ad9d2640 1 -- 172.21.15.91:0/1734893911 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a8159960 con 0x7f39a80cdad0 2023-12-13T22:25:07.403 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.405+0000 7f39ad9d2640 1 --2- 172.21.15.91:0/1734893911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a806bbf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009e50 tx=0x7f39a001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb5e241d55dfad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:07.407 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f399ffff640 1 -- 172.21.15.91:0/1734893911 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00a5730 con 0x7f39a80cdad0 2023-12-13T22:25:07.407 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f399ffff640 1 -- 172.21.15.91:0/1734893911 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00a5890 con 0x7f39a80cdad0 2023-12-13T22:25:07.407 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f399ffff640 1 -- 172.21.15.91:0/1734893911 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00a5c20 con 0x7f39a80cdad0 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- 172.21.15.91:0/1734893911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 msgr2=0x7f39a806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 --2- 172.21.15.91:0/1734893911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a806bbf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009e50 tx=0x7f39a001c9a0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- 172.21.15.91:0/1734893911 shutdown_connections 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 --2- 172.21.15.91:0/1734893911 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a806bbf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 --2- 172.21.15.91:0/1734893911 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a81538d0 0x7f39a80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.408 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- 172.21.15.91:0/1734893911 >> 172.21.15.91:0/1734893911 conn(0x7f39a80b0820 msgr2=0x7f39a80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:07.409 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- 172.21.15.91:0/1734893911 shutdown_connections 2023-12-13T22:25:07.409 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- 172.21.15.91:0/1734893911 wait complete. 2023-12-13T22:25:07.409 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 Processor -- start 2023-12-13T22:25:07.409 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.409+0000 7f39af435640 1 -- start start 2023-12-13T22:25:07.410 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a80cd580 0x7f39a814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.410 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.410 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39a81538d0 0x7f39a8148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.410 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8147db0 con 0x7f39a80cdad0 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c7a00 con 0x7f39a81538d0 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39af435640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80c7ce0 con 0x7f39a80cd580 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39ac9d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39ac9d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:35270/0 (socket says 172.21.15.91:35270) 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39ac9d0640 1 -- 172.21.15.91:0/609236294 learned_addr learned my addr 172.21.15.91:0/609236294 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:07.411 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39ad9d2640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39a81538d0 0x7f39a8148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:07.412 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.413+0000 7f39ad1d1640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a80cd580 0x7f39a814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:07.414 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 -- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a80cd580 msgr2=0x7f39a814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:07.414 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a80cd580 0x7f39a814a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.414 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 -- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39a81538d0 msgr2=0x7f39a8148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:07.414 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39a81538d0 0x7f39a8148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.415 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 -- 172.21.15.91:0/609236294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0009b30 con 0x7f39a80cdad0 2023-12-13T22:25:07.416 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.417+0000 7f39ac9d0640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39a400b3e0 tx=0x7f39a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:07.420 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011830 con 0x7f39a80cdad0 2023-12-13T22:25:07.420 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40119b0 con 0x7f39a80cdad0 2023-12-13T22:25:07.420 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011d60 con 0x7f39a80cdad0 2023-12-13T22:25:07.420 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80c7fc0 con 0x7f39a80cdad0 2023-12-13T22:25:07.420 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80c8580 con 0x7f39a80cdad0 2023-12-13T22:25:07.421 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.421+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a8147f20 con 0x7f39a80cdad0 2023-12-13T22:25:07.442 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.441+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f39a401a400 con 0x7f39a80cdad0 2023-12-13T22:25:07.443 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.445+0000 7f399dffb640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 0x7f398c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:07.443 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.445+0000 7f39ad1d1640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 0x7f398c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:07.443 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.445+0000 7f39ad1d1640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 0x7f398c068c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3998009990 tx=0x7f3998009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:07.706 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.709+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f39a4055750 con 0x7f39a80cdad0 2023-12-13T22:25:07.707 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.709+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f39a4051a90 con 0x7f39a80cdad0 2023-12-13T22:25:07.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.857+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39a8067520 con 0x7f39a80cdad0 2023-12-13T22:25:07.902 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.901+0000 7f399dffb640 1 -- 172.21.15.91:0/609236294 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f39a4015070 con 0x7f39a80cdad0 2023-12-13T22:25:07.902 INFO:teuthology.misc.health.smithi091.stdout: 2023-12-13T22:25:07.902 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":10,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:05.351199+0000","last_up_change":"0.000000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 msgr2=0x7f398c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 0x7f398c068c70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3998009990 tx=0x7f3998009110 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 msgr2=0x7f39a8148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39a400b3e0 tx=0x7f39a400b8a0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 shutdown_connections 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f398c0667b0 0x7f398c068c70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39a81538d0 0x7f39a8148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f39a80cdad0 0x7f39a8148240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 --2- 172.21.15.91:0/609236294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39a80cd580 0x7f39a814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:07.905 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 >> 172.21.15.91:0/609236294 conn(0x7f39a80b0820 msgr2=0x7f39a80735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:07.906 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 shutdown_connections 2023-12-13T22:25:07.906 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:07.905+0000 7f39af435640 1 -- 172.21.15.91:0/609236294 wait complete. 2023-12-13T22:25:07.920 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-13T22:25:10.106 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:25:10.105+0000 7f3a5dc39640 -1 osd.0 0 log_to_monitors true 2023-12-13T22:25:10.170 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:25:10.166+0000 7fede5900640 -1 osd.7 0 log_to_monitors true 2023-12-13T22:25:10.221 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:25:10.221+0000 7fedd1d91640 -1 osd.3 0 log_to_monitors true 2023-12-13T22:25:10.240 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:25:10.238+0000 7f59222a0640 -1 osd.6 0 log_to_monitors true 2023-12-13T22:25:10.310 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:25:10.309+0000 7fe76d728640 -1 osd.1 0 log_to_monitors true 2023-12-13T22:25:10.363 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:25:10.362+0000 7fc5a17e5640 -1 osd.4 0 log_to_monitors true 2023-12-13T22:25:10.377 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:25:10.374+0000 7f0bc48f9640 -1 osd.5 0 log_to_monitors true 2023-12-13T22:25:10.397 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:25:10.397+0000 7fba3afc9640 -1 osd.2 0 log_to_monitors true 2023-12-13T22:25:12.419 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:25:12.421+0000 7f3a5a3f4640 -1 osd.0 0 waiting for initial osdmap 2023-12-13T22:25:12.804 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:25:12.805+0000 7f3a51a1d640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:14.449 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:25:14.449+0000 7fedcdd3a640 -1 osd.3 0 waiting for initial osdmap 2023-12-13T22:25:14.468 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:25:14.469+0000 7fba36f72640 -1 osd.2 0 waiting for initial osdmap 2023-12-13T22:25:14.468 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:25:14.469+0000 7fe7696d1640 -1 osd.1 0 waiting for initial osdmap 2023-12-13T22:25:14.660 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:25:14.661+0000 7fba2edad640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:14.667 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:25:14.669+0000 7fedc5b75640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:14.679 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:25:14.681+0000 7fe76150c640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:14.725 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:14.842 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.841+0000 7fe5c04e3640 1 Processor -- start 2023-12-13T22:25:14.842 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.841+0000 7fe5c04e3640 1 -- start start 2023-12-13T22:25:14.843 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5c04e3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe5b806eb60 0x7fe5b806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:14.843 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5c04e3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b81538c0 con 0x7fe5b8066730 2023-12-13T22:25:14.843 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5c04e3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b806a610 con 0x7fe5b81534e0 2023-12-13T22:25:14.843 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5c04e3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80c6830 con 0x7fe5b806eb60 2023-12-13T22:25:14.844 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5be27f640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe5b81534e0 0x7fe5b8159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:51762/0 (socket says 172.21.15.91:51762) 2023-12-13T22:25:14.844 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.845+0000 7fe5be27f640 1 -- 172.21.15.91:0/3718449430 learned_addr learned my addr 172.21.15.91:0/3718449430 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:14.847 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.849+0000 7fe5bea80640 1 --2- 172.21.15.91:0/3718449430 >> v2:172.21.15.152:3300/0 conn(0x7fe5b806eb60 0x7fe5b806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:14.850 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.853+0000 7fe5bea80640 1 -- 172.21.15.91:0/3718449430 >> v1:172.21.15.152:6789/0 conn(0x7fe5b81534e0 legacy=0x7fe5b8159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:14.850 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.853+0000 7fe5bea80640 1 -- 172.21.15.91:0/3718449430 >> v1:172.21.15.91:6789/0 conn(0x7fe5b8066730 legacy=0x7fe5b80c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:14.851 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.853+0000 7fe5bea80640 1 -- 172.21.15.91:0/3718449430 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b806a8f0 con 0x7fe5b806eb60 2023-12-13T22:25:14.857 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.857+0000 7fe5bea80640 1 --2- 172.21.15.91:0/3718449430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b806eb60 0x7fe5b806ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009d90 tx=0x7fe5b001f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce8806814ec6014 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:14.863 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5bd27d640 1 -- 172.21.15.91:0/3718449430 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00af600 con 0x7fe5b806eb60 2023-12-13T22:25:14.863 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5bd27d640 1 -- 172.21.15.91:0/3718449430 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00ab050 con 0x7fe5b806eb60 2023-12-13T22:25:14.863 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5bd27d640 1 -- 172.21.15.91:0/3718449430 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00af980 con 0x7fe5b806eb60 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- 172.21.15.91:0/3718449430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b806eb60 msgr2=0x7fe5b806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/3718449430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b806eb60 0x7fe5b806ef90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009d90 tx=0x7fe5b001f100 comp rx=0 tx=0).stop 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- 172.21.15.91:0/3718449430 shutdown_connections 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/3718449430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b806eb60 0x7fe5b806ef90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- 172.21.15.91:0/3718449430 >> 172.21.15.91:0/3718449430 conn(0x7fe5b80cb510 msgr2=0x7fe5b80cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- 172.21.15.91:0/3718449430 shutdown_connections 2023-12-13T22:25:14.864 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- 172.21.15.91:0/3718449430 wait complete. 2023-12-13T22:25:14.865 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 Processor -- start 2023-12-13T22:25:14.865 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- start start 2023-12-13T22:25:14.870 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 0x7fe5b8150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5b806eb60 0x7fe5b80c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 0x7fe5b81ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80c6970 con 0x7fe5b806eb60 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81ef150 con 0x7fe5b8066730 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.865+0000 7fe5c04e3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81f2bb0 con 0x7fe5b81534e0 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.869+0000 7fe5be27f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 0x7fe5b8150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:14.871 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.869+0000 7fe5bea80640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 0x7fe5b81ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:14.872 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.869+0000 7fe5be27f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 0x7fe5b8150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:53784/0 (socket says 172.21.15.91:53784) 2023-12-13T22:25:14.872 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.869+0000 7fe5be27f640 1 -- 172.21.15.91:0/2811977604 learned_addr learned my addr 172.21.15.91:0/2811977604 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:14.874 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.873+0000 7fe5bea80640 1 -- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 msgr2=0x7fe5b8150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:14.874 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.873+0000 7fe5bea80640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 0x7fe5b8150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:14.874 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.873+0000 7fe5bea80640 1 -- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5b806eb60 msgr2=0x7fe5b80c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:14.874 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.873+0000 7fe5bea80640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5b806eb60 0x7fe5b80c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:14.874 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.873+0000 7fe5bea80640 1 -- 172.21.15.91:0/2811977604 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009a70 con 0x7fe5b81534e0 2023-12-13T22:25:14.877 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.877+0000 7fe5bea80640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 0x7fe5b81ef930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00af000 tx=0x7fe5b001bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:14.883 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00c2070 con 0x7fe5b81534e0 2023-12-13T22:25:14.883 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00afe50 con 0x7fe5b81534e0 2023-12-13T22:25:14.883 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00ba680 con 0x7fe5b81534e0 2023-12-13T22:25:14.883 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b81f2e90 con 0x7fe5b81534e0 2023-12-13T22:25:14.884 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b81f3450 con 0x7fe5b81534e0 2023-12-13T22:25:14.884 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.885+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80cc470 con 0x7fe5b81534e0 2023-12-13T22:25:14.920 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.921+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7fe5b00b6040 con 0x7fe5b81534e0 2023-12-13T22:25:14.920 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.921+0000 7fe5aeffd640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 0x7fe59c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:14.921 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.921+0000 7fe5be27f640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 0x7fe59c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:14.921 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.921+0000 7fe5be27f640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 0x7fe59c068c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005890 tx=0x7fe5b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:14.922 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:25:14.918+0000 7f591e249640 -1 osd.6 0 waiting for initial osdmap 2023-12-13T22:25:14.925 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:14.925+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7fe5b00f46f0 con 0x7fe5b81534e0 2023-12-13T22:25:14.992 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:25:14.986+0000 7f0bc08a2640 -1 osd.5 0 waiting for initial osdmap 2023-12-13T22:25:15.035 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:25:15.034+0000 7fc59d78e640 -1 osd.4 0 waiting for initial osdmap 2023-12-13T22:25:15.073 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:25:15.066+0000 7fede18a9640 -1 osd.7 0 waiting for initial osdmap 2023-12-13T22:25:15.119 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:25:15.118+0000 7fedd96e4640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:15.131 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:25:15.130+0000 7fc5955c9640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:15.131 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:25:15.130+0000 7f0bb86dd640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:15.296 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.297+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe5b00f3dc0 con 0x7fe5b81534e0 2023-12-13T22:25:15.319 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:25:15.318+0000 7f5916084640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-13T22:25:15.460 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.461+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5b8073e70 con 0x7fe5b81534e0 2023-12-13T22:25:15.912 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.913+0000 7fe5aeffd640 1 -- 172.21.15.91:0/2811977604 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8052 (secure 0 0 0) 0x7fe5b00b4030 con 0x7fe5b81534e0 2023-12-13T22:25:15.912 INFO:teuthology.misc.health.smithi091.stdout: 2023-12-13T22:25:15.912 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":15,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:14.935136+0000","last_up_change":"2023-12-13T22:25:14.935136+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:15.915 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 msgr2=0x7fe59c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:15.915 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 0x7fe59c068c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005890 tx=0x7fe5b4009040 comp rx=0 tx=0).stop 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 msgr2=0x7fe5b81ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 0x7fe5b81ef930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00af000 tx=0x7fe5b001bea0 comp rx=0 tx=0).stop 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 shutdown_connections 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe59c066760 0x7fe59c068c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5b81534e0 0x7fe5b81ef930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:15.916 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe5b806eb60 0x7fe5b80c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:15.917 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 --2- 172.21.15.91:0/2811977604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5b8066730 0x7fe5b8150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:15.917 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 >> 172.21.15.91:0/2811977604 conn(0x7fe5b80cb510 msgr2=0x7fe5b814b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:15.917 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 shutdown_connections 2023-12-13T22:25:15.917 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:15.917+0000 7fe5c04e3640 1 -- 172.21.15.91:0/2811977604 wait complete. 2023-12-13T22:25:15.934 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-12-13T22:25:22.741 DEBUG:teuthology.orchestra.run.smithi091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:22.854 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.853+0000 7f0faed16640 1 Processor -- start 2023-12-13T22:25:22.854 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.853+0000 7f0faed16640 1 -- start start 2023-12-13T22:25:22.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0faed16640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0fa8151700 0x7f0fa80c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:22.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0faed16640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0fa80c2e10 0x7f0fa80c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:22.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0faed16640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa80b28d0 con 0x7f0fa80c7a40 2023-12-13T22:25:22.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0faed16640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa80cdaa0 con 0x7f0fa80c2e10 2023-12-13T22:25:22.855 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0faed16640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa8151ae0 con 0x7f0fa8151700 2023-12-13T22:25:22.856 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0fad2b3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f0fa80c2e10 0x7f0fa80c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:22.856 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0fa7fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f0fa80c7a40 0x7f0fa80c8810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48492/0 (socket says 172.21.15.91:48492) 2023-12-13T22:25:22.856 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0fa7fff640 1 -- 172.21.15.91:0/2955918568 learned_addr learned my addr 172.21.15.91:0/2955918568 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:22.856 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.857+0000 7f0facab2640 1 --2- 172.21.15.91:0/2955918568 >> v2:172.21.15.152:3300/0 conn(0x7f0fa8151700 0x7f0fa80c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:22.861 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.861+0000 7f0fad2b3640 1 -- 172.21.15.91:0/2955918568 >> v2:172.21.15.152:3300/0 conn(0x7f0fa8151700 msgr2=0x7f0fa80c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:22.861 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.861+0000 7f0fad2b3640 1 --2- 172.21.15.91:0/2955918568 >> v2:172.21.15.152:3300/0 conn(0x7f0fa8151700 0x7f0fa80c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:22.861 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.861+0000 7f0fad2b3640 1 -- 172.21.15.91:0/2955918568 >> v1:172.21.15.91:6789/0 conn(0x7f0fa80c7a40 legacy=0x7f0fa80c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:22.861 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.861+0000 7f0fad2b3640 1 -- 172.21.15.91:0/2955918568 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80c37c0 con 0x7f0fa80c2e10 2023-12-13T22:25:22.866 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:22.869+0000 7f0fad2b3640 1 --2- 172.21.15.91:0/2955918568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa80c2e10 0x7f0fa80c3280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8151c80 tx=0x7f0fa001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2485d6310b87246 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:27.501 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.501+0000 7f0fa77fe640 1 -- 172.21.15.91:0/2955918568 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00a5910 con 0x7f0fa80c2e10 2023-12-13T22:25:27.501 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.501+0000 7f0fa77fe640 1 -- 172.21.15.91:0/2955918568 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa00a5a90 con 0x7f0fa80c2e10 2023-12-13T22:25:27.501 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.501+0000 7f0fa77fe640 1 -- 172.21.15.91:0/2955918568 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00a5e80 con 0x7f0fa80c2e10 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.501+0000 7f0faed16640 1 -- 172.21.15.91:0/2955918568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa80c2e10 msgr2=0x7f0fa80c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.501+0000 7f0faed16640 1 --2- 172.21.15.91:0/2955918568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa80c2e10 0x7f0fa80c3280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8151c80 tx=0x7f0fa001c850 comp rx=0 tx=0).stop 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 -- 172.21.15.91:0/2955918568 shutdown_connections 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 --2- 172.21.15.91:0/2955918568 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa80c2e10 0x7f0fa80c3280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 --2- 172.21.15.91:0/2955918568 >> v2:172.21.15.152:3300/0 conn(0x7f0fa8151700 0x7f0fa80c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 -- 172.21.15.91:0/2955918568 >> 172.21.15.91:0/2955918568 conn(0x7f0fa8070ac0 msgr2=0x7f0fa8070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 -- 172.21.15.91:0/2955918568 shutdown_connections 2023-12-13T22:25:27.502 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 -- 172.21.15.91:0/2955918568 wait complete. 2023-12-13T22:25:27.504 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 Processor -- start 2023-12-13T22:25:27.504 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.505+0000 7f0faed16640 1 -- start start 2023-12-13T22:25:27.506 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:27.506 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fa80c7a40 0x7f0fa815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:27.506 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa8151700 0x7f0fa81f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:27.506 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81583f0 con 0x7f0fa8151700 2023-12-13T22:25:27.507 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81f15c0 con 0x7f0fa80c2e10 2023-12-13T22:25:27.507 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0faed16640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8159910 con 0x7f0fa80c7a40 2023-12-13T22:25:27.508 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0facab2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:27.509 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0fad2b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa8151700 0x7f0fa81f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:27.510 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0facab2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:44766/0 (socket says 172.21.15.91:44766) 2023-12-13T22:25:27.510 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.509+0000 7f0facab2640 1 -- 172.21.15.91:0/810560680 learned_addr learned my addr 172.21.15.91:0/810560680 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:27.514 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.517+0000 7f0fa7fff640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fa80c7a40 0x7f0fa815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:27.523 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.525+0000 7f0facab2640 1 -- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fa80c7a40 msgr2=0x7f0fa815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:27.523 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.525+0000 7f0facab2640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fa80c7a40 0x7f0fa815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:27.523 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.525+0000 7f0facab2640 1 -- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa8151700 msgr2=0x7f0fa81f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:27.523 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.525+0000 7f0facab2640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa8151700 0x7f0fa81f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:27.523 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.525+0000 7f0facab2640 1 -- 172.21.15.91:0/810560680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009a70 con 0x7f0fa80c2e10 2023-12-13T22:25:27.536 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.537+0000 7f0facab2640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e870 tx=0x7f0f9c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:27.555 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c009510 con 0x7f0fa80c2e10 2023-12-13T22:25:27.555 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00eec0 con 0x7f0fa80c2e10 2023-12-13T22:25:27.555 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00cb40 con 0x7f0fa80c2e10 2023-12-13T22:25:27.555 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa8153ae0 con 0x7f0fa80c2e10 2023-12-13T22:25:27.555 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa8153ff0 con 0x7f0fa80c2e10 2023-12-13T22:25:27.556 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.557+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa81f1960 con 0x7f0fa80c2e10 2023-12-13T22:25:27.895 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.897+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f0f9c00cca0 con 0x7f0fa80c2e10 2023-12-13T22:25:27.896 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.897+0000 7f0fa57fa640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 0x7f0f8c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:27.896 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.897+0000 7f0fa7fff640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 0x7f0f8c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:27.897 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.897+0000 7f0fa7fff640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 0x7f0f8c068ca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8156db0 tx=0x7f0f94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:27.902 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.901+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f9c055700 con 0x7f0fa80c2e10 2023-12-13T22:25:27.924 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:27.925+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0f9c051a40 con 0x7f0fa80c2e10 2023-12-13T22:25:28.109 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:28.109+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa81f1960 con 0x7f0fa80c2e10 2023-12-13T22:25:29.006 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:25:29.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:25:33.719 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0fa57fa640 1 -- 172.21.15.91:0/810560680 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f0fa81f1960 con 0x7f0fa80c2e10 2023-12-13T22:25:33.720 INFO:teuthology.misc.health.smithi091.stdout: 2023-12-13T22:25:33.720 INFO:teuthology.misc.health.smithi091.stdout:{"epoch":19,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:20.614373+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 msgr2=0x7f0f8c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 0x7f0f8c068ca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8156db0 tx=0x7f0f94009040 comp rx=0 tx=0).stop 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 msgr2=0x7f0fa81f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e870 tx=0x7f0f9c00ec70 comp rx=0 tx=0).stop 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 shutdown_connections 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0f8c0667e0 0x7f0f8c068ca0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0fa8151700 0x7f0fa81f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:33.722 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fa80c7a40 0x7f0fa815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:33.723 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 --2- 172.21.15.91:0/810560680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fa80c2e10 0x7f0fa81f54f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:33.723 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 >> 172.21.15.91:0/810560680 conn(0x7f0fa8070ac0 msgr2=0x7f0fa80c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:33.723 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 shutdown_connections 2023-12-13T22:25:33.723 INFO:teuthology.misc.health.smithi091.stderr:2023-12-13T22:25:33.721+0000 7f0faed16640 1 -- 172.21.15.91:0/810560680 wait complete. 2023-12-13T22:25:33.744 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-13T22:25:33.744 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-13T22:25:33.744 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.744 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-13T22:25:33.745 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-13T22:25:33.747 INFO:tasks.ceph.mds.a:Started 2023-12-13T22:25:33.747 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.747 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-13T22:25:33.748 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-13T22:25:33.750 INFO:tasks.ceph.mds.c:Started 2023-12-13T22:25:33.750 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.750 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-13T22:25:33.750 DEBUG:teuthology.orchestra.run.smithi091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-13T22:25:33.752 INFO:tasks.ceph.mds.e:Started 2023-12-13T22:25:33.752 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.753 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-13T22:25:33.753 DEBUG:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-13T22:25:33.755 INFO:tasks.ceph.mds.b:Started 2023-12-13T22:25:33.755 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.756 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-13T22:25:33.756 DEBUG:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-13T22:25:33.758 INFO:tasks.ceph.mds.d:Started 2023-12-13T22:25:33.758 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2023-12-13T22:25:33.759 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-13T22:25:33.759 DEBUG:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-13T22:25:33.761 INFO:tasks.ceph.mds.f:Started 2023-12-13T22:25:33.761 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-13T22:25:33.762 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:33.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 Processor -- start 2023-12-13T22:25:33.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 -- start start 2023-12-13T22:25:33.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff7a80722f0 0x7ff7a80726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:33.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff7a80c66d0 0x7ff7a80c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:33.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a8159590 con 0x7ff7a8159a20 2023-12-13T22:25:33.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8155fa0 con 0x7ff7a80c66d0 2023-12-13T22:25:33.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.909+0000 7ff7adbc6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a8072c10 con 0x7ff7a80722f0 2023-12-13T22:25:33.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.937+0000 7ff7a7fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff7a8159a20 0x7ff7a8159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:54202/0 (socket says 172.21.15.91:54202) 2023-12-13T22:25:33.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.937+0000 7ff7a7fff640 1 -- 172.21.15.91:0/2016090697 learned_addr learned my addr 172.21.15.91:0/2016090697 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:33.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.937+0000 7ff7a77fe640 1 --2- 172.21.15.91:0/2016090697 >> v2:172.21.15.152:3300/0 conn(0x7ff7a80722f0 0x7ff7a80726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:33.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.945+0000 7ff7a77fe640 1 -- 172.21.15.91:0/2016090697 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80c66d0 msgr2=0x7ff7a80c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:33.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.945+0000 7ff7a77fe640 1 --2- 172.21.15.91:0/2016090697 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80c66d0 0x7ff7a80c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:33.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.945+0000 7ff7a77fe640 1 -- 172.21.15.91:0/2016090697 >> v1:172.21.15.152:6789/0 conn(0x7ff7a8159a20 legacy=0x7ff7a8159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:33.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.945+0000 7ff7a77fe640 1 -- 172.21.15.91:0/2016090697 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8156190 con 0x7ff7a80722f0 2023-12-13T22:25:33.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:33.949+0000 7ff7a77fe640 1 --2- 172.21.15.91:0/2016090697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a80722f0 0x7ff7a80726d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80c9420 tx=0x7ff79801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae90d958953d828 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:38.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7a67fc640 1 -- 172.21.15.91:0/2016090697 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980ac600 con 0x7ff7a80722f0 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7a67fc640 1 -- 172.21.15.91:0/2016090697 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7980a8050 con 0x7ff7a80722f0 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7a67fc640 1 -- 172.21.15.91:0/2016090697 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980aca00 con 0x7ff7a80722f0 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- 172.21.15.91:0/2016090697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a80722f0 msgr2=0x7ff7a80726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/2016090697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a80722f0 0x7ff7a80726d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80c9420 tx=0x7ff79801c3a0 comp rx=0 tx=0).stop 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- 172.21.15.91:0/2016090697 shutdown_connections 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/2016090697 >> v2:172.21.15.91:3300/0 conn(0x7ff7a80c66d0 0x7ff7a80c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:38.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/2016090697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a80722f0 0x7ff7a80726d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:38.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- 172.21.15.91:0/2016090697 >> 172.21.15.91:0/2016090697 conn(0x7ff7a806b670 msgr2=0x7ff7a806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:38.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- 172.21.15.91:0/2016090697 shutdown_connections 2023-12-13T22:25:38.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- 172.21.15.91:0/2016090697 wait complete. 2023-12-13T22:25:38.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 Processor -- start 2023-12-13T22:25:38.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.609+0000 7ff7adbc6640 1 -- start start 2023-12-13T22:25:38.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c66d0 0x7ff7a8155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:38.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:38.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a8158c20 0x7ff7a8147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:38.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a81f2960 con 0x7ff7a80c66d0 2023-12-13T22:25:38.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a814a5e0 con 0x7ff7a8158c20 2023-12-13T22:25:38.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7adbc6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a814a880 con 0x7ff7a8159a20 2023-12-13T22:25:38.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:38.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:34450/0 (socket says 172.21.15.91:34450) 2023-12-13T22:25:38.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7a6ffd640 1 -- 172.21.15.91:0/364821972 learned_addr learned my addr 172.21.15.91:0/364821972 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:38.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.613+0000 7ff7a7fff640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a8158c20 0x7ff7a8147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:38.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.617+0000 7ff7a6ffd640 1 -- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a8158c20 msgr2=0x7ff7a8147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:38.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.617+0000 7ff7a6ffd640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a8158c20 0x7ff7a8147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:38.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.617+0000 7ff7a6ffd640 1 -- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c66d0 msgr2=0x7ff7a8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:38.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.617+0000 7ff7a6ffd640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c66d0 0x7ff7a8155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:38.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.617+0000 7ff7a6ffd640 1 -- 172.21.15.91:0/364821972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009420 con 0x7ff7a8159a20 2023-12-13T22:25:38.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.621+0000 7ff7a6ffd640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00b410 tx=0x7ff79c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:38.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c011830 con 0x7ff7a8159a20 2023-12-13T22:25:38.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c011990 con 0x7ff7a8159a20 2023-12-13T22:25:38.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c011d40 con 0x7ff7a8159a20 2023-12-13T22:25:38.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a81f2030 con 0x7ff7a8159a20 2023-12-13T22:25:38.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a81f25f0 con 0x7ff7a8159a20 2023-12-13T22:25:38.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.629+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a8159170 con 0x7ff7a8159a20 2023-12-13T22:25:38.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.669+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7ff79c01a400 con 0x7ff7a8159a20 2023-12-13T22:25:38.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.669+0000 7ff78ffff640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 0x7ff794068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:38.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.669+0000 7ff7a77fe640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 0x7ff794068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:38.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.669+0000 7ff7a77fe640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 0x7ff794068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7980ae000 tx=0x7ff798004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:38.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:38.673+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff79c055ea0 con 0x7ff7a8159a20 2023-12-13T22:25:39.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:39.141+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff79c051ae0 con 0x7ff7a8159a20 2023-12-13T22:25:39.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:39.301+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7a81f2aa0 con 0x7ff7a8159a20 2023-12-13T22:25:39.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:39.441+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff79c051eb0 con 0x7ff7a8159a20 2023-12-13T22:25:41.430 INFO:tasks.ceph.mds.c.smithi091.stdout:starting mds.c at 2023-12-13T22:25:41.815 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-12-13T22:25:44.143 INFO:tasks.ceph.mds.f.smithi152.stdout:starting mds.f at 2023-12-13T22:25:44.200 INFO:tasks.ceph.mds.e.smithi091.stdout:starting mds.e at 2023-12-13T22:25:45.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.193+0000 7ff78ffff640 1 -- 172.21.15.91:0/364821972 <== mon.2 v2:172.21.15.152:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12827 (secure 0 0 0) 0x7ff79c07f3a0 con 0x7ff7a8159a20 2023-12-13T22:25:45.193 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:45.193 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":19,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:20.614373+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:45.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 msgr2=0x7ff794068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:45.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 0x7ff794068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7980ae000 tx=0x7ff798004740 comp rx=0 tx=0).stop 2023-12-13T22:25:45.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 msgr2=0x7ff7a8147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:45.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00b410 tx=0x7ff79c00b8d0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 shutdown_connections 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff794066760 0x7ff794068c20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7a8158c20 0x7ff7a8147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7a8159a20 0x7ff7a8147830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 --2- 172.21.15.91:0/364821972 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7a80c66d0 0x7ff7a8155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 >> 172.21.15.91:0/364821972 conn(0x7ff7a806b670 msgr2=0x7ff7a80c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 shutdown_connections 2023-12-13T22:25:45.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.197+0000 7ff7adbc6640 1 -- 172.21.15.91:0/364821972 wait complete. 2023-12-13T22:25:45.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-13T22:25:45.219 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:25:45.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 Processor -- start 2023-12-13T22:25:45.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 -- start start 2023-12-13T22:25:45.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa72806a560 0x7fa728157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:45.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa728151950 con 0x7fa728151570 2023-12-13T22:25:45.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72806ab80 con 0x7fa7280c8e10 2023-12-13T22:25:45.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.349+0000 7fa7305d0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7280c7d40 con 0x7fa72806a560 2023-12-13T22:25:45.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.361+0000 7fa72eb6d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa7280c8e10 0x7fa728161b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:47954/0 (socket says 172.21.15.91:47954) 2023-12-13T22:25:45.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.361+0000 7fa72eb6d640 1 -- 172.21.15.91:0/3220358877 learned_addr learned my addr 172.21.15.91:0/3220358877 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:45.568 INFO:tasks.ceph.mds.a.smithi091.stdout:starting mds.a at 2023-12-13T22:25:45.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.609+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405140678 0 0) 0x7fa72806ab80 con 0x7fa7280c8e10 2023-12-13T22:25:45.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.609+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa714003530 con 0x7fa7280c8e10 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1861987706 0 0) 0x7fa714003530 con 0x7fa7280c8e10 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 >> v2:172.21.15.91:3300/0 conn(0x7fa72806a560 msgr2=0x7fa728157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 --2- 172.21.15.91:0/3220358877 >> v2:172.21.15.91:3300/0 conn(0x7fa72806a560 0x7fa728157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 >> v1:172.21.15.91:6789/0 conn(0x7fa728151570 legacy=0x7fa7280c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72806ae20 con 0x7fa7280c8e10 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fa720001a00 con 0x7fa7280c8e10 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 >> v1:172.21.15.152:6789/0 conn(0x7fa7280c8e10 legacy=0x7fa728161b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.613+0000 7fa72d36a640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa714003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72d36a640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7140047d0 0x7fa714004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:45.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72d36a640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714005390 0x7fa71400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:45.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280c7d40 con 0x7fa714005390 2023-12-13T22:25:45.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71400c250 con 0x7fa7140047d0 2023-12-13T22:25:45.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71400c410 con 0x7fa714003a40 2023-12-13T22:25:45.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.617+0000 7fa72e36c640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa714003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72db6b640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7140047d0 0x7fa714004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72e36c640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7140047d0 msgr2=0x7fa714004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72e36c640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7140047d0 0x7fa714004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72e36c640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714005390 msgr2=0x7fa71400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72e36c640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714005390 0x7fa71400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:45.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72eb6d640 1 -- 172.21.15.91:0/3220358877 reap_dead start 2023-12-13T22:25:45.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.621+0000 7fa72e36c640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714003530 con 0x7fa714003a40 2023-12-13T22:25:45.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:45.625+0000 7fa72e36c640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa714003e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa724001650 tx=0x7fa72401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600edbdfded097e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:45.628 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2023-12-13T22:25:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.621+0000 7fa7305d0640 -1 monclient: get_monmap_and_config failed to get config 2023-12-13T22:25:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.621+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 msgr2=0x7fa714003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:48.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.621+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa714003e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa724001650 tx=0x7fa72401c2e0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa7280c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa7280c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 0x7fa7280c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280c89a0 con 0x7fa72815ef10 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280b2270 con 0x7fa7280c66b0 2023-12-13T22:25:48.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa728157ea0 con 0x7fa714003a40 2023-12-13T22:25:48.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa72eb6d640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 0x7fa7280c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.625+0000 7fa72e36c640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa7280c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.629+0000 7fa72db6b640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa7280c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.633+0000 7fa72eb6d640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 msgr2=0x7fa7280c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:48.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.633+0000 7fa72eb6d640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa7280c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.633+0000 7fa72eb6d640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 msgr2=0x7fa7280c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:48.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.633+0000 7fa72eb6d640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa7280c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.633+0000 7fa72eb6d640 1 -- 172.21.15.91:0/3220358877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=2+}) v3 -- 0x7fa7280c5fe0 con 0x7fa72815ef10 2023-12-13T22:25:48.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.637+0000 7fa72eb6d640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 0x7fa7280c5290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa72806c210 tx=0x7fa72000a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85467c8c181df8b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:48.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.641+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200074e0 con 0x7fa72815ef10 2023-12-13T22:25:48.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.641+0000 7fa72d36a640 1 -- 172.21.15.91:0/3220358877 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa720007640 con 0x7fa72815ef10 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 msgr2=0x7fa7280c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 0x7fa7280c5290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa72806c210 tx=0x7fa72000a870 comp rx=0 tx=0).stop 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 shutdown_connections 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa72815ef10 0x7fa7280c5290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa714003a40 0x7fa7280c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 --2- 172.21.15.91:0/3220358877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa7280c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 >> 172.21.15.91:0/3220358877 conn(0x7fa728070160 msgr2=0x7fa72806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 shutdown_connections 2023-12-13T22:25:48.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.645+0000 7fa7305d0640 1 -- 172.21.15.91:0/3220358877 wait complete. 2023-12-13T22:25:48.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 Processor -- start 2023-12-13T22:25:48.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 -- start start 2023-12-13T22:25:48.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa728153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa72815ef10 0x7fa7281806f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa728197100 con 0x7fa714003a40 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7281974c0 con 0x7fa7280c66b0 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa7305d0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7281984f0 con 0x7fa72815ef10 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa72e36c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa72e36c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53702/0 (socket says 172.21.15.91:53702) 2023-12-13T22:25:48.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.649+0000 7fa72e36c640 1 -- 172.21.15.91:0/2851879195 learned_addr learned my addr 172.21.15.91:0/2851879195 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:48.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.653+0000 7fa72db6b640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa728153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.653+0000 7fa72eb6d640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa72815ef10 0x7fa7281806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 -- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa72815ef10 msgr2=0x7fa7281806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa72815ef10 0x7fa7281806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 -- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 msgr2=0x7fa728153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa728153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:48.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 -- 172.21.15.91:0/2851879195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72806ae20 con 0x7fa714003a40 2023-12-13T22:25:48.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.657+0000 7fa72e36c640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa72401c7c0 tx=0x7fa714005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240bd070 con 0x7fa714003a40 2023-12-13T22:25:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240a7070 con 0x7fa714003a40 2023-12-13T22:25:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240074f0 con 0x7fa714003a40 2023-12-13T22:25:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7281976b0 con 0x7fa714003a40 2023-12-13T22:25:48.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa728197c50 con 0x7fa714003a40 2023-12-13T22:25:48.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.665+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa728073e70 con 0x7fa714003a40 2023-12-13T22:25:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.689+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa7240a9020 con 0x7fa714003a40 2023-12-13T22:25:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.689+0000 7fa71effd640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 0x7fa70c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.689+0000 7fa72db6b640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 0x7fa70c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.689+0000 7fa72db6b640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 0x7fa70c068d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa72806e760 tx=0x7fa718008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:48.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.969+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7240ef5a0 con 0x7fa714003a40 2023-12-13T22:25:48.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:48.973+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa7240eb8e0 con 0x7fa714003a40 2023-12-13T22:25:49.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.141+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa72815dd20 con 0x7fa714003a40 2023-12-13T22:25:49.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.173+0000 7fa71effd640 1 -- 172.21.15.91:0/2851879195 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7240b1070 con 0x7fa714003a40 2023-12-13T22:25:49.173 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 msgr2=0x7fa70c068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 0x7fa70c068d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa72806e760 tx=0x7fa718008040 comp rx=0 tx=0).stop 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 msgr2=0x7fa728153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa72401c7c0 tx=0x7fa714005800 comp rx=0 tx=0).stop 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 shutdown_connections 2023-12-13T22:25:49.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa70c066860 0x7fa70c068d20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa72815ef10 0x7fa7281806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7280c66b0 0x7fa728153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 --2- 172.21.15.91:0/2851879195 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa714003a40 0x7fa728153110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 >> 172.21.15.91:0/2851879195 conn(0x7fa728070160 msgr2=0x7fa728158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 shutdown_connections 2023-12-13T22:25:49.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.177+0000 7fa7305d0640 1 -- 172.21.15.91:0/2851879195 wait complete. 2023-12-13T22:25:49.194 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:25:49.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.313+0000 7ff22a16f640 1 Processor -- start 2023-12-13T22:25:49.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.313+0000 7ff22a16f640 1 -- start start 2023-12-13T22:25:49.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff22a16f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff22406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff22a16f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2240c40e0 0x7ff2240c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff22a16f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22406f4a0 con 0x7ff224151720 2023-12-13T22:25:49.314 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff22a16f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff224072570 con 0x7ff2240c40e0 2023-12-13T22:25:49.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff22a16f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff224070be0 con 0x7ff224151340 2023-12-13T22:25:49.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff223fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2240c40e0 0x7ff2240c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff223fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff2240c40e0 0x7ff2240c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38752/0 (socket says 172.21.15.91:38752) 2023-12-13T22:25:49.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff223fff640 1 -- 172.21.15.91:0/2694152425 learned_addr learned my addr 172.21.15.91:0/2694152425 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:49.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.317+0000 7ff2237fe640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff22406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.321+0000 7ff223fff640 1 -- 172.21.15.91:0/2694152425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 msgr2=0x7ff22406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:49.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.321+0000 7ff223fff640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff22406ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.321+0000 7ff223fff640 1 -- 172.21.15.91:0/2694152425 >> v1:172.21.15.152:6789/0 conn(0x7ff224151720 legacy=0x7ff224157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.321+0000 7ff223fff640 1 -- 172.21.15.91:0/2694152425 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224070e80 con 0x7ff2240c40e0 2023-12-13T22:25:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.325+0000 7ff223fff640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff2240c4590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009e50 tx=0x7ff21c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5a100a543f7639 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.329+0000 7ff2227fc640 1 -- 172.21.15.91:0/2694152425 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0a58a0 con 0x7ff2240c40e0 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.329+0000 7ff2227fc640 1 -- 172.21.15.91:0/2694152425 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c0a5a00 con 0x7ff2240c40e0 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.329+0000 7ff2227fc640 1 -- 172.21.15.91:0/2694152425 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0a5d90 con 0x7ff2240c40e0 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.329+0000 7ff22a16f640 1 -- 172.21.15.91:0/2694152425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 msgr2=0x7ff2240c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.329+0000 7ff22a16f640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff2240c4590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009e50 tx=0x7ff21c01c9e0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- 172.21.15.91:0/2694152425 shutdown_connections 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff2240c4590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 --2- 172.21.15.91:0/2694152425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff22406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- 172.21.15.91:0/2694152425 >> 172.21.15.91:0/2694152425 conn(0x7ff22406c6a0 msgr2=0x7ff22406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:49.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- 172.21.15.91:0/2694152425 shutdown_connections 2023-12-13T22:25:49.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- 172.21.15.91:0/2694152425 wait complete. 2023-12-13T22:25:49.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 Processor -- start 2023-12-13T22:25:49.331 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- start start 2023-12-13T22:25:49.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff224156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff224151720 0x7ff2241f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2241507b0 con 0x7ff2240c40e0 2023-12-13T22:25:49.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2241565b0 con 0x7ff224151720 2023-12-13T22:25:49.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff22a16f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff224149a50 con 0x7ff224151340 2023-12-13T22:25:49.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38766/0 (socket says 172.21.15.91:38766) 2023-12-13T22:25:49.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff2237fe640 1 -- 172.21.15.91:0/518272814 learned_addr learned my addr 172.21.15.91:0/518272814 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:49.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff223fff640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff224151720 0x7ff2241f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.333+0000 7ff222ffd640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff224156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.337+0000 7ff2237fe640 1 -- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 msgr2=0x7ff224156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.337+0000 7ff2237fe640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff224156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.337+0000 7ff2237fe640 1 -- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff224151720 msgr2=0x7ff2241f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.337+0000 7ff2237fe640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff224151720 0x7ff2241f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.337+0000 7ff2237fe640 1 -- 172.21.15.91:0/518272814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c009b30 con 0x7ff2240c40e0 2023-12-13T22:25:49.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.341+0000 7ff2237fe640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d800 tx=0x7ff21400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:49.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400b660 con 0x7ff2240c40e0 2023-12-13T22:25:49.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400b7c0 con 0x7ff2240c40e0 2023-12-13T22:25:49.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400bb30 con 0x7ff2240c40e0 2023-12-13T22:25:49.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22414b7b0 con 0x7ff2240c40e0 2023-12-13T22:25:49.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2241f1ba0 con 0x7ff2240c40e0 2023-12-13T22:25:49.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.345+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224067520 con 0x7ff2240c40e0 2023-12-13T22:25:49.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.597+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff21400bc90 con 0x7ff2240c40e0 2023-12-13T22:25:49.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.601+0000 7ff20bfff640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 0x7ff210068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:49.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.601+0000 7ff222ffd640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 0x7ff210068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:49.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.601+0000 7ff222ffd640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 0x7ff210068cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff224154950 tx=0x7ff218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:49.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.613+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff214056040 con 0x7ff2240c40e0 2023-12-13T22:25:49.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.613+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff214052380 con 0x7ff2240c40e0 2023-12-13T22:25:49.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.809+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff224071db0 con 0x7ff2240c40e0 2023-12-13T22:25:49.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.841+0000 7ff20bfff640 1 -- 172.21.15.91:0/518272814 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7ff2140559a0 con 0x7ff2240c40e0 2023-12-13T22:25:49.840 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:49.840 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-13T22:25:49.840 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 2 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 msgr2=0x7ff210068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 0x7ff210068cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff224154950 tx=0x7ff218009040 comp rx=0 tx=0).stop 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 msgr2=0x7ff224149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d800 tx=0x7ff21400dcc0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 shutdown_connections 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff2100667f0 0x7ff210068cb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff224151720 0x7ff2241f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff224151340 0x7ff224156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 --2- 172.21.15.91:0/518272814 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff2240c40e0 0x7ff224149ee0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:49.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 >> 172.21.15.91:0/518272814 conn(0x7ff22406c6a0 msgr2=0x7ff2240c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:49.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 shutdown_connections 2023-12-13T22:25:49.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:49.845+0000 7ff22a16f640 1 -- 172.21.15.91:0/518272814 wait complete. 2023-12-13T22:25:51.861 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:25:51.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 Processor -- start 2023-12-13T22:25:51.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 -- start start 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 0x7f5d60072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d600c2440 con 0x7f5d600c65f0 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d600c2720 con 0x7f5d6006b1a0 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d66df9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6015a480 con 0x7f5d6006adc0 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d65396640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5d600c65f0 0x7f5d601532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50096/0 (socket says 172.21.15.91:50096) 2023-12-13T22:25:51.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.993+0000 7f5d65396640 1 -- 172.21.15.91:0/3410454901 learned_addr learned my addr 172.21.15.91:0/3410454901 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:51.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.997+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624397688 0 0) 0x7f5d600c2440 con 0x7f5d600c65f0 2023-12-13T22:25:51.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.997+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d48003530 con 0x7f5d600c65f0 2023-12-13T22:25:51.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.997+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076574132 0 0) 0x7f5d600c2720 con 0x7f5d6006b1a0 2023-12-13T22:25:51.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:51.997+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d600c2440 con 0x7f5d6006b1a0 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10776515 0 0) 0x7f5d48003530 con 0x7f5d600c65f0 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 msgr2=0x7f5d60072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 0x7f5d60072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 >> v1:172.21.15.152:6789/0 conn(0x7f5d6006b1a0 legacy=0x7f5d60159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600c2a00 con 0x7f5d600c65f0 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f5d58001a00 con 0x7f5d600c65f0 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 >> v1:172.21.15.91:6789/0 conn(0x7f5d600c65f0 legacy=0x7f5d601532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:51.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d48003bb0 0x7f5d48003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:51.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 0x7f5d480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:51.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d48004de0 0x7f5d48005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:51.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6015a480 con 0x7f5d48003bb0 2023-12-13T22:25:51.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4800bbf0 con 0x7f5d48004de0 2023-12-13T22:25:51.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4800bdb0 con 0x7f5d6006adc0 2023-12-13T22:25:52.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.001+0000 7f5d64b95640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d48003bb0 0x7f5d48003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.005+0000 7f5d64b95640 1 -- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 msgr2=0x7f5d480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:52.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.005+0000 7f5d64b95640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6006adc0 0x7f5d480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.005+0000 7f5d64b95640 1 -- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d48004de0 msgr2=0x7f5d48005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:52.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.005+0000 7f5d64b95640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d48004de0 0x7f5d48005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.005+0000 7f5d64b95640 1 -- 172.21.15.91:0/3410454901 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48003530 con 0x7f5d48003bb0 2023-12-13T22:25:52.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.009+0000 7f5d64b95640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d48003bb0 0x7f5d48003fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009890 tx=0x7f5d5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1488a158da0f8571 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:52.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500ab600 con 0x7f5d48003bb0 2023-12-13T22:25:52.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d500a7050 con 0x7f5d48003bb0 2023-12-13T22:25:52.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d5f7fe640 1 -- 172.21.15.91:0/3410454901 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500aba00 con 0x7f5d48003bb0 2023-12-13T22:25:52.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 -- 172.21.15.91:0/3410454901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d48003bb0 msgr2=0x7f5d48003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 --2- 172.21.15.91:0/3410454901 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d48003bb0 0x7f5d48003fb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009890 tx=0x7f5d5001c370 comp rx=0 tx=0).stop 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d65396640 1 -- 172.21.15.91:0/3410454901 reap_dead start 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 -- 172.21.15.91:0/3410454901 shutdown_connections 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 -- 172.21.15.91:0/3410454901 >> 172.21.15.91:0/3410454901 conn(0x7f5d60070160 msgr2=0x7f5d6006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 -- 172.21.15.91:0/3410454901 shutdown_connections 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.013+0000 7f5d66df9640 1 -- 172.21.15.91:0/3410454901 wait complete. 2023-12-13T22:25:52.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 Processor -- start 2023-12-13T22:25:52.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 -- start start 2023-12-13T22:25:52.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d48003bb0 0x7f5d6015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6015aa30 0x7f5d601f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d601540d0 con 0x7f5d6015c2e0 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6015af90 con 0x7f5d6015aa30 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d66df9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60153df0 con 0x7f5d48003bb0 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d65396640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d65396640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38776/0 (socket says 172.21.15.91:38776) 2023-12-13T22:25:52.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.017+0000 7f5d65396640 1 -- 172.21.15.91:0/2747305605 learned_addr learned my addr 172.21.15.91:0/2747305605 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:52.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d5ffff640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6015aa30 0x7f5d601f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d64b95640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d48003bb0 0x7f5d6015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d65396640 1 -- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d48003bb0 msgr2=0x7f5d6015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d65396640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d48003bb0 0x7f5d6015ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d65396640 1 -- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6015aa30 msgr2=0x7f5d601f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d65396640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6015aa30 0x7f5d601f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.021+0000 7f5d65396640 1 -- 172.21.15.91:0/2747305605 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6015a750 con 0x7f5d6015c2e0 2023-12-13T22:25:52.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.025+0000 7f5d65396640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c69d0 tx=0x7f5d5800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800ce60 con 0x7f5d6015c2e0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5800a610 con 0x7f5d6015c2e0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800a9c0 con 0x7f5d6015c2e0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d601f1960 con 0x7f5d6015c2e0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6015bf90 con 0x7f5d6015c2e0 2023-12-13T22:25:52.026 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.029+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d60073e70 con 0x7f5d6015c2e0 2023-12-13T22:25:52.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.049+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5d5800ab20 con 0x7f5d6015c2e0 2023-12-13T22:25:52.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.049+0000 7f5d5d7fa640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 0x7f5d4c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.049+0000 7f5d64b95640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 0x7f5d4c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.049+0000 7f5d64b95640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 0x7f5d4c068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d500ad000 tx=0x7f5d50004850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:52.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.333+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d58054c80 con 0x7f5d6015c2e0 2023-12-13T22:25:52.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.333+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5d58050fc0 con 0x7f5d6015c2e0 2023-12-13T22:25:52.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.585+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d60159fc0 con 0x7f5d6015c2e0 2023-12-13T22:25:52.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.597+0000 7f5d5d7fa640 1 -- 172.21.15.91:0/2747305605 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+5277 (secure 0 0 0) 0x7f5d580545e0 con 0x7f5d6015c2e0 2023-12-13T22:25:52.597 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:52.597 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-13T22:25:52.597 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 4 2023-12-13T22:25:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 msgr2=0x7f5d4c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 0x7f5d4c068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d500ad000 tx=0x7f5d50004850 comp rx=0 tx=0).stop 2023-12-13T22:25:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 msgr2=0x7f5d601f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d600c69d0 tx=0x7f5d5800cc10 comp rx=0 tx=0).stop 2023-12-13T22:25:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 shutdown_connections 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5d4c066840 0x7f5d4c068d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5d6015c2e0 0x7f5d601f23c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6015aa30 0x7f5d601f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 --2- 172.21.15.91:0/2747305605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d48003bb0 0x7f5d6015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 >> 172.21.15.91:0/2747305605 conn(0x7f5d60070160 msgr2=0x7f5d601509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 shutdown_connections 2023-12-13T22:25:52.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.601+0000 7f5d66df9640 1 -- 172.21.15.91:0/2747305605 wait complete. 2023-12-13T22:25:52.617 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:25:52.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.737+0000 7f7d51784640 1 Processor -- start 2023-12-13T22:25:52.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.737+0000 7f7d51784640 1 -- start start 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d51784640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151720 0x7f7d4c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d51784640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d51784640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c06f4a0 con 0x7f7d4c151340 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d51784640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c072570 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d51784640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c070be0 con 0x7f7d4c151720 2023-12-13T22:25:52.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38792/0 (socket says 172.21.15.91:38792) 2023-12-13T22:25:52.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/3585471616 learned_addr learned my addr 172.21.15.91:0/3585471616 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:52.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4a7fc640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151720 0x7f7d4c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/3585471616 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151720 msgr2=0x7f7d4c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:52.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151720 0x7f7d4c06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/3585471616 >> v1:172.21.15.152:6789/0 conn(0x7f7d4c151340 legacy=0x7f7d4c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.741+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/3585471616 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c070e80 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.745+0000 7f7d4b7fe640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009870 tx=0x7f7d4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9e30aeb8a50530 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:52.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.749+0000 7f7d49ffb640 1 -- 172.21.15.91:0/3585471616 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440aa670 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.749+0000 7f7d49ffb640 1 -- 172.21.15.91:0/3585471616 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440aa7d0 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.749+0000 7f7d49ffb640 1 -- 172.21.15.91:0/3585471616 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440aab60 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- 172.21.15.91:0/3585471616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c0c40e0 msgr2=0x7f7d4c0c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009870 tx=0x7f7d4401c510 comp rx=0 tx=0).stop 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- 172.21.15.91:0/3585471616 shutdown_connections 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c0c4590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- 172.21.15.91:0/3585471616 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151720 0x7f7d4c06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- 172.21.15.91:0/3585471616 >> 172.21.15.91:0/3585471616 conn(0x7f7d4c06c6a0 msgr2=0x7f7d4c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- 172.21.15.91:0/3585471616 shutdown_connections 2023-12-13T22:25:52.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- 172.21.15.91:0/3585471616 wait complete. 2023-12-13T22:25:52.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 Processor -- start 2023-12-13T22:25:52.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- start start 2023-12-13T22:25:52.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151340 0x7f7d4c1f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c15b3a0 con 0x7f7d4c151720 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1f1190 con 0x7f7d4c0c40e0 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d51784640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0c68e0 con 0x7f7d4c151340 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.753+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.757+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38806/0 (socket says 172.21.15.91:38806) 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.757+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/777411600 learned_addr learned my addr 172.21.15.91:0/777411600 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:52.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.757+0000 7f7d4affd640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.757+0000 7f7d4a7fc640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151340 0x7f7d4c1f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151340 msgr2=0x7f7d4c1f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151340 0x7f7d4c1f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0c40e0 msgr2=0x7f7d4c15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:52.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c15a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:52.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 -- 172.21.15.91:0/777411600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440094d0 con 0x7f7d4c151720 2023-12-13T22:25:52.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.761+0000 7f7d4b7fe640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac040 tx=0x7f7d4401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.765+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440bd5f0 con 0x7f7d4c151720 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.765+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440bd770 con 0x7f7d4c151720 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.765+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1f39f0 con 0x7f7d4c151720 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.765+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440bdb20 con 0x7f7d4c151720 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.769+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0ca5a0 con 0x7f7d4c151720 2023-12-13T22:25:52.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.769+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1f0c80 con 0x7f7d4c151720 2023-12-13T22:25:52.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.785+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7d440b3600 con 0x7f7d4c151720 2023-12-13T22:25:52.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.789+0000 7f7d437fe640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 0x7f7d2c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:52.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.789+0000 7f7d4affd640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 0x7f7d2c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:52.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:52.789+0000 7f7d4affd640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 0x7f7d2c068d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06e960 tx=0x7f7d3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:53.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.053+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d440f0340 con 0x7f7d4c151720 2023-12-13T22:25:53.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.053+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7d440ec680 con 0x7f7d4c151720 2023-12-13T22:25:53.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.221+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d4c1f0c80 con 0x7f7d4c151720 2023-12-13T22:25:53.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.377+0000 7f7d437fe640 1 -- 172.21.15.91:0/777411600 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12827 (secure 0 0 0) 0x7f7d4c1f0c80 con 0x7f7d4c151720 2023-12-13T22:25:53.376 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:53.376 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":19,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:25:20.614373+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 msgr2=0x7f7d2c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 0x7f7d2c068d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06e960 tx=0x7f7d3c009040 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 msgr2=0x7f7d4c1f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac040 tx=0x7f7d4401ad50 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 shutdown_connections 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d2c066870 0x7f7d2c068d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d4c151720 0x7f7d4c1f1620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d4c151340 0x7f7d4c1f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 --2- 172.21.15.91:0/777411600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0c40e0 0x7f7d4c15a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 >> 172.21.15.91:0/777411600 conn(0x7f7d4c06c6a0 msgr2=0x7f7d4c0c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 shutdown_connections 2023-12-13T22:25:53.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.381+0000 7f7d51784640 1 -- 172.21.15.91:0/777411600 wait complete. 2023-12-13T22:25:53.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-13T22:25:53.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:25:53.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 Processor -- start 2023-12-13T22:25:53.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 -- start start 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fac1815b620 0x7fac180cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1815a4a0 con 0x7fac1815c5a0 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1806d560 con 0x7fac1815b620 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac2062d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1806cc00 con 0x7fac1815c1c0 2023-12-13T22:25:53.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac1ebca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fac1815b620 0x7fac180cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:53.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac1ebca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fac1815b620 0x7fac180cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38808/0 (socket says 172.21.15.91:38808) 2023-12-13T22:25:53.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.529+0000 7fac1ebca640 1 -- 172.21.15.91:0/761127910 learned_addr learned my addr 172.21.15.91:0/761127910 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:53.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.533+0000 7fac1ebca640 1 -- 172.21.15.91:0/761127910 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 msgr2=0x7fac18159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:53.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.533+0000 7fac1ebca640 1 --2- 172.21.15.91:0/761127910 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.533+0000 7fac1ebca640 1 -- 172.21.15.91:0/761127910 >> v1:172.21.15.91:6789/0 conn(0x7fac1815c5a0 legacy=0x7fac1815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.533+0000 7fac1ebca640 1 -- 172.21.15.91:0/761127910 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1806c680 con 0x7fac1815b620 2023-12-13T22:25:53.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.537+0000 7fac1ebca640 1 --2- 172.21.15.91:0/761127910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815b620 0x7fac180cb6f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e50 tx=0x7fac1001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a222005c4405e217 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:53.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac1d3c7640 1 -- 172.21.15.91:0/761127910 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100a58a0 con 0x7fac1815b620 2023-12-13T22:25:53.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac1d3c7640 1 -- 172.21.15.91:0/761127910 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac100a5a00 con 0x7fac1815b620 2023-12-13T22:25:53.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac1d3c7640 1 -- 172.21.15.91:0/761127910 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100a5d90 con 0x7fac1815b620 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- 172.21.15.91:0/761127910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815b620 msgr2=0x7fac180cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 --2- 172.21.15.91:0/761127910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815b620 0x7fac180cb6f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac10009e50 tx=0x7fac1001c9e0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- 172.21.15.91:0/761127910 shutdown_connections 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 --2- 172.21.15.91:0/761127910 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815b620 0x7fac180cb6f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 --2- 172.21.15.91:0/761127910 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- 172.21.15.91:0/761127910 >> 172.21.15.91:0/761127910 conn(0x7fac18060fd0 msgr2=0x7fac180613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- 172.21.15.91:0/761127910 shutdown_connections 2023-12-13T22:25:53.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- 172.21.15.91:0/761127910 wait complete. 2023-12-13T22:25:53.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 Processor -- start 2023-12-13T22:25:53.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.545+0000 7fac2062d640 1 -- start start 2023-12-13T22:25:53.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac1815b620 0x7fac181f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18156d90 con 0x7fac1815c5a0 2023-12-13T22:25:53.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac181f5db0 con 0x7fac1815b620 2023-12-13T22:25:53.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac2062d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac18151150 con 0x7fac1815c1c0 2023-12-13T22:25:53.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac1ebca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:53.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac1ebca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38824/0 (socket says 172.21.15.91:38824) 2023-12-13T22:25:53.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.549+0000 7fac1ebca640 1 -- 172.21.15.91:0/286797128 learned_addr learned my addr 172.21.15.91:0/286797128 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:53.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 -- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 msgr2=0x7fac18155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 -- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac1815b620 msgr2=0x7fac181f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:53.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac1815b620 0x7fac181f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:53.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 -- 172.21.15.91:0/286797128 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009b30 con 0x7fac1815c5a0 2023-12-13T22:25:53.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.553+0000 7fac1ebca640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac1001a610 tx=0x7fac10019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.557+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100b8880 con 0x7fac1815c5a0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.557+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac100b89e0 con 0x7fac1815c5a0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.557+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100b8d90 con 0x7fac1815c5a0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.557+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac18151430 con 0x7fac1815c5a0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.557+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac180c0ce0 con 0x7fac1815c5a0 2023-12-13T22:25:53.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.561+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac18151290 con 0x7fac1815c5a0 2023-12-13T22:25:53.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.581+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fac100ca430 con 0x7fac1815c5a0 2023-12-13T22:25:53.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.581+0000 7fac0effd640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 0x7fabfc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:53.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.581+0000 7fac1e3c9640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 0x7fabfc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:53.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.581+0000 7fac1e3c9640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 0x7fabfc068d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac14009690 tx=0x7fac14006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.849+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac100f11b0 con 0x7fac1815c5a0 2023-12-13T22:25:53.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:53.849+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fac100ecdf0 con 0x7fac1815c5a0 2023-12-13T22:25:54.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.017+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac18151290 con 0x7fac1815c5a0 2023-12-13T22:25:54.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.029+0000 7fac0effd640 1 -- 172.21.15.91:0/286797128 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac18151290 con 0x7fac1815c5a0 2023-12-13T22:25:54.027 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 msgr2=0x7fabfc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 0x7fabfc068d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac14009690 tx=0x7fac14006c00 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 msgr2=0x7fac1814ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac1001a610 tx=0x7fac10019780 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 shutdown_connections 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fabfc066870 0x7fabfc068d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fac1815c5a0 0x7fac1814ce60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac1815c1c0 0x7fac18155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 --2- 172.21.15.91:0/286797128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac1815b620 0x7fac181f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 >> 172.21.15.91:0/286797128 conn(0x7fac18060fd0 msgr2=0x7fac18154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 shutdown_connections 2023-12-13T22:25:54.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.033+0000 7fac2062d640 1 -- 172.21.15.91:0/286797128 wait complete. 2023-12-13T22:25:54.047 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-13T22:25:54.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.169+0000 7f7164711640 1 Processor -- start 2023-12-13T22:25:54.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 -- start start 2023-12-13T22:25:54.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f715c1505d0 0x7f715c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c1568c0 con 0x7f715c0c1ed0 2023-12-13T22:25:54.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0c4ed0 con 0x7f715c1505d0 2023-12-13T22:25:54.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7164711640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c15a650 con 0x7f715c1501f0 2023-12-13T22:25:54.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7161cac640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f715c1505d0 0x7f715c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7162cae640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f715c0c1ed0 0x7f715c1596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50112/0 (socket says 172.21.15.91:50112) 2023-12-13T22:25:54.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f7162cae640 1 -- 172.21.15.91:0/876875805 learned_addr learned my addr 172.21.15.91:0/876875805 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:54.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.173+0000 7f71624ad640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.177+0000 7f7161cac640 1 -- 172.21.15.91:0/876875805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 msgr2=0x7f715c156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:54.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.177+0000 7f7161cac640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.177+0000 7f7161cac640 1 -- 172.21.15.91:0/876875805 >> v1:172.21.15.91:6789/0 conn(0x7f715c0c1ed0 legacy=0x7f715c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.177+0000 7f7161cac640 1 -- 172.21.15.91:0/876875805 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c159dd0 con 0x7f715c1505d0 2023-12-13T22:25:54.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.181+0000 7f7161cac640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c1505d0 0x7f715c0c6d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d55dea14bc0551c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:54.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.185+0000 7f71614ab640 1 -- 172.21.15.91:0/876875805 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0ad640 con 0x7f715c1505d0 2023-12-13T22:25:54.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.185+0000 7f71614ab640 1 -- 172.21.15.91:0/876875805 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0ad7a0 con 0x7f715c1505d0 2023-12-13T22:25:54.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.185+0000 7f71614ab640 1 -- 172.21.15.91:0/876875805 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0adb30 con 0x7f715c1505d0 2023-12-13T22:25:54.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- 172.21.15.91:0/876875805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c1505d0 msgr2=0x7f715c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c1505d0 0x7f715c0c6d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c480 comp rx=0 tx=0).stop 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- 172.21.15.91:0/876875805 shutdown_connections 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c1505d0 0x7f715c0c6d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- 172.21.15.91:0/876875805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- 172.21.15.91:0/876875805 >> 172.21.15.91:0/876875805 conn(0x7f715c06c6a0 msgr2=0x7f715c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- 172.21.15.91:0/876875805 shutdown_connections 2023-12-13T22:25:54.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- 172.21.15.91:0/876875805 wait complete. 2023-12-13T22:25:54.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 Processor -- start 2023-12-13T22:25:54.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- start start 2023-12-13T22:25:54.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f715c0c1ed0 0x7f715c0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c13c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c1f1b70 con 0x7f715c149ea0 2023-12-13T22:25:54.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c153900 con 0x7f715c0c1ed0 2023-12-13T22:25:54.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.189+0000 7f7164711640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c1f2000 con 0x7f715c1501f0 2023-12-13T22:25:54.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.193+0000 7f7162cae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.193+0000 7f7162cae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38846/0 (socket says 172.21.15.91:38846) 2023-12-13T22:25:54.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.193+0000 7f7162cae640 1 -- 172.21.15.91:0/1826210612 learned_addr learned my addr 172.21.15.91:0/1826210612 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:54.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.193+0000 7f71624ad640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f715c0c1ed0 0x7f715c0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.193+0000 7f7161cac640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c13c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 -- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 msgr2=0x7f715c13c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c13c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 -- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f715c0c1ed0 msgr2=0x7f715c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f715c0c1ed0 0x7f715c0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 -- 172.21.15.91:0/1826210612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009420 con 0x7f715c149ea0 2023-12-13T22:25:54.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.197+0000 7f7162cae640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f715400c400 tx=0x7f715400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:54.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154005cf0 con 0x7f715c149ea0 2023-12-13T22:25:54.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154005e50 con 0x7f715c149ea0 2023-12-13T22:25:54.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71540072d0 con 0x7f715c149ea0 2023-12-13T22:25:54.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c153620 con 0x7f715c149ea0 2023-12-13T22:25:54.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c1f1520 con 0x7f715c149ea0 2023-12-13T22:25:54.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.201+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c155cf0 con 0x7f715c149ea0 2023-12-13T22:25:54.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.225+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7154007430 con 0x7f715c149ea0 2023-12-13T22:25:54.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.225+0000 7f7152ffd640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 0x7f7140068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.225+0000 7f71624ad640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 0x7f7140068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.225+0000 7f71624ad640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 0x7f7140068d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71580113e0 tx=0x7f715800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:54.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.497+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7154054e50 con 0x7f715c149ea0 2023-12-13T22:25:54.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.497+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7154051190 con 0x7f715c149ea0 2023-12-13T22:25:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.661+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f715c067520 con 0x7f715c149ea0 2023-12-13T22:25:54.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.681+0000 7f7152ffd640 1 -- 172.21.15.91:0/1826210612 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7154021060 con 0x7f715c149ea0 2023-12-13T22:25:54.681 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout:[ 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout: { 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout: "poolnum": 1, 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout: "poolname": ".mgr" 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-13T22:25:54.682 INFO:teuthology.orchestra.run.smithi091.stdout:] 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 msgr2=0x7f7140068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 0x7f7140068d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f71580113e0 tx=0x7f715800b040 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 msgr2=0x7f715c1edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f715400c400 tx=0x7f715400c8c0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 shutdown_connections 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7140066870 0x7f7140068d30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f715c149ea0 0x7f715c1edbc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f715c1501f0 0x7f715c13c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 --2- 172.21.15.91:0/1826210612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f715c0c1ed0 0x7f715c0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 >> 172.21.15.91:0/1826210612 conn(0x7f715c06c6a0 msgr2=0x7f715c14e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:54.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 shutdown_connections 2023-12-13T22:25:54.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.685+0000 7f7164711640 1 -- 172.21.15.91:0/1826210612 wait complete. 2023-12-13T22:25:54.701 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-13T22:25:54.701 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-13T22:25:54.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.825+0000 7f047f109640 1 Processor -- start 2023-12-13T22:25:54.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.825+0000 7f047f109640 1 -- start start 2023-12-13T22:25:54.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047f109640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 0x7f04780ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047f109640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f047815a280 0x7f0478163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047f109640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780cd9a0 con 0x7f04780ce0c0 2023-12-13T22:25:54.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047f109640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04780ca550 con 0x7f047815a280 2023-12-13T22:25:54.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047f109640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780ce9e0 con 0x7f04780cc3c0 2023-12-13T22:25:54.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f0477fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 0x7f04780ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047cea5640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f04780ce0c0 0x7f0478159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:33176/0 (socket says 172.21.15.91:33176) 2023-12-13T22:25:54.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047cea5640 1 -- 172.21.15.91:0/199353381 learned_addr learned my addr 172.21.15.91:0/199353381 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:54.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.829+0000 7f047d6a6640 1 --2- 172.21.15.91:0/199353381 >> v2:172.21.15.152:3300/0 conn(0x7f047815a280 0x7f0478163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.837+0000 7f0477fff640 1 -- 172.21.15.91:0/199353381 >> v2:172.21.15.152:3300/0 conn(0x7f047815a280 msgr2=0x7f0478163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:54.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.837+0000 7f0477fff640 1 --2- 172.21.15.91:0/199353381 >> v2:172.21.15.152:3300/0 conn(0x7f047815a280 0x7f0478163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.837+0000 7f0477fff640 1 -- 172.21.15.91:0/199353381 >> v1:172.21.15.152:6789/0 conn(0x7f04780ce0c0 legacy=0x7f0478159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.837+0000 7f0477fff640 1 -- 172.21.15.91:0/199353381 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04781596c0 con 0x7f04780cc3c0 2023-12-13T22:25:54.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.841+0000 7f0477fff640 1 --2- 172.21.15.91:0/199353381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 0x7f04780ce4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f046c0097c0 tx=0x7f046c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22419b5579ac76b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:54.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f04777fe640 1 -- 172.21.15.91:0/199353381 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0ab680 con 0x7f04780cc3c0 2023-12-13T22:25:54.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f04777fe640 1 -- 172.21.15.91:0/199353381 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c0ab7e0 con 0x7f04780cc3c0 2023-12-13T22:25:54.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f04777fe640 1 -- 172.21.15.91:0/199353381 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0abb70 con 0x7f04780cc3c0 2023-12-13T22:25:54.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- 172.21.15.91:0/199353381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 msgr2=0x7f04780ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 --2- 172.21.15.91:0/199353381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 0x7f04780ce4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f046c0097c0 tx=0x7f046c01c480 comp rx=0 tx=0).stop 2023-12-13T22:25:54.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- 172.21.15.91:0/199353381 shutdown_connections 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 --2- 172.21.15.91:0/199353381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04780cc3c0 0x7f04780ce4a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 --2- 172.21.15.91:0/199353381 >> v2:172.21.15.152:3300/0 conn(0x7f047815a280 0x7f0478163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- 172.21.15.91:0/199353381 >> 172.21.15.91:0/199353381 conn(0x7f04780b07c0 msgr2=0x7f04780b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- 172.21.15.91:0/199353381 shutdown_connections 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- 172.21.15.91:0/199353381 wait complete. 2023-12-13T22:25:54.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 Processor -- start 2023-12-13T22:25:54.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.853+0000 7f047f109640 1 -- start start 2023-12-13T22:25:54.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04780ce0c0 0x7f04780c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047815a280 0x7f04780b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c6ff0 con 0x7f04780cc3c0 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c69c0 con 0x7f04780ce0c0 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047f109640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b4570 con 0x7f047815a280 2023-12-13T22:25:54.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047cea5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047cea5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38862/0 (socket says 172.21.15.91:38862) 2023-12-13T22:25:54.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047cea5640 1 -- 172.21.15.91:0/2512477639 learned_addr learned my addr 172.21.15.91:0/2512477639 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:54.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.857+0000 7f047d6a6640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047815a280 0x7f04780b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:54.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.861+0000 7f047cea5640 1 -- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047815a280 msgr2=0x7f04780b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.861+0000 7f047cea5640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047815a280 0x7f04780b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.861+0000 7f047cea5640 1 -- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04780ce0c0 msgr2=0x7f04780c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:54.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.861+0000 7f047cea5640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04780ce0c0 0x7f04780c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:54.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.861+0000 7f047cea5640 1 -- 172.21.15.91:0/2512477639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c009420 con 0x7f04780cc3c0 2023-12-13T22:25:54.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.865+0000 7f047cea5640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f046800c500 tx=0x7f046800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:54.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468005cf0 con 0x7f04780cc3c0 2023-12-13T22:25:54.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468005e50 con 0x7f04780cc3c0 2023-12-13T22:25:54.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680072f0 con 0x7f04780cc3c0 2023-12-13T22:25:54.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04780c5730 con 0x7f04780cc3c0 2023-12-13T22:25:54.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780c6c10 con 0x7f04780cc3c0 2023-12-13T22:25:54.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:54.869+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478067520 con 0x7f04780cc3c0 2023-12-13T22:25:55.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.137+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0468007450 con 0x7f04780cc3c0 2023-12-13T22:25:55.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.137+0000 7f04757fa640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 0x7f0464068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:55.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.137+0000 7f0477fff640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 0x7f0464068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:55.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.137+0000 7f0477fff640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 0x7f0464068d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f046c0af000 tx=0x7f046c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:55.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.149+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0468054ae0 con 0x7f04780cc3c0 2023-12-13T22:25:55.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.149+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0468050e20 con 0x7f04780cc3c0 2023-12-13T22:25:55.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:55.313+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f04780b1570 con 0x7f04780cc3c0 2023-12-13T22:25:56.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.289+0000 7f04757fa640 1 -- 172.21.15.91:0/2512477639 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0468054440 con 0x7f04780cc3c0 2023-12-13T22:25:56.287 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' created 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.289+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 msgr2=0x7f0464068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.289+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 0x7f0464068d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f046c0af000 tx=0x7f046c008040 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.289+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 msgr2=0x7f04780b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.289+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f046800c500 tx=0x7f046800c9c0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 shutdown_connections 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0464066840 0x7f0464068d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047815a280 0x7f04780b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04780ce0c0 0x7f04780c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 --2- 172.21.15.91:0/2512477639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f04780cc3c0 0x7f04780b1790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 >> 172.21.15.91:0/2512477639 conn(0x7f04780b07c0 msgr2=0x7f047814e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 shutdown_connections 2023-12-13T22:25:56.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.293+0000 7f047f109640 1 -- 172.21.15.91:0/2512477639 wait complete. 2023-12-13T22:25:56.320 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-13T22:25:56.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 Processor -- start 2023-12-13T22:25:56.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 -- start start 2023-12-13T22:25:56.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 0x7fe06806ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0681595f0 con 0x7fe0680c4cc0 2023-12-13T22:25:56.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0680c2c50 con 0x7fe0680c82d0 2023-12-13T22:25:56.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe06d9f5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680c2f30 con 0x7fe06806b620 2023-12-13T22:25:56.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe0677fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe0680c4cc0 0x7fe068156050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50122/0 (socket says 172.21.15.91:50122) 2023-12-13T22:25:56.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.453+0000 7fe0677fe640 1 -- 172.21.15.91:0/3628359959 learned_addr learned my addr 172.21.15.91:0/3628359959 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:56.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.457+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160789312 0 0) 0x7fe0681595f0 con 0x7fe0680c4cc0 2023-12-13T22:25:56.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.457+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe050005740 con 0x7fe0680c4cc0 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234469758 0 0) 0x7fe050005740 con 0x7fe0680c4cc0 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 msgr2=0x7fe06806ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 0x7fe06806ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 >> v1:172.21.15.152:6789/0 conn(0x7fe0680c82d0 legacy=0x7fe068159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680c3210 con 0x7fe0680c4cc0 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fe060001a00 con 0x7fe0680c4cc0 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 >> v1:172.21.15.91:6789/0 conn(0x7fe0680c4cc0 legacy=0x7fe068156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe050005c30 0x7fe050006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 0x7fe0500069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050007040 0x7fe05000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680c2f30 con 0x7fe050005c30 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050007790 con 0x7fe050007040 2023-12-13T22:25:56.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.461+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05000e0e0 con 0x7fe06806b620 2023-12-13T22:25:56.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.465+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe050005c30 0x7fe050006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:56.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 -- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 msgr2=0x7fe0500069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe06806b620 0x7fe0500069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 -- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050007040 msgr2=0x7fe05000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050007040 0x7fe05000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 -- 172.21.15.91:0/3628359959 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050005740 con 0x7fe050005c30 2023-12-13T22:25:56.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.469+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe050005c30 0x7fe050006030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe058001650 tx=0x7fe05801c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8da0dfee78a77 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:56.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058005270 con 0x7fe050005c30 2023-12-13T22:25:56.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0580a7070 con 0x7fe050005c30 2023-12-13T22:25:56.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe065ffb640 1 -- 172.21.15.91:0/3628359959 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058003620 con 0x7fe050005c30 2023-12-13T22:25:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3628359959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe050005c30 msgr2=0x7fe050006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3628359959 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe050005c30 0x7fe050006030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe058001650 tx=0x7fe05801c2b0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe0677fe640 1 -- 172.21.15.91:0/3628359959 reap_dead start 2023-12-13T22:25:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3628359959 shutdown_connections 2023-12-13T22:25:56.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3628359959 >> 172.21.15.91:0/3628359959 conn(0x7fe0680713a0 msgr2=0x7fe0680717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:56.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3628359959 shutdown_connections 2023-12-13T22:25:56.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3628359959 wait complete. 2023-12-13T22:25:56.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 Processor -- start 2023-12-13T22:25:56.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- start start 2023-12-13T22:25:56.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050005c30 0x7fe068157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe068137c80 0x7fe068135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068139640 con 0x7fe068153030 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0681398b0 con 0x7fe050005c30 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.477+0000 7fe06d9f5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680cbcc0 con 0x7fe068137c80 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.481+0000 7fe0677fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.481+0000 7fe0677fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38878/0 (socket says 172.21.15.91:38878) 2023-12-13T22:25:56.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.481+0000 7fe0677fe640 1 -- 172.21.15.91:0/3801190793 learned_addr learned my addr 172.21.15.91:0/3801190793 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:56.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 -- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe068137c80 msgr2=0x7fe068135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe068137c80 0x7fe068135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 -- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050005c30 msgr2=0x7fe068157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:56.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050005c30 0x7fe068157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:56.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 -- 172.21.15.91:0/3801190793 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0680cbfa0 con 0x7fe068153030 2023-12-13T22:25:56.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.485+0000 7fe0677fe640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe068070d40 tx=0x7fe06000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000a610 con 0x7fe068153030 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000a770 con 0x7fe068153030 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000ab20 con 0x7fe068153030 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0681546b0 con 0x7fe068153030 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe068154a20 con 0x7fe068153030 2023-12-13T22:25:56.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.489+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0680cbb00 con 0x7fe068153030 2023-12-13T22:25:56.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.513+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe06000ac80 con 0x7fe068153030 2023-12-13T22:25:56.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.513+0000 7fe04ffff640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 0x7fe054068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:56.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.513+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 0x7fe054068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:56.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.513+0000 7fe066ffd640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 0x7fe054068d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0580aa000 tx=0x7fe058000fc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:56.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.769+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe060055450 con 0x7fe068153030 2023-12-13T22:25:56.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.769+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe060051090 con 0x7fe068153030 2023-12-13T22:25:56.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:56.937+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe068073e70 con 0x7fe068153030 2023-12-13T22:25:57.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.677+0000 7fe04ffff640 1 -- 172.21.15.91:0/3801190793 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe0600546b0 con 0x7fe068153030 2023-12-13T22:25:57.675 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' created 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 msgr2=0x7fe054068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 0x7fe054068d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0580aa000 tx=0x7fe058000fc0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 msgr2=0x7fe068136110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe068070d40 tx=0x7fe06000ccd0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 shutdown_connections 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe054066870 0x7fe054068d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe068153030 0x7fe068136110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe068137c80 0x7fe068135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 --2- 172.21.15.91:0/3801190793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe050005c30 0x7fe068157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 >> 172.21.15.91:0/3801190793 conn(0x7fe0680713a0 msgr2=0x7fe06813e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:57.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 shutdown_connections 2023-12-13T22:25:57.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.681+0000 7fe06d9f5640 1 -- 172.21.15.91:0/3801190793 wait complete. 2023-12-13T22:25:57.701 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-13T22:25:57.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 Processor -- start 2023-12-13T22:25:57.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 -- start start 2023-12-13T22:25:57.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 0x7fbef8164d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef815d2a0 con 0x7fbef806b250 2023-12-13T22:25:57.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef8159f10 con 0x7fbef8153550 2023-12-13T22:25:57.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbefe84d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c2cb0 con 0x7fbef80c83c0 2023-12-13T22:25:57.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbeeffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbef806b250 0x7fbef80c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50128/0 (socket says 172.21.15.91:50128) 2023-12-13T22:25:57.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.841+0000 7fbeeffff640 1 -- 172.21.15.91:0/2462862991 learned_addr learned my addr 172.21.15.91:0/2462862991 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:25:57.844 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.845+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377352452 0 0) 0x7fbef815d2a0 con 0x7fbef806b250 2023-12-13T22:25:57.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.845+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee4003530 con 0x7fbef806b250 2023-12-13T22:25:57.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2554261760 0 0) 0x7fbee4003530 con 0x7fbef806b250 2023-12-13T22:25:57.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 msgr2=0x7fbef8164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:57.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 0x7fbef8164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 >> v1:172.21.15.152:6789/0 conn(0x7fbef8153550 legacy=0x7fbef80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef815a1f0 con 0x7fbef806b250 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fbee0001680 con 0x7fbef806b250 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 >> v1:172.21.15.91:6789/0 conn(0x7fbef806b250 legacy=0x7fbef80c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 0x7fbee4003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbee4004110 0x7fbee40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbee4004de0 0x7fbee4005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c2cb0 con 0x7fbee4004de0 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400bce0 con 0x7fbee4004110 2023-12-13T22:25:57.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.853+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400bea0 con 0x7fbef80c83c0 2023-12-13T22:25:57.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.865+0000 7fbefcdea640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbee4004de0 0x7fbee4005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:57.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.873+0000 7fbefcdea640 1 -- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 msgr2=0x7fbee4003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:57.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.873+0000 7fbefcdea640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbef80c83c0 0x7fbee4003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.873+0000 7fbefcdea640 1 -- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbee4004110 msgr2=0x7fbee40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:25:57.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.873+0000 7fbefcdea640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbee4004110 0x7fbee40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.873+0000 7fbefcdea640 1 -- 172.21.15.91:0/2462862991 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef815a1f0 con 0x7fbee4004de0 2023-12-13T22:25:57.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.877+0000 7fbefcdea640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbee4004de0 0x7fbee4005260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbef8070cb0 tx=0x7fbef001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d232cfe843177acf server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:57.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00a5c00 con 0x7fbee4004de0 2023-12-13T22:25:57.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00a5d80 con 0x7fbee4004de0 2023-12-13T22:25:57.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbef77fe640 1 -- 172.21.15.91:0/2462862991 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00ad680 con 0x7fbee4004de0 2023-12-13T22:25:57.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 -- 172.21.15.91:0/2462862991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbee4004de0 msgr2=0x7fbee4005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 --2- 172.21.15.91:0/2462862991 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbee4004de0 0x7fbee4005260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbef8070cb0 tx=0x7fbef001cbf0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefcdea640 1 -- 172.21.15.91:0/2462862991 reap_dead start 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 -- 172.21.15.91:0/2462862991 shutdown_connections 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 -- 172.21.15.91:0/2462862991 >> 172.21.15.91:0/2462862991 conn(0x7fbef80713a0 msgr2=0x7fbef80717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 -- 172.21.15.91:0/2462862991 shutdown_connections 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.881+0000 7fbefe84d640 1 -- 172.21.15.91:0/2462862991 wait complete. 2023-12-13T22:25:57.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 Processor -- start 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 -- start start 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbee4004de0 0x7fbef814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbef8158ff0 0x7fbef8146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81f2240 con 0x7fbef8148770 2023-12-13T22:25:57.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815c1f0 con 0x7fbef8158ff0 2023-12-13T22:25:57.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.885+0000 7fbefe84d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815c440 con 0x7fbee4004de0 2023-12-13T22:25:57.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.889+0000 7fbefcdea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:57.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.889+0000 7fbefcdea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38882/0 (socket says 172.21.15.91:38882) 2023-12-13T22:25:57.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.889+0000 7fbefcdea640 1 -- 172.21.15.91:0/3247145198 learned_addr learned my addr 172.21.15.91:0/3247145198 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:25:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 -- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbee4004de0 msgr2=0x7fbef814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbee4004de0 0x7fbef814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 -- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbef8158ff0 msgr2=0x7fbef8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:25:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbef8158ff0 0x7fbef8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:25:57.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 -- 172.21.15.91:0/3247145198 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef81f1f60 con 0x7fbef8148770 2023-12-13T22:25:57.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.893+0000 7fbefcdea640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbef001d490 tx=0x7fbee4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00a5c10 con 0x7fbef8148770 2023-12-13T22:25:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef00adbb0 con 0x7fbef8148770 2023-12-13T22:25:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00b7410 con 0x7fbef8148770 2023-12-13T22:25:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8145da0 con 0x7fbef8148770 2023-12-13T22:25:57.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8146360 con 0x7fbef8148770 2023-12-13T22:25:57.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.897+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8145c00 con 0x7fbef8148770 2023-12-13T22:25:57.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.921+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbef00b4070 con 0x7fbef8148770 2023-12-13T22:25:57.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.921+0000 7fbef57fa640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 0x7fbed8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:25:57.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.921+0000 7fbef7fff640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 0x7fbed8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:25:57.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:57.921+0000 7fbef7fff640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 0x7fbed8068d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007fd0 tx=0x7fbee80079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:25:58.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:58.197+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbef00ef4a0 con 0x7fbef8148770 2023-12-13T22:25:58.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:58.197+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbef00eb750 con 0x7fbef8148770 2023-12-13T22:25:58.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:25:58.397+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbef8145c00 con 0x7fbef8148770 2023-12-13T22:25:59.128 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:25:59.130 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:26:00.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.037+0000 7fbef57fa640 1 -- 172.21.15.91:0/3247145198 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v5) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbef8145c00 con 0x7fbef8148770 2023-12-13T22:26:00.036 INFO:teuthology.orchestra.run.smithi091.stderr:new fs with metadata pool 2 and data pool 3 2023-12-13T22:26:00.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 msgr2=0x7fbed8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 0x7fbed8068d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007fd0 tx=0x7fbee80079a0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 msgr2=0x7fbef8146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbef001d490 tx=0x7fbee4005800 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 shutdown_connections 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbed8066840 0x7fbed8068d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbef8148770 0x7fbef8146dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbef8158ff0 0x7fbef8146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 --2- 172.21.15.91:0/3247145198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbee4004de0 0x7fbef814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 >> 172.21.15.91:0/3247145198 conn(0x7fbef80713a0 msgr2=0x7fbef80c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 shutdown_connections 2023-12-13T22:26:00.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.041+0000 7fbefe84d640 1 -- 172.21.15.91:0/3247145198 wait complete. 2023-12-13T22:26:00.056 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-13T22:26:00.056 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-13T22:26:00.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 Processor -- start 2023-12-13T22:26:00.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 -- start start 2023-12-13T22:26:00.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1a800cd210 0x7f1a8006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1a800cd5f0 0x7f1a80153210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015a350 con 0x7f1a800cc4b0 2023-12-13T22:26:00.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a801594f0 con 0x7f1a800cd210 2023-12-13T22:26:00.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.185+0000 7f1a852ae640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a801597d0 con 0x7f1a800cd5f0 2023-12-13T22:26:00.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.193+0000 7f1a7effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1a800cd210 0x7f1a8006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:00.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.193+0000 7f1a7effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1a800cd210 0x7f1a8006fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43344/0 (socket says 172.21.15.91:43344) 2023-12-13T22:26:00.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.193+0000 7f1a7effd640 1 -- 172.21.15.91:0/994855758 learned_addr learned my addr 172.21.15.91:0/994855758 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:00.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.205+0000 7f1a7effd640 1 -- 172.21.15.91:0/994855758 >> v2:172.21.15.152:3300/0 conn(0x7f1a800cd5f0 msgr2=0x7f1a80153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:00.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.205+0000 7f1a7effd640 1 --2- 172.21.15.91:0/994855758 >> v2:172.21.15.152:3300/0 conn(0x7f1a800cd5f0 0x7f1a80153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.205+0000 7f1a7effd640 1 -- 172.21.15.91:0/994855758 >> v1:172.21.15.91:6789/0 conn(0x7f1a800cc4b0 legacy=0x7f1a8015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.205+0000 7f1a7effd640 1 -- 172.21.15.91:0/994855758 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80159ab0 con 0x7f1a800cd210 2023-12-13T22:26:00.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.213+0000 7f1a7effd640 1 --2- 172.21.15.91:0/994855758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cd210 0x7f1a8006fae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006ed50 tx=0x7f1a7001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f42fbb830629a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a7dffb640 1 -- 172.21.15.91:0/994855758 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700a89f0 con 0x7f1a800cd210 2023-12-13T22:26:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a7dffb640 1 -- 172.21.15.91:0/994855758 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700a8b50 con 0x7f1a800cd210 2023-12-13T22:26:00.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a7dffb640 1 -- 172.21.15.91:0/994855758 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700b0440 con 0x7f1a800cd210 2023-12-13T22:26:00.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 -- 172.21.15.91:0/994855758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cd210 msgr2=0x7f1a8006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 --2- 172.21.15.91:0/994855758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cd210 0x7f1a8006fae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006ed50 tx=0x7f1a7001ecf0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 -- 172.21.15.91:0/994855758 shutdown_connections 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 --2- 172.21.15.91:0/994855758 >> v2:172.21.15.152:3300/0 conn(0x7f1a800cd5f0 0x7f1a80153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 --2- 172.21.15.91:0/994855758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cd210 0x7f1a8006fae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 -- 172.21.15.91:0/994855758 >> 172.21.15.91:0/994855758 conn(0x7f1a80061400 msgr2=0x7f1a80061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 -- 172.21.15.91:0/994855758 shutdown_connections 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.225+0000 7f1a852ae640 1 -- 172.21.15.91:0/994855758 wait complete. 2023-12-13T22:26:00.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 Processor -- start 2023-12-13T22:26:00.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 -- start start 2023-12-13T22:26:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a800cd210 0x7f1a800c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1a800cd5f0 0x7f1a8014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c6720 con 0x7f1a800cc4b0 2023-12-13T22:26:00.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801572f0 con 0x7f1a800cd210 2023-12-13T22:26:00.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a852ae640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c9fc0 con 0x7f1a800cd5f0 2023-12-13T22:26:00.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a7effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:00.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a7effd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43354/0 (socket says 172.21.15.91:43354) 2023-12-13T22:26:00.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a7effd640 1 -- 172.21.15.91:0/2186878025 learned_addr learned my addr 172.21.15.91:0/2186878025 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:00.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.229+0000 7f1a7f7fe640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1a800cd5f0 0x7f1a8014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:00.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.233+0000 7f1a7effd640 1 -- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1a800cd5f0 msgr2=0x7f1a8014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.233+0000 7f1a7effd640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1a800cd5f0 0x7f1a8014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.233+0000 7f1a7effd640 1 -- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a800cd210 msgr2=0x7f1a800c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:00.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.233+0000 7f1a7effd640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a800cd210 0x7f1a800c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:00.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.233+0000 7f1a7effd640 1 -- 172.21.15.91:0/2186878025 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700094d0 con 0x7f1a800cc4b0 2023-12-13T22:26:00.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.241+0000 7f1a7effd640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a700b3040 tx=0x7f1a7001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:00.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.397+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700b0e00 con 0x7f1a800cc4b0 2023-12-13T22:26:00.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.397+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700bb470 con 0x7f1a800cc4b0 2023-12-13T22:26:00.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.397+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700bb820 con 0x7f1a800cc4b0 2023-12-13T22:26:00.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.397+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a800c6950 con 0x7f1a800cc4b0 2023-12-13T22:26:00.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.397+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800c5700 con 0x7f1a800cc4b0 2023-12-13T22:26:00.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.405+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80073e70 con 0x7f1a800cc4b0 2023-12-13T22:26:00.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.937+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1a700b7070 con 0x7f1a800cc4b0 2023-12-13T22:26:00.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.937+0000 7f1a677fe640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 0x7f1a6c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:00.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.937+0000 7f1a7e7fc640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 0x7f1a6c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:00.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.937+0000 7f1a7e7fc640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 0x7f1a6c068d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006c800 tx=0x7f1a74006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:00.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.973+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a700f4590 con 0x7f1a800cc4b0 2023-12-13T22:26:00.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:00.973+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1a700f01d0 con 0x7f1a800cc4b0 2023-12-13T22:26:01.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.177+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f1a801560b0 con 0x7f1a800cc4b0 2023-12-13T22:26:01.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.609+0000 7f1a677fe640 1 -- 172.21.15.91:0/2186878025 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1a700b5020 con 0x7f1a800cc4b0 2023-12-13T22:26:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 msgr2=0x7f1a6c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 0x7f1a6c068d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006c800 tx=0x7f1a74006c00 comp rx=0 tx=0).stop 2023-12-13T22:26:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 msgr2=0x7f1a800c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1a700b3040 tx=0x7f1a7001ba90 comp rx=0 tx=0).stop 2023-12-13T22:26:01.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 shutdown_connections 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1a6c066840 0x7f1a6c068d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1a800cd5f0 0x7f1a8014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a800cd210 0x7f1a800c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 --2- 172.21.15.91:0/2186878025 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1a800cc4b0 0x7f1a800c3e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 >> 172.21.15.91:0/2186878025 conn(0x7f1a80061400 msgr2=0x7f1a8006b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 shutdown_connections 2023-12-13T22:26:01.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.613+0000 7f1a852ae640 1 -- 172.21.15.91:0/2186878025 wait complete. 2023-12-13T22:26:01.631 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-13T22:26:01.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 Processor -- start 2023-12-13T22:26:01.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 -- start start 2023-12-13T22:26:01.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8458151340 0x7f845806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8458151720 0x7f8458157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84580c40e0 0x7f84580c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8458072570 con 0x7f8458151340 2023-12-13T22:26:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845806f4a0 con 0x7f84580c40e0 2023-12-13T22:26:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.773+0000 7f845ffea640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8458070be0 con 0x7f8458151720 2023-12-13T22:26:01.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8458151340 0x7f845806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8458151340 0x7f845806ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43370/0 (socket says 172.21.15.91:43370) 2023-12-13T22:26:01.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845e587640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84580c40e0 0x7f84580c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 -- 172.21.15.91:0/3634963848 learned_addr learned my addr 172.21.15.91:0/3634963848 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:01.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845d585640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8458151720 0x7f8458157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 -- 172.21.15.91:0/3634963848 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8458151720 msgr2=0x7f8458157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:01.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8458151720 0x7f8458157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 -- 172.21.15.91:0/3634963848 >> v2:172.21.15.152:3300/0 conn(0x7f84580c40e0 msgr2=0x7f84580c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:01.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 --2- 172.21.15.91:0/3634963848 >> v2:172.21.15.152:3300/0 conn(0x7f84580c40e0 0x7f84580c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.777+0000 7f845dd86640 1 -- 172.21.15.91:0/3634963848 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458158190 con 0x7f8458151340 2023-12-13T22:26:01.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.781+0000 7f845dd86640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f845806ee10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f845806d6a0 tx=0x7f845401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf7e31c78e1042b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:01.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845cd84640 1 -- 172.21.15.91:0/3634963848 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540ac600 con 0x7f8458151340 2023-12-13T22:26:01.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845cd84640 1 -- 172.21.15.91:0/3634963848 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540a8050 con 0x7f8458151340 2023-12-13T22:26:01.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845cd84640 1 -- 172.21.15.91:0/3634963848 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540ac980 con 0x7f8458151340 2023-12-13T22:26:01.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 -- 172.21.15.91:0/3634963848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 msgr2=0x7f845806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:01.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f845806ee10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f845806d6a0 tx=0x7f845401c4d0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 -- 172.21.15.91:0/3634963848 shutdown_connections 2023-12-13T22:26:01.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 --2- 172.21.15.91:0/3634963848 >> v2:172.21.15.152:3300/0 conn(0x7f84580c40e0 0x7f84580c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8458151720 0x7f8458157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 --2- 172.21.15.91:0/3634963848 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f845806ee10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.785+0000 7f845ffea640 1 -- 172.21.15.91:0/3634963848 >> 172.21.15.91:0/3634963848 conn(0x7f845806c6a0 msgr2=0x7f845806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:01.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- 172.21.15.91:0/3634963848 shutdown_connections 2023-12-13T22:26:01.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- 172.21.15.91:0/3634963848 wait complete. 2023-12-13T22:26:01.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 Processor -- start 2023-12-13T22:26:01.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- start start 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f84580c40e0 0x7f8458142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8458151720 0x7f84581420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845814e700 con 0x7f8458151340 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845814eff0 con 0x7f8458151720 2023-12-13T22:26:01.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845ffea640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845814b6e0 con 0x7f84580c40e0 2023-12-13T22:26:01.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845d585640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845d585640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43376/0 (socket says 172.21.15.91:43376) 2023-12-13T22:26:01.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845d585640 1 -- 172.21.15.91:0/2102997594 learned_addr learned my addr 172.21.15.91:0/2102997594 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:01.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.789+0000 7f845dd86640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f84580c40e0 0x7f8458142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.793+0000 7f845e587640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8458151720 0x7f84581420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:01.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.797+0000 7f845d585640 1 -- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f84580c40e0 msgr2=0x7f8458142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:01.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.797+0000 7f845d585640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f84580c40e0 0x7f8458142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.797+0000 7f845d585640 1 -- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8458151720 msgr2=0x7f84581420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:01.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.797+0000 7f845d585640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8458151720 0x7f84581420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:01.794 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.797+0000 7f845d585640 1 -- 172.21.15.91:0/2102997594 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540094d0 con 0x7f8458151340 2023-12-13T22:26:01.797 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.801+0000 7f845d585640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f844800c820 tx=0x7f844800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:01.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.805+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448004220 con 0x7f8458151340 2023-12-13T22:26:01.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.805+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84480043a0 con 0x7f8458151340 2023-12-13T22:26:01.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.805+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448004510 con 0x7f8458151340 2023-12-13T22:26:01.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.805+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84581f5ba0 con 0x7f8458151340 2023-12-13T22:26:01.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.805+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845814bc10 con 0x7f8458151340 2023-12-13T22:26:01.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:01.809+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8458067520 con 0x7f8458151340 2023-12-13T22:26:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.065+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8448007a10 con 0x7f8458151340 2023-12-13T22:26:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.065+0000 7f844e7fc640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 0x7f843c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:02.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.069+0000 7f845dd86640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 0x7f843c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:02.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.069+0000 7f845dd86640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 0x7f843c068d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84540ae000 tx=0x7f8454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:02.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.093+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f8448055210 con 0x7f8458151340 2023-12-13T22:26:02.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.097+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8448051550 con 0x7f8458151340 2023-12-13T22:26:02.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:02.261+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8458143490 con 0x7f8458151340 2023-12-13T22:26:04.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.361+0000 7f844e7fc640 1 -- 172.21.15.91:0/2102997594 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f844801e020 con 0x7f8458151340 2023-12-13T22:26:04.361 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data_ec' created 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 msgr2=0x7f843c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 0x7f843c068d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f84540ae000 tx=0x7f8454008040 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 msgr2=0x7f8458148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f844800c820 tx=0x7f844800cce0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 shutdown_connections 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f843c066840 0x7f843c068d00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8458151720 0x7f84581420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8458151340 0x7f8458148e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 --2- 172.21.15.91:0/2102997594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f84580c40e0 0x7f8458142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 >> 172.21.15.91:0/2102997594 conn(0x7f845806c6a0 msgr2=0x7f845814db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:04.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 shutdown_connections 2023-12-13T22:26:04.365 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.365+0000 7f845ffea640 1 -- 172.21.15.91:0/2102997594 wait complete. 2023-12-13T22:26:04.385 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-13T22:26:04.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 Processor -- start 2023-12-13T22:26:04.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 -- start start 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc14f850 0x7f19bc0c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19bc0c1ed0 0x7f19bc06e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0c3b10 con 0x7f19bc070ab0 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc14fc30 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.513+0000 7f19c354c640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0c11e0 con 0x7f19bc14f850 2023-12-13T22:26:04.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19bc0c1ed0 0x7f19bc06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:04.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19bc0c1ed0 0x7f19bc06e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43390/0 (socket says 172.21.15.91:43390) 2023-12-13T22:26:04.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 -- 172.21.15.91:0/2365689689 learned_addr learned my addr 172.21.15.91:0/2365689689 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 -- 172.21.15.91:0/2365689689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc14f850 msgr2=0x7f19bc0c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 --2- 172.21.15.91:0/2365689689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc14f850 0x7f19bc0c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 -- 172.21.15.91:0/2365689689 >> v1:172.21.15.152:6789/0 conn(0x7f19bc070ab0 legacy=0x7f19bc158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.517+0000 7f19c0ae7640 1 -- 172.21.15.91:0/2365689689 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0c2410 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.521+0000 7f19c0ae7640 1 --2- 172.21.15.91:0/2365689689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c1ed0 0x7f19bc06e530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009870 tx=0x7f19ac01d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec28be771d655cf server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:04.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19b3fff640 1 -- 172.21.15.91:0/2365689689 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0ab620 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19b3fff640 1 -- 172.21.15.91:0/2365689689 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0ab780 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19b3fff640 1 -- 172.21.15.91:0/2365689689 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0abb10 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 -- 172.21.15.91:0/2365689689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c1ed0 msgr2=0x7f19bc06e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 --2- 172.21.15.91:0/2365689689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c1ed0 0x7f19bc06e530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009870 tx=0x7f19ac01d5e0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 -- 172.21.15.91:0/2365689689 shutdown_connections 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 --2- 172.21.15.91:0/2365689689 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc0c1ed0 0x7f19bc06e530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 --2- 172.21.15.91:0/2365689689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc14f850 0x7f19bc0c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 -- 172.21.15.91:0/2365689689 >> 172.21.15.91:0/2365689689 conn(0x7f19bc06c6a0 msgr2=0x7f19bc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 -- 172.21.15.91:0/2365689689 shutdown_connections 2023-12-13T22:26:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.525+0000 7f19c354c640 1 -- 172.21.15.91:0/2365689689 wait complete. 2023-12-13T22:26:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 Processor -- start 2023-12-13T22:26:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 -- start start 2023-12-13T22:26:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc0c1ed0 0x7f19bc1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19bc14f850 0x7f19bc1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0c0ff0 con 0x7f19bc070ab0 2023-12-13T22:26:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0c0ac0 con 0x7f19bc14f850 2023-12-13T22:26:04.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.529+0000 7f19c354c640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1f7670 con 0x7f19bc0c1ed0 2023-12-13T22:26:04.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.533+0000 7f19c12e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:04.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.533+0000 7f19c12e8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43396/0 (socket says 172.21.15.91:43396) 2023-12-13T22:26:04.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.533+0000 7f19c12e8640 1 -- 172.21.15.91:0/411189877 learned_addr learned my addr 172.21.15.91:0/411189877 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 -- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc0c1ed0 msgr2=0x7f19bc1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc0c1ed0 0x7f19bc1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 -- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19bc14f850 msgr2=0x7f19bc1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19bc14f850 0x7f19bc1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 -- 172.21.15.91:0/411189877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0094d0 con 0x7f19bc070ab0 2023-12-13T22:26:04.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.537+0000 7f19c12e8640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19b800b5b0 tx=0x7f19b800ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8010890 con 0x7f19bc070ab0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8010a10 con 0x7f19bc070ab0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc145ab0 con 0x7f19bc070ab0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8010dc0 con 0x7f19bc070ab0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc1f7300 con 0x7f19bc070ab0 2023-12-13T22:26:04.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.545+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc1f7160 con 0x7f19bc070ab0 2023-12-13T22:26:04.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.825+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f19b8023480 con 0x7f19bc070ab0 2023-12-13T22:26:04.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.825+0000 7f19b1ffb640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 0x7f19a0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:04.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.825+0000 7f19c0ae7640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 0x7f19a0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:04.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.825+0000 7f19c0ae7640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 0x7f19a0068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0af000 tx=0x7f19ac004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:04.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.845+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f19b8055a80 con 0x7f19bc070ab0 2023-12-13T22:26:04.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:04.845+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f19b80516c0 con 0x7f19bc070ab0 2023-12-13T22:26:05.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.013+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f19bc1f7160 con 0x7f19bc070ab0 2023-12-13T22:26:05.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19b1ffb640 1 -- 172.21.15.91:0/411189877 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f19bc1f7160 con 0x7f19bc070ab0 2023-12-13T22:26:05.666 INFO:teuthology.orchestra.run.smithi091.stderr:set pool 4 allow_ec_overwrites to true 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 msgr2=0x7f19a0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 0x7f19a0068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0af000 tx=0x7f19ac004740 comp rx=0 tx=0).stop 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 msgr2=0x7f19bc0bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19b800b5b0 tx=0x7f19b800ba70 comp rx=0 tx=0).stop 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 shutdown_connections 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f19a0066840 0x7f19a0068d00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19bc14f850 0x7f19bc1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19bc0c1ed0 0x7f19bc1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 --2- 172.21.15.91:0/411189877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19bc070ab0 0x7f19bc0bf9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 >> 172.21.15.91:0/411189877 conn(0x7f19bc06c6a0 msgr2=0x7f19bc0c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:05.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 shutdown_connections 2023-12-13T22:26:05.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.669+0000 7f19c354c640 1 -- 172.21.15.91:0/411189877 wait complete. 2023-12-13T22:26:05.690 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-13T22:26:05.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 Processor -- start 2023-12-13T22:26:05.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 -- start start 2023-12-13T22:26:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb164151720 0x7fb16406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16406f4a0 con 0x7fb164151340 2023-12-13T22:26:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb164070be0 con 0x7fb1640c40e0 2023-12-13T22:26:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb16a79e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb164072570 con 0x7fb164151720 2023-12-13T22:26:05.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.817+0000 7fb1637fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb164151720 0x7fb16406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.821+0000 7fb1637fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb164151720 0x7fb16406ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43404/0 (socket says 172.21.15.91:43404) 2023-12-13T22:26:05.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.821+0000 7fb1637fe640 1 -- 172.21.15.91:0/3550032758 learned_addr learned my addr 172.21.15.91:0/3550032758 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.821+0000 7fb1637fe640 1 -- 172.21.15.91:0/3550032758 >> v1:172.21.15.152:6789/0 conn(0x7fb1640c40e0 legacy=0x7fb1640c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.821+0000 7fb1637fe640 1 -- 172.21.15.91:0/3550032758 >> v1:172.21.15.91:6789/0 conn(0x7fb164151340 legacy=0x7fb164157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.821+0000 7fb1637fe640 1 -- 172.21.15.91:0/3550032758 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164070e80 con 0x7fb164151720 2023-12-13T22:26:05.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.825+0000 7fb1637fe640 1 --2- 172.21.15.91:0/3550032758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb164151720 0x7fb16406ee10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5418ff371b7126 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.829+0000 7fb162ffd640 1 -- 172.21.15.91:0/3550032758 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580aa650 con 0x7fb164151720 2023-12-13T22:26:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb162ffd640 1 -- 172.21.15.91:0/3550032758 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1580aa7b0 con 0x7fb164151720 2023-12-13T22:26:05.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb162ffd640 1 -- 172.21.15.91:0/3550032758 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580aab40 con 0x7fb164151720 2023-12-13T22:26:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- 172.21.15.91:0/3550032758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb164151720 msgr2=0x7fb16406ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 --2- 172.21.15.91:0/3550032758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb164151720 0x7fb16406ee10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb158009870 tx=0x7fb15801c4d0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- 172.21.15.91:0/3550032758 shutdown_connections 2023-12-13T22:26:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 --2- 172.21.15.91:0/3550032758 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb164151720 0x7fb16406ee10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- 172.21.15.91:0/3550032758 >> 172.21.15.91:0/3550032758 conn(0x7fb16406c6a0 msgr2=0x7fb16406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- 172.21.15.91:0/3550032758 shutdown_connections 2023-12-13T22:26:05.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- 172.21.15.91:0/3550032758 wait complete. 2023-12-13T22:26:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 Processor -- start 2023-12-13T22:26:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- start start 2023-12-13T22:26:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb164151340 0x7fb16414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:05.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb16414a780 0x7fb1641f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16414e650 con 0x7fb1640c40e0 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1641f15c0 con 0x7fb164151340 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb16a79e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16414a2f0 con 0x7fb16414a780 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb163fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb163fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43418/0 (socket says 172.21.15.91:43418) 2023-12-13T22:26:05.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.833+0000 7fb163fff640 1 -- 172.21.15.91:0/1764860630 learned_addr learned my addr 172.21.15.91:0/1764860630 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:05.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.837+0000 7fb163fff640 1 -- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb16414a780 msgr2=0x7fb1641f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.837+0000 7fb163fff640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb16414a780 0x7fb1641f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.837+0000 7fb163fff640 1 -- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb164151340 msgr2=0x7fb16414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.837+0000 7fb163fff640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb164151340 0x7fb16414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:05.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.837+0000 7fb163fff640 1 -- 172.21.15.91:0/1764860630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580094d0 con 0x7fb1640c40e0 2023-12-13T22:26:05.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.841+0000 7fb163fff640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c3c0 tx=0x7fb15400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1540052d0 con 0x7fb1640c40e0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154005430 con 0x7fb1640c40e0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16414b5a0 con 0x7fb1640c40e0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154003840 con 0x7fb1640c40e0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb164149ca0 con 0x7fb1640c40e0 2023-12-13T22:26:05.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.845+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164149b00 con 0x7fb1640c40e0 2023-12-13T22:26:05.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.865+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb1540039a0 con 0x7fb1640c40e0 2023-12-13T22:26:05.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.865+0000 7fb160ff9640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 0x7fb150068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:05.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.865+0000 7fb1637fe640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 0x7fb150068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:05.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.865+0000 7fb1637fe640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 0x7fb150068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1580ae000 tx=0x7fb158008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:05.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:05.941+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb154054d30 con 0x7fb1640c40e0 2023-12-13T22:26:06.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:06.205+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb154050970 con 0x7fb1640c40e0 2023-12-13T22:26:06.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:06.397+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb164149b00 con 0x7fb1640c40e0 2023-12-13T22:26:07.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.257+0000 7fb160ff9640 1 -- 172.21.15.91:0/1764860630 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v8) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb164149b00 con 0x7fb1640c40e0 2023-12-13T22:26:07.255 INFO:teuthology.orchestra.run.smithi091.stderr:added data pool 4 to fsmap 2023-12-13T22:26:07.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 msgr2=0x7fb150068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 0x7fb150068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1580ae000 tx=0x7fb158008040 comp rx=0 tx=0).stop 2023-12-13T22:26:07.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 msgr2=0x7fb16414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c3c0 tx=0x7fb15400c880 comp rx=0 tx=0).stop 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 shutdown_connections 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb150066840 0x7fb150068d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb16414a780 0x7fb1641f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb164151340 0x7fb16414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 --2- 172.21.15.91:0/1764860630 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb1640c40e0 0x7fb16414af80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 >> 172.21.15.91:0/1764860630 conn(0x7fb16406c6a0 msgr2=0x7fb1640c7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 shutdown_connections 2023-12-13T22:26:07.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.261+0000 7fb16a79e640 1 -- 172.21.15.91:0/1764860630 wait complete. 2023-12-13T22:26:07.278 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:26:07.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.393+0000 7f52beeaf640 1 Processor -- start 2023-12-13T22:26:07.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52beeaf640 1 -- start start 2023-12-13T22:26:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52beeaf640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 0x7f52b80c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52beeaf640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b80c72b0 con 0x7f52b80c4630 2023-12-13T22:26:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52beeaf640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b815a100 con 0x7f52b80c4a10 2023-12-13T22:26:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52beeaf640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80c4f40 con 0x7f52b81505a0 2023-12-13T22:26:07.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52b7fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f52b80c4a10 0x7f52b814fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:41456/0 (socket says 172.21.15.91:41456) 2023-12-13T22:26:07.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.397+0000 7f52b7fff640 1 -- 172.21.15.91:0/2461413713 learned_addr learned my addr 172.21.15.91:0/2461413713 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:07.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.401+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743590663 0 0) 0x7f52b80c72b0 con 0x7f52b80c4630 2023-12-13T22:26:07.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.401+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a8003530 con 0x7f52b80c4630 2023-12-13T22:26:07.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879819478 0 0) 0x7f52b815a100 con 0x7f52b80c4a10 2023-12-13T22:26:07.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b80c72b0 con 0x7f52b80c4a10 2023-12-13T22:26:07.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913077782 0 0) 0x7f52a8003530 con 0x7f52b80c4630 2023-12-13T22:26:07.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 msgr2=0x7f52b80c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 0x7f52b80c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 >> v1:172.21.15.152:6789/0 conn(0x7f52b80c4a10 legacy=0x7f52b814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b815a3e0 con 0x7f52b80c4630 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f52ac001680 con 0x7f52b80c4630 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 >> v1:172.21.15.91:6789/0 conn(0x7f52b80c4630 legacy=0x7f52b81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52a8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a80047d0 0x7f52a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 0x7f52a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8005510 con 0x7f52a8003bb0 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8005680 con 0x7f52a80047d0 2023-12-13T22:26:07.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.405+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a800bf50 con 0x7f52b81505a0 2023-12-13T22:26:07.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.409+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52a8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:07.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.413+0000 7f52bcc4b640 1 -- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 msgr2=0x7f52a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:07.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.413+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b81505a0 0x7f52a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.413+0000 7f52bcc4b640 1 -- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a80047d0 msgr2=0x7f52a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:07.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.413+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a80047d0 0x7f52a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.413+0000 7f52bcc4b640 1 -- 172.21.15.91:0/2461413713 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8003530 con 0x7f52a8003bb0 2023-12-13T22:26:07.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.417+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52a8003fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52ac007f90 tx=0x7f52ac01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe16308c4d45c4e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:07.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0a5910 con 0x7f52a8003bb0 2023-12-13T22:26:07.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac0a5a90 con 0x7f52a8003bb0 2023-12-13T22:26:07.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52b77fe640 1 -- 172.21.15.91:0/2461413713 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0a5e40 con 0x7f52a8003bb0 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 -- 172.21.15.91:0/2461413713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 msgr2=0x7f52a8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 --2- 172.21.15.91:0/2461413713 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52a8003fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52ac007f90 tx=0x7f52ac01cb00 comp rx=0 tx=0).stop 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52bd44c640 1 -- 172.21.15.91:0/2461413713 reap_dead start 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 -- 172.21.15.91:0/2461413713 shutdown_connections 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 -- 172.21.15.91:0/2461413713 >> 172.21.15.91:0/2461413713 conn(0x7f52b806c6a0 msgr2=0x7f52b806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 -- 172.21.15.91:0/2461413713 shutdown_connections 2023-12-13T22:26:07.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.421+0000 7f52beeaf640 1 -- 172.21.15.91:0/2461413713 wait complete. 2023-12-13T22:26:07.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 Processor -- start 2023-12-13T22:26:07.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 -- start start 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b8154d10 0x7f52b8135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b8136240 0x7f52b80c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8136b40 con 0x7f52a8003bb0 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b81594f0 con 0x7f52b8136240 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52beeaf640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8150f80 con 0x7f52b8154d10 2023-12-13T22:26:07.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52bcc4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:07.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52bcc4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43434/0 (socket says 172.21.15.91:43434) 2023-12-13T22:26:07.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52bcc4b640 1 -- 172.21.15.91:0/333777812 learned_addr learned my addr 172.21.15.91:0/333777812 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:07.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.425+0000 7f52b7fff640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b8154d10 0x7f52b8135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:07.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 -- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b8154d10 msgr2=0x7f52b8135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b8154d10 0x7f52b8135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 -- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b8136240 msgr2=0x7f52b80c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:07.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b8136240 0x7f52b80c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:07.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 -- 172.21.15.91:0/333777812 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b81576d0 con 0x7f52a8003bb0 2023-12-13T22:26:07.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.429+0000 7f52bcc4b640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0018c0 tx=0x7f52a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.433+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac003600 con 0x7f52a8003bb0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.433+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac003760 con 0x7f52a8003bb0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.433+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b81579b0 con 0x7f52a8003bb0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.433+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac003af0 con 0x7f52a8003bb0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.433+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8157f70 con 0x7f52a8003bb0 2023-12-13T22:26:07.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.437+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b8067520 con 0x7f52a8003bb0 2023-12-13T22:26:07.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.721+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f52ac0b4040 con 0x7f52a8003bb0 2023-12-13T22:26:07.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.721+0000 7f52b57fa640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 0x7f529c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:07.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.721+0000 7f52b7fff640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 0x7f529c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:07.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.725+0000 7f52b7fff640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 0x7f529c068d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52a400afd0 tx=0x7f52a400ade0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:07.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.753+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52ac0f01d0 con 0x7f52a8003bb0 2023-12-13T22:26:07.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.753+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f52ac0ec480 con 0x7f52a8003bb0 2023-12-13T22:26:07.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:07.949+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52b8067520 con 0x7f52a8003bb0 2023-12-13T22:26:08.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.041+0000 7f52b57fa640 1 -- 172.21.15.91:0/333777812 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6492 (secure 0 0 0) 0x7f52ac0b2030 con 0x7f52a8003bb0 2023-12-13T22:26:08.041 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:08.041 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:06.437985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-13T22:26:08.042 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 msgr2=0x7f529c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 0x7f529c068d30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52a400afd0 tx=0x7f52a400ade0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 msgr2=0x7f52b8158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0018c0 tx=0x7f52a8005800 comp rx=0 tx=0).stop 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 shutdown_connections 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f529c066870 0x7f529c068d30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b8136240 0x7f52b80c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52b8154d10 0x7f52b8135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 --2- 172.21.15.91:0/333777812 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52a8003bb0 0x7f52b8158a50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 >> 172.21.15.91:0/333777812 conn(0x7f52b806c6a0 msgr2=0x7f52b80c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:08.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 shutdown_connections 2023-12-13T22:26:08.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.045+0000 7f52beeaf640 1 -- 172.21.15.91:0/333777812 wait complete. 2023-12-13T22:26:08.066 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:08.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 Processor -- start 2023-12-13T22:26:08.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 -- start start 2023-12-13T22:26:08.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 0x7f610c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0c2440 con 0x7f610c0cbce0 2023-12-13T22:26:08.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0c2720 con 0x7f610c0cc0c0 2023-12-13T22:26:08.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.193+0000 7f6114107640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0c2a00 con 0x7f610c0c65f0 2023-12-13T22:26:08.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.245+0000 7f6111ea3640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f610c0cbce0 0x7f610c072550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:55664/0 (socket says 172.21.15.91:55664) 2023-12-13T22:26:08.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.245+0000 7f6111ea3640 1 -- 172.21.15.91:0/476838929 learned_addr learned my addr 172.21.15.91:0/476838929 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:08.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.249+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377856258 0 0) 0x7f610c0c2440 con 0x7f610c0cbce0 2023-12-13T22:26:08.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.249+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f8003530 con 0x7f610c0cbce0 2023-12-13T22:26:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2133934005 0 0) 0x7f60f8003530 con 0x7f610c0cbce0 2023-12-13T22:26:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 msgr2=0x7f610c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 0x7f610c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 >> v1:172.21.15.152:6789/0 conn(0x7f610c0cc0c0 legacy=0x7f610c153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:08.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c159570 con 0x7f610c0cbce0 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f6108001680 con 0x7f610c0cbce0 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 >> v1:172.21.15.91:6789/0 conn(0x7f610c0cbce0 legacy=0x7f610c072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 0x7f60f8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f8004160 0x7f60f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f60f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0c2a00 con 0x7f60f8004e30 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8005640 con 0x7f60f8004160 2023-12-13T22:26:08.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.257+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f800bf00 con 0x7f610c0c65f0 2023-12-13T22:26:08.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.261+0000 7f61126a4640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f60f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:08.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.269+0000 7f61126a4640 1 -- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 msgr2=0x7f60f8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:08.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.269+0000 7f61126a4640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c0c65f0 0x7f60f8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.269+0000 7f61126a4640 1 -- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f8004160 msgr2=0x7f60f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:08.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.269+0000 7f61126a4640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60f8004160 0x7f60f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.267 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.269+0000 7f61126a4640 1 -- 172.21.15.91:0/476838929 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8003530 con 0x7f60f8004e30 2023-12-13T22:26:08.274 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.277+0000 7f61126a4640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f60f800b990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6104001d50 tx=0x7f610401c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7ccd0a790306c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:08.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104003ba0 con 0x7f60f8004e30 2023-12-13T22:26:08.281 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104003d00 con 0x7f60f8004e30 2023-12-13T22:26:08.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6110ea1640 1 -- 172.21.15.91:0/476838929 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040052b0 con 0x7f60f8004e30 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 -- 172.21.15.91:0/476838929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 msgr2=0x7f60f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 --2- 172.21.15.91:0/476838929 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f60f800b990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6104001d50 tx=0x7f610401c600 comp rx=0 tx=0).stop 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f61126a4640 1 -- 172.21.15.91:0/476838929 reap_dead start 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 -- 172.21.15.91:0/476838929 shutdown_connections 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 -- 172.21.15.91:0/476838929 >> 172.21.15.91:0/476838929 conn(0x7f610c070160 msgr2=0x7f610c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 -- 172.21.15.91:0/476838929 shutdown_connections 2023-12-13T22:26:08.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.285+0000 7f6114107640 1 -- 172.21.15.91:0/476838929 wait complete. 2023-12-13T22:26:08.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 Processor -- start 2023-12-13T22:26:08.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 -- start start 2023-12-13T22:26:08.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c156b70 0x7f610c158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f610c150830 0x7f610c150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b1b80 con 0x7f60f8004e30 2023-12-13T22:26:08.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b1e50 con 0x7f610c150830 2023-12-13T22:26:08.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.289+0000 7f6114107640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0ac970 con 0x7f610c156b70 2023-12-13T22:26:08.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.293+0000 7f61116a2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c156b70 0x7f610c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:08.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.293+0000 7f6111ea3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:08.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.293+0000 7f61126a4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f610c150830 0x7f610c150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:08.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.293+0000 7f6111ea3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:43448/0 (socket says 172.21.15.91:43448) 2023-12-13T22:26:08.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.293+0000 7f6111ea3640 1 -- 172.21.15.91:0/2155440218 learned_addr learned my addr 172.21.15.91:0/2155440218 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:08.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.297+0000 7f6111ea3640 1 -- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c156b70 msgr2=0x7f610c158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.297+0000 7f6111ea3640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c156b70 0x7f610c158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.297+0000 7f6111ea3640 1 -- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f610c150830 msgr2=0x7f610c150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.297+0000 7f6111ea3640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f610c150830 0x7f610c150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.297+0000 7f6111ea3640 1 -- 172.21.15.91:0/2155440218 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0acc50 con 0x7f60f8004e30 2023-12-13T22:26:08.297 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.301+0000 7f6111ea3640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6108007fd0 tx=0x7f610800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:08.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080072d0 con 0x7f60f8004e30 2023-12-13T22:26:08.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108007450 con 0x7f60f8004e30 2023-12-13T22:26:08.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108004a30 con 0x7f60f8004e30 2023-12-13T22:26:08.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c0acf30 con 0x7f60f8004e30 2023-12-13T22:26:08.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c156650 con 0x7f60f8004e30 2023-12-13T22:26:08.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.305+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c0c8370 con 0x7f60f8004e30 2023-12-13T22:26:08.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.581+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f610800a610 con 0x7f60f8004e30 2023-12-13T22:26:08.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.581+0000 7f61027fc640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 0x7f60f0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:08.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.581+0000 7f61116a2640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 0x7f60f0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:08.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.581+0000 7f61116a2640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 0x7f60f0068ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f610c159450 tx=0x7f60fc006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:08.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.621+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6108007640 con 0x7f60f8004e30 2023-12-13T22:26:08.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.633+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6108050c90 con 0x7f60f8004e30 2023-12-13T22:26:08.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.813+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f610c073e70 con 0x7f60f8004e30 2023-12-13T22:26:08.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f61027fc640 1 -- 172.21.15.91:0/2155440218 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f6108018070 con 0x7f60f8004e30 2023-12-13T22:26:08.974 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:08.974 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:08.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 msgr2=0x7f60f0068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 0x7f60f0068ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f610c159450 tx=0x7f60fc006f90 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 msgr2=0x7f610c1f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6108007fd0 tx=0x7f610800cb90 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 shutdown_connections 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f60f0066820 0x7f60f0068ce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f610c150830 0x7f610c150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f610c156b70 0x7f610c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 --2- 172.21.15.91:0/2155440218 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60f8004e30 0x7f610c1f1af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 >> 172.21.15.91:0/2155440218 conn(0x7f610c070160 msgr2=0x7f610c0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 shutdown_connections 2023-12-13T22:26:08.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:08.977+0000 7f6114107640 1 -- 172.21.15.91:0/2155440218 wait complete. 2023-12-13T22:26:08.998 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:09.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.121+0000 7f810bb85640 1 Processor -- start 2023-12-13T22:26:09.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 -- start start 2023-12-13T22:26:09.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f810414f850 0x7f81040c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81040c1ed0 0x7f810406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81040c3b10 con 0x7f8104070ab0 2023-12-13T22:26:09.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810414fc30 con 0x7f81040c1ed0 2023-12-13T22:26:09.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f810bb85640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040c11e0 con 0x7f810414f850 2023-12-13T22:26:09.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f8109120640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81040c1ed0 0x7f810406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f8109120640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f81040c1ed0 0x7f810406e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57984/0 (socket says 172.21.15.91:57984) 2023-12-13T22:26:09.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f8109120640 1 -- 172.21.15.91:0/965428176 learned_addr learned my addr 172.21.15.91:0/965428176 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:09.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.125+0000 7f8109921640 1 --2- 172.21.15.91:0/965428176 >> v2:172.21.15.152:3300/0 conn(0x7f810414f850 0x7f81040c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.129+0000 7f8109120640 1 -- 172.21.15.91:0/965428176 >> v2:172.21.15.152:3300/0 conn(0x7f810414f850 msgr2=0x7f81040c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:09.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.129+0000 7f8109120640 1 --2- 172.21.15.91:0/965428176 >> v2:172.21.15.152:3300/0 conn(0x7f810414f850 0x7f81040c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.129+0000 7f8109120640 1 -- 172.21.15.91:0/965428176 >> v1:172.21.15.152:6789/0 conn(0x7f8104070ab0 legacy=0x7f8104158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:09.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.129+0000 7f8109120640 1 -- 172.21.15.91:0/965428176 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040c2410 con 0x7f81040c1ed0 2023-12-13T22:26:09.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.129+0000 7f8109120640 1 --2- 172.21.15.91:0/965428176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81040c1ed0 0x7f810406e530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f810406f120 tx=0x7f80f401e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd95ea608471bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.133+0000 7f810891f640 1 -- 172.21.15.91:0/965428176 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004230 con 0x7f81040c1ed0 2023-12-13T22:26:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.133+0000 7f810891f640 1 -- 172.21.15.91:0/965428176 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40ab070 con 0x7f81040c1ed0 2023-12-13T22:26:09.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.133+0000 7f810891f640 1 -- 172.21.15.91:0/965428176 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40a7720 con 0x7f81040c1ed0 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- 172.21.15.91:0/965428176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81040c1ed0 msgr2=0x7f810406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- 172.21.15.91:0/965428176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81040c1ed0 0x7f810406e530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f810406f120 tx=0x7f80f401e940 comp rx=0 tx=0).stop 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- 172.21.15.91:0/965428176 shutdown_connections 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- 172.21.15.91:0/965428176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f81040c1ed0 0x7f810406e530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- 172.21.15.91:0/965428176 >> v2:172.21.15.152:3300/0 conn(0x7f810414f850 0x7f81040c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- 172.21.15.91:0/965428176 >> 172.21.15.91:0/965428176 conn(0x7f810406c6a0 msgr2=0x7f810406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- 172.21.15.91:0/965428176 shutdown_connections 2023-12-13T22:26:09.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- 172.21.15.91:0/965428176 wait complete. 2023-12-13T22:26:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 Processor -- start 2023-12-13T22:26:09.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- start start 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8104070ab0 0x7f81040c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81040c1ed0 0x7f8104157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81041577e0 con 0x7f810414f850 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8104156780 con 0x7f81040c1ed0 2023-12-13T22:26:09.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810bb85640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8104156b60 con 0x7f8104070ab0 2023-12-13T22:26:09.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810a122640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810a122640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57994/0 (socket says 172.21.15.91:57994) 2023-12-13T22:26:09.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f810a122640 1 -- 172.21.15.91:0/3841092697 learned_addr learned my addr 172.21.15.91:0/3841092697 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:09.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.137+0000 7f8109921640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8104070ab0 0x7f81040c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f8109120640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81040c1ed0 0x7f8104157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f810a122640 1 -- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8104070ab0 msgr2=0x7f81040c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f810a122640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8104070ab0 0x7f81040c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f810a122640 1 -- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81040c1ed0 msgr2=0x7f8104157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f810a122640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81040c1ed0 0x7f8104157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.141+0000 7f810a122640 1 -- 172.21.15.91:0/3841092697 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f400b780 con 0x7f810414f850 2023-12-13T22:26:09.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.153+0000 7f810a122640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b9a0 tx=0x7f80fc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00cba0 con 0x7f810414f850 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc00cd00 con 0x7f810414f850 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc014680 con 0x7f810414f850 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8104156e40 con 0x7f810414f850 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8104157400 con 0x7f810414f850 2023-12-13T22:26:09.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.161+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81041575c0 con 0x7f810414f850 2023-12-13T22:26:09.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.181+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f80fc01e440 con 0x7f810414f850 2023-12-13T22:26:09.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.181+0000 7f80fa7fc640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 0x7f80e8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.181+0000 7f8109921640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 0x7f80e8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.181+0000 7f8109921640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 0x7f80e8068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8100007a60 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.185+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80fc055050 con 0x7f810414f850 2023-12-13T22:26:09.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.441+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f80fc051390 con 0x7f810414f850 2023-12-13T22:26:09.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.605+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8104157920 con 0x7f810414f850 2023-12-13T22:26:09.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.701+0000 7f80fa7fc640 1 -- 172.21.15.91:0/3841092697 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f80fc0549b0 con 0x7f810414f850 2023-12-13T22:26:09.699 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:09.699 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.701+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 msgr2=0x7f80e8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.701+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 0x7f80e8068d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8100007a60 tx=0x7f8100008040 comp rx=0 tx=0).stop 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.701+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 msgr2=0x7f8104158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.701+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00b9a0 tx=0x7f80fc00be60 comp rx=0 tx=0).stop 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 shutdown_connections 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f80e8066870 0x7f80e8068d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f810414f850 0x7f8104158140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81040c1ed0 0x7f8104157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 --2- 172.21.15.91:0/3841092697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8104070ab0 0x7f81040c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 >> 172.21.15.91:0/3841092697 conn(0x7f810406c6a0 msgr2=0x7f81040c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:09.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 shutdown_connections 2023-12-13T22:26:09.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.705+0000 7f810bb85640 1 -- 172.21.15.91:0/3841092697 wait complete. 2023-12-13T22:26:09.738 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:26:09.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 Processor -- start 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 -- start start 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe10153870 0x7fbe100cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbe1015a1e0 0x7fbe100cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe100c9bd0 con 0x7fbe100cc3e0 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe100c9e70 con 0x7fbe1015a1e0 2023-12-13T22:26:09.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1629e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100ce140 con 0x7fbe10153870 2023-12-13T22:26:09.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1483b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbe1015a1e0 0x7fbe100cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1483b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbe1015a1e0 0x7fbe100cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57996/0 (socket says 172.21.15.91:57996) 2023-12-13T22:26:09.864 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.865+0000 7fbe1483b640 1 -- 172.21.15.91:0/2118436360 learned_addr learned my addr 172.21.15.91:0/2118436360 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.869+0000 7fbe1483b640 1 -- 172.21.15.91:0/2118436360 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe10153870 msgr2=0x7fbe100cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.869+0000 7fbe1483b640 1 --2- 172.21.15.91:0/2118436360 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe10153870 0x7fbe100cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.869+0000 7fbe1483b640 1 -- 172.21.15.91:0/2118436360 >> v1:172.21.15.91:6789/0 conn(0x7fbe100cc3e0 legacy=0x7fbe10159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.869+0000 7fbe1483b640 1 -- 172.21.15.91:0/2118436360 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100ce420 con 0x7fbe1015a1e0 2023-12-13T22:26:09.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.873+0000 7fbe1483b640 1 --2- 172.21.15.91:0/2118436360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe1015a1e0 0x7fbe100cbc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009e50 tx=0x7fbe0801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0d496f9c92729 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.877+0000 7fbe0effd640 1 -- 172.21.15.91:0/2118436360 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080af400 con 0x7fbe1015a1e0 2023-12-13T22:26:09.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.877+0000 7fbe0effd640 1 -- 172.21.15.91:0/2118436360 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe080ab050 con 0x7fbe1015a1e0 2023-12-13T22:26:09.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.877+0000 7fbe1629e640 1 -- 172.21.15.91:0/2118436360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe1015a1e0 msgr2=0x7fbe100cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.877+0000 7fbe0effd640 1 -- 172.21.15.91:0/2118436360 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080af780 con 0x7fbe1015a1e0 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.877+0000 7fbe1629e640 1 --2- 172.21.15.91:0/2118436360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe1015a1e0 0x7fbe100cbc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009e50 tx=0x7fbe0801f1f0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- 172.21.15.91:0/2118436360 shutdown_connections 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 --2- 172.21.15.91:0/2118436360 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe1015a1e0 0x7fbe100cbc20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 --2- 172.21.15.91:0/2118436360 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe10153870 0x7fbe100cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- 172.21.15.91:0/2118436360 >> 172.21.15.91:0/2118436360 conn(0x7fbe100b07e0 msgr2=0x7fbe100b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- 172.21.15.91:0/2118436360 shutdown_connections 2023-12-13T22:26:09.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- 172.21.15.91:0/2118436360 wait complete. 2023-12-13T22:26:09.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 Processor -- start 2023-12-13T22:26:09.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- start start 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe100cc3e0 0x7fbe10156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe1015a1e0 0x7fbe10153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100c5fd0 con 0x7fbe10153870 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10158c90 con 0x7fbe100cc3e0 2023-12-13T22:26:09.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe1629e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe100c6270 con 0x7fbe1015a1e0 2023-12-13T22:26:09.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.881+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58004/0 (socket says 172.21.15.91:58004) 2023-12-13T22:26:09.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 -- 172.21.15.91:0/3847045539 learned_addr learned my addr 172.21.15.91:0/3847045539 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:09.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe1483b640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe1015a1e0 0x7fbe10153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 -- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe1015a1e0 msgr2=0x7fbe10153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe1015a1e0 0x7fbe10153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 -- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe100cc3e0 msgr2=0x7fbe10156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:09.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe100cc3e0 0x7fbe10156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:09.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.885+0000 7fbe0f7fe640 1 -- 172.21.15.91:0/3847045539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08009b30 con 0x7fbe10153870 2023-12-13T22:26:09.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.889+0000 7fbe0f7fe640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400c4d0 tx=0x7fbe0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040052d0 con 0x7fbe10153870 2023-12-13T22:26:09.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04005430 con 0x7fbe10153870 2023-12-13T22:26:09.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04012830 con 0x7fbe10153870 2023-12-13T22:26:09.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe100c7a80 con 0x7fbe10153870 2023-12-13T22:26:09.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe100c8040 con 0x7fbe10153870 2023-12-13T22:26:09.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.893+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe100cb550 con 0x7fbe10153870 2023-12-13T22:26:09.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.913+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbe04012990 con 0x7fbe10153870 2023-12-13T22:26:09.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.913+0000 7fbe0cff9640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 0x7fbdfc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:09.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.913+0000 7fbe0ffff640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 0x7fbdfc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:09.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.913+0000 7fbe0ffff640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 0x7fbdfc068d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009730 tx=0x7fbe00006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:09.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:09.917+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe04055c10 con 0x7fbe10153870 2023-12-13T22:26:10.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.197+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbe04051850 con 0x7fbe10153870 2023-12-13T22:26:10.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.397+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe10073e70 con 0x7fbe10153870 2023-12-13T22:26:10.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.417+0000 7fbe0cff9640 1 -- 172.21.15.91:0/3847045539 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6492 (secure 0 0 0) 0x7fbe04054e70 con 0x7fbe10153870 2023-12-13T22:26:10.417 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:10.418 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:06.437985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-13T22:26:10.418 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 8 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 msgr2=0x7fbdfc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 0x7fbdfc068d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009730 tx=0x7fbe00006ca0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 msgr2=0x7fbe10156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400c4d0 tx=0x7fbe0400c990 comp rx=0 tx=0).stop 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 shutdown_connections 2023-12-13T22:26:10.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbdfc066870 0x7fbdfc068d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbe1015a1e0 0x7fbe10153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbe10153870 0x7fbe10156860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 --2- 172.21.15.91:0/3847045539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe100cc3e0 0x7fbe10156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 >> 172.21.15.91:0/3847045539 conn(0x7fbe100b07e0 msgr2=0x7fbe100c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 shutdown_connections 2023-12-13T22:26:10.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.421+0000 7fbe1629e640 1 -- 172.21.15.91:0/3847045539 wait complete. 2023-12-13T22:26:10.437 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:10.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 Processor -- start 2023-12-13T22:26:10.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 -- start start 2023-12-13T22:26:10.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fec700c4ca0 0x7fec700c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec701577d0 0x7fec70157c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7006ac70 con 0x7fec700c5080 2023-12-13T22:26:10.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7015b930 con 0x7fec700c4ca0 2023-12-13T22:26:10.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.557+0000 7fec77ca0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70158180 con 0x7fec701577d0 2023-12-13T22:26:10.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.641+0000 7fec7523b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fec700c5080 0x7fec7006a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53324/0 (socket says 172.21.15.91:53324) 2023-12-13T22:26:10.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.641+0000 7fec7523b640 1 -- 172.21.15.91:0/3254045567 learned_addr learned my addr 172.21.15.91:0/3254045567 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:10.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.645+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3254045567 >> v2:172.21.15.152:3300/0 conn(0x7fec700c4ca0 0x7fec700c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:10.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.645+0000 7fec75a3c640 1 -- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec701577d0 msgr2=0x7fec70157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:10.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.645+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec701577d0 0x7fec70157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.645+0000 7fec75a3c640 1 -- 172.21.15.91:0/3254045567 >> v1:172.21.15.91:6789/0 conn(0x7fec700c5080 legacy=0x7fec7006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.645+0000 7fec75a3c640 1 -- 172.21.15.91:0/3254045567 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7015ab10 con 0x7fec700c4ca0 2023-12-13T22:26:10.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.653+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec700c4ca0 0x7fec700c7a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec600097c0 tx=0x7fec6001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87867a997d9e536e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.657+0000 7fec74a3a640 1 -- 172.21.15.91:0/3254045567 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600ab650 con 0x7fec700c4ca0 2023-12-13T22:26:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.657+0000 7fec74a3a640 1 -- 172.21.15.91:0/3254045567 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600ab7b0 con 0x7fec700c4ca0 2023-12-13T22:26:10.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.657+0000 7fec74a3a640 1 -- 172.21.15.91:0/3254045567 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600abb40 con 0x7fec700c4ca0 2023-12-13T22:26:10.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.657+0000 7fec77ca0640 1 -- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec700c4ca0 msgr2=0x7fec700c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.657+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec700c4ca0 0x7fec700c7a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec600097c0 tx=0x7fec6001c450 comp rx=0 tx=0).stop 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- 172.21.15.91:0/3254045567 shutdown_connections 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec701577d0 0x7fec70157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3254045567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec700c4ca0 0x7fec700c7a60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- 172.21.15.91:0/3254045567 >> 172.21.15.91:0/3254045567 conn(0x7fec7006d220 msgr2=0x7fec7006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- 172.21.15.91:0/3254045567 shutdown_connections 2023-12-13T22:26:10.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- 172.21.15.91:0/3254045567 wait complete. 2023-12-13T22:26:10.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 Processor -- start 2023-12-13T22:26:10.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- start start 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec700c5080 0x7fec70146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec701577d0 0x7fec70136b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec701492c0 con 0x7fec700c4ca0 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec701489b0 con 0x7fec701577d0 2023-12-13T22:26:10.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.661+0000 7fec77ca0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70149750 con 0x7fec700c5080 2023-12-13T22:26:10.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.665+0000 7fec75a3c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:10.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.665+0000 7fec7623d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec701577d0 0x7fec70136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:10.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.665+0000 7fec75a3c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58018/0 (socket says 172.21.15.91:58018) 2023-12-13T22:26:10.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.665+0000 7fec75a3c640 1 -- 172.21.15.91:0/3819720659 learned_addr learned my addr 172.21.15.91:0/3819720659 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:10.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.665+0000 7fec7523b640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec700c5080 0x7fec70146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.669+0000 7fec75a3c640 1 -- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec700c5080 msgr2=0x7fec70146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.669+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec700c5080 0x7fec70146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.669+0000 7fec75a3c640 1 -- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec701577d0 msgr2=0x7fec70136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.669+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec701577d0 0x7fec70136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:10.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.669+0000 7fec75a3c640 1 -- 172.21.15.91:0/3819720659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60009420 con 0x7fec700c4ca0 2023-12-13T22:26:10.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.673+0000 7fec75a3c640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec6001a080 tx=0x7fec6001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:10.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600b58d0 con 0x7fec700c4ca0 2023-12-13T22:26:10.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600b5a30 con 0x7fec700c4ca0 2023-12-13T22:26:10.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600b5de0 con 0x7fec700c4ca0 2023-12-13T22:26:10.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec700caeb0 con 0x7fec700c4ca0 2023-12-13T22:26:10.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70148f50 con 0x7fec700c4ca0 2023-12-13T22:26:10.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.709+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70073e70 con 0x7fec700c4ca0 2023-12-13T22:26:10.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.749+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fec600bf410 con 0x7fec700c4ca0 2023-12-13T22:26:10.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.749+0000 7fec667fc640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 0x7fec54068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:10.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.749+0000 7fec7523b640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 0x7fec54068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:10.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:10.749+0000 7fec7523b640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 0x7fec54068d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec700c8570 tx=0x7fec6c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:11.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.045+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec600f0970 con 0x7fec700c4ca0 2023-12-13T22:26:11.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.049+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fec600eccb0 con 0x7fec700c4ca0 2023-12-13T22:26:11.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.213+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec70161ad0 con 0x7fec700c4ca0 2023-12-13T22:26:11.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.305+0000 7fec667fc640 1 -- 172.21.15.91:0/3819720659 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fec600f02d0 con 0x7fec700c4ca0 2023-12-13T22:26:11.302 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:11.303 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:11.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 msgr2=0x7fec54068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:11.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 0x7fec54068d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec700c8570 tx=0x7fec6c007e90 comp rx=0 tx=0).stop 2023-12-13T22:26:11.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 msgr2=0x7fec700ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec6001a080 tx=0x7fec6001ac90 comp rx=0 tx=0).stop 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 shutdown_connections 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fec54066840 0x7fec54068d00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec701577d0 0x7fec70136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec700c5080 0x7fec70146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 --2- 172.21.15.91:0/3819720659 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fec700c4ca0 0x7fec700ca470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 >> 172.21.15.91:0/3819720659 conn(0x7fec7006d220 msgr2=0x7fec7014f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 shutdown_connections 2023-12-13T22:26:11.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:11.309+0000 7fec77ca0640 1 -- 172.21.15.91:0/3819720659 wait complete. 2023-12-13T22:26:11.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-13T22:25:58.517400+0000', 'modified': '2023-12-13T22:26:06.437985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'f', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6835/3409704443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 3409704443}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 3409704443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-13T22:26:11.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-13T22:26:11.932 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-13T22:26:12.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 Processor -- start 2023-12-13T22:26:12.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 -- start start 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a41513b0 0x7fb8a415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8a40c6df0 0x7fb8a40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40c7260 con 0x7fb8a4157dc0 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a4158200 con 0x7fb8a40c6df0 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8aba31640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c7c60 con 0x7fb8a41513b0 2023-12-13T22:26:12.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8a9fce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8a40c6df0 0x7fb8a40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8a9fce640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb8a40c6df0 0x7fb8a40c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58026/0 (socket says 172.21.15.91:58026) 2023-12-13T22:26:12.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.065+0000 7fb8a9fce640 1 -- 172.21.15.91:0/3246326466 learned_addr learned my addr 172.21.15.91:0/3246326466 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.069+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a41513b0 0x7fb8a415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.069+0000 7fb8a9fce640 1 -- 172.21.15.91:0/3246326466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a41513b0 msgr2=0x7fb8a415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.069+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a41513b0 0x7fb8a415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.069+0000 7fb8a9fce640 1 -- 172.21.15.91:0/3246326466 >> v1:172.21.15.152:6789/0 conn(0x7fb8a4157dc0 legacy=0x7fb8a40c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.069+0000 7fb8a9fce640 1 -- 172.21.15.91:0/3246326466 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40c7f40 con 0x7fb8a40c6df0 2023-12-13T22:26:12.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.073+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a40c6df0 0x7fb8a40c40e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009e50 tx=0x7fb89c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b3b4738f4b06ea server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb89bfff640 1 -- 172.21.15.91:0/3246326466 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0af400 con 0x7fb8a40c6df0 2023-12-13T22:26:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb89bfff640 1 -- 172.21.15.91:0/3246326466 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0ab050 con 0x7fb8a40c6df0 2023-12-13T22:26:12.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb89bfff640 1 -- 172.21.15.91:0/3246326466 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0af780 con 0x7fb8a40c6df0 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 -- 172.21.15.91:0/3246326466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a40c6df0 msgr2=0x7fb8a40c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a40c6df0 0x7fb8a40c40e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009e50 tx=0x7fb89c01f1f0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 -- 172.21.15.91:0/3246326466 shutdown_connections 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a40c6df0 0x7fb8a40c40e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 --2- 172.21.15.91:0/3246326466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a41513b0 0x7fb8a415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 -- 172.21.15.91:0/3246326466 >> 172.21.15.91:0/3246326466 conn(0x7fb8a406c6a0 msgr2=0x7fb8a406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 -- 172.21.15.91:0/3246326466 shutdown_connections 2023-12-13T22:26:12.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.077+0000 7fb8aba31640 1 -- 172.21.15.91:0/3246326466 wait complete. 2023-12-13T22:26:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 Processor -- start 2023-12-13T22:26:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 -- start start 2023-12-13T22:26:12.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a40c6df0 0x7fb8a41ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a4157dc0 0x7fb8a41ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4154980 con 0x7fb8a41513b0 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a41edc30 con 0x7fb8a40c6df0 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8aba31640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40cb190 con 0x7fb8a4157dc0 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8a8fcc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8a8fcc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58034/0 (socket says 172.21.15.91:58034) 2023-12-13T22:26:12.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.081+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/2582367183 learned_addr learned my addr 172.21.15.91:0/2582367183 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a40c6df0 0x7fb8a41ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a4157dc0 0x7fb8a41ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a4157dc0 msgr2=0x7fb8a41ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a4157dc0 0x7fb8a41ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a40c6df0 msgr2=0x7fb8a41ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a40c6df0 0x7fb8a41ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.085+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/2582367183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c009b30 con 0x7fb8a41513b0 2023-12-13T22:26:12.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.089+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c370 tx=0x7fb89400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.093+0000 7fb899ffb640 1 -- 172.21.15.91:0/2582367183 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940052d0 con 0x7fb8a41513b0 2023-12-13T22:26:12.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.093+0000 7fb899ffb640 1 -- 172.21.15.91:0/2582367183 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894005430 con 0x7fb8a41513b0 2023-12-13T22:26:12.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.093+0000 7fb899ffb640 1 -- 172.21.15.91:0/2582367183 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894007260 con 0x7fb8a41513b0 2023-12-13T22:26:12.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.093+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40c98c0 con 0x7fb8a41513b0 2023-12-13T22:26:12.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.093+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c9b60 con 0x7fb8a41513b0 2023-12-13T22:26:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 Processor -- start 2023-12-13T22:26:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 -- start start 2023-12-13T22:26:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52d6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c52d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c5100250 con 0x55e6c529c4b0 2023-12-13T22:26:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50edd60 con 0x55e6c529bb90 2023-12-13T22:26:12.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.097+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50eb290 con 0x55e6c52d6940 2023-12-13T22:26:12.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.101+0000 7fb8a9fce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.099 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.101+0000 7fb8a8fcc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c52d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.101+0000 7fb8a9fce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:37866/0 (socket says 172.21.15.91:37866) 2023-12-13T22:26:12.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.101+0000 7fb8a9fce640 1 -- 172.21.15.91:0/2291431256 learned_addr learned my addr 172.21.15.91:0/2291431256 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.109+0000 7fb8a9fce640 1 -- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 msgr2=0x55e6c52d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.109+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c52d6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.109+0000 7fb8a9fce640 1 -- 172.21.15.91:0/2291431256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 msgr2=0x55e6c52d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.109+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.109+0000 7fb8a9fce640 1 -- 172.21.15.91:0/2291431256 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6c4dde890 con 0x55e6c529bb90 2023-12-13T22:26:12.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.117+0000 7fb899ffb640 1 -- 172.21.15.91:0/2582367183 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb8940067e0 con 0x7fb8a41513b0 2023-12-13T22:26:12.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.117+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb89c01d8a0 tx=0x7fb89c004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74cd7dcaeaffaa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.117+0000 7fb899ffb640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 0x7fb888068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.117+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 0x7fb888068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.117+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 0x7fb888068d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00074a0 tx=0x7fb8a0007430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.121+0000 7fb899ffb640 1 -- 172.21.15.91:0/2582367183 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8940548f0 con 0x7fb8a41513b0 2023-12-13T22:26:12.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.129+0000 7fb886ffd640 1 -- 172.21.15.91:0/2291431256 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0c3630 con 0x55e6c529bb90 2023-12-13T22:26:12.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.129+0000 7fb886ffd640 1 -- 172.21.15.91:0/2291431256 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0be070 con 0x55e6c529bb90 2023-12-13T22:26:12.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.129+0000 7fb886ffd640 1 -- 172.21.15.91:0/2291431256 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0c39f0 con 0x55e6c529bb90 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 msgr2=0x55e6c529bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb89c01d8a0 tx=0x7fb89c004ac0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2291431256 shutdown_connections 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c52d6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52d6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2291431256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c529bb90 0x55e6c529bf70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2291431256 >> 172.21.15.91:0/2291431256 conn(0x55e6c52d31c0 msgr2=0x55e6c52d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2291431256 shutdown_connections 2023-12-13T22:26:12.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2291431256 wait complete. 2023-12-13T22:26:12.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- start start 2023-12-13T22:26:12.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 Processor -- start 2023-12-13T22:26:12.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c529c4b0 0x55e6c5298640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c5298b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50e6b80 con 0x55e6c529bb90 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c509ebf0 con 0x55e6c52d6940 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50a4a90 con 0x55e6c529c4b0 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8aeb61000 10 client.0 _ll_register_callbacks cb 0x55e6c5281970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8a97cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8a97cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58048/0 (socket says 172.21.15.91:58048) 2023-12-13T22:26:12.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8a97cd640 1 -- 172.21.15.91:0/308313875 learned_addr learned my addr 172.21.15.91:0/308313875 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.133+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c529c4b0 0x55e6c5298640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c5298b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a97cd640 1 -- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c529c4b0 msgr2=0x55e6c5298640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c529c4b0 0x55e6c5298640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a97cd640 1 -- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 msgr2=0x55e6c5298b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c5298b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.137+0000 7fb8a97cd640 1 -- 172.21.15.91:0/308313875 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c7f40 con 0x55e6c529bb90 2023-12-13T22:26:12.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.141+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0010670 tx=0x7fb8a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551e0f91fca9941c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.141+0000 7fb87ffff640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:26:12.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.145+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0014800 con 0x55e6c529bb90 2023-12-13T22:26:12.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.145+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8a0014960 con 0x55e6c529bb90 2023-12-13T22:26:12.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.145+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6c50a4420 con 0x55e6c529bb90 2023-12-13T22:26:12.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.145+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a0014b20 con 0x55e6c529bb90 2023-12-13T22:26:12.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.145+0000 7fb8aeb61000 10 client.4323 fetch_fsmap learned FSMap version 8 2023-12-13T22:26:12.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.149+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e6c50a7190 con 0x55e6c529bb90 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e6c50a4420 con 0x55e6c529bb90 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fb8a0014c80 con 0x55e6c529bb90 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 10 client.4323 fetch_fsmap finished waiting for FSMap version 8 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 10 client.4323 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 20 client.4323 populate_metadata read hostname 'smithi091' 2023-12-13T22:26:12.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c52eb110 0x55e6c52ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 4 client.4323 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T22:26:12.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.153+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 --> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6c50e54d0 con 0x55e6c52eb110 2023-12-13T22:26:12.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.173+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c52eb110 0x55e6c52ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.337+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c52eb110 0x55e6c52ed500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe4b7bca223ea89 server_cookie=b3c913495d00f55a in_seq=0 out_seq=0 2023-12-13T22:26:12.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.337+0000 7fb87ffff640 10 client.4323 ms_handle_connect on v2:172.21.15.152:6834/3409704443 2023-12-13T22:26:12.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb87ffff640 1 -- 172.21.15.91:0/308313875 <== mds.0 v2:172.21.15.152:6834/3409704443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e6c50e54d0 con 0x55e6c52eb110 2023-12-13T22:26:12.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb87ffff640 10 client.4323 handle_command_reply: tid=0 2023-12-13T22:26:12.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 client.4323 shutdown 2023-12-13T22:26:12.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 msgr2=0x55e6c5298100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0010670 tx=0x7fb8a0004740 comp rx=0 tx=0).stop 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 shutdown_connections 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c5298b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c52eb110 0x55e6c52ed500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c529c4b0 0x55e6c5298640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/308313875 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529bb90 0x55e6c5298100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 >> 172.21.15.91:0/308313875 conn(0x55e6c52d31c0 msgr2=0x55e6c52d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb87ffff640 0 client.4323 ms_handle_reset on v2:172.21.15.152:6834/3409704443 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 shutdown_connections 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 1 -- 172.21.15.91:0/308313875 wait complete. 2023-12-13T22:26:12.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.565+0000 7fb8aeb61000 20 client.4323 trim_cache size 0 max 16384 2023-12-13T22:26:12.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.597+0000 7fb8aeb61000 1 Processor -- start 2023-12-13T22:26:12.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.597+0000 7fb8aeb61000 1 -- start start 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52ee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52f8f90 0x55e6c52f9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c4d9f940 con 0x55e6c529c4b0 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50eab80 con 0x55e6c52d6940 2023-12-13T22:26:12.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6c4ddf1b0 con 0x55e6c52f8f90 2023-12-13T22:26:12.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8a8fcc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8a9fce640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52f8f90 0x55e6c52f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8a8fcc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:37886/0 (socket says 172.21.15.91:37886) 2023-12-13T22:26:12.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.601+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/1384452072 learned_addr learned my addr 172.21.15.91:0/1384452072 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.609+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52f8f90 msgr2=0x55e6c52f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.609+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52f8f90 0x55e6c52f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.609+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/1384452072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 msgr2=0x55e6c52ee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.609+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.609+0000 7fb8a8fcc640 1 -- 172.21.15.91:0/1384452072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6c508d490 con 0x55e6c52d6940 2023-12-13T22:26:12.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.621+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb894001240 tx=0x7fb8940011d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=251d154b9c4e73b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.629+0000 7fb8877fe640 1 -- 172.21.15.91:0/1384452072 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89405c6b0 con 0x55e6c52d6940 2023-12-13T22:26:12.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.629+0000 7fb8877fe640 1 -- 172.21.15.91:0/1384452072 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89405c810 con 0x55e6c52d6940 2023-12-13T22:26:12.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.629+0000 7fb8877fe640 1 -- 172.21.15.91:0/1384452072 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89405c980 con 0x55e6c52d6940 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 msgr2=0x55e6c52eea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb894001240 tx=0x7fb8940011d0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- 172.21.15.91:0/1384452072 shutdown_connections 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52f8f90 0x55e6c52f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52d6940 0x55e6c52eea50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/1384452072 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c52ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- 172.21.15.91:0/1384452072 >> 172.21.15.91:0/1384452072 conn(0x55e6c52d31c0 msgr2=0x55e6c52d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- 172.21.15.91:0/1384452072 shutdown_connections 2023-12-13T22:26:12.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- 172.21.15.91:0/1384452072 wait complete. 2023-12-13T22:26:12.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- start start 2023-12-13T22:26:12.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 Processor -- start 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c5336a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52f8f90 0x55e6c5337180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50de380 con 0x55e6c529c4b0 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50dfde0 con 0x55e6c52f8f90 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6c50e4390 con 0x55e6c52d6940 2023-12-13T22:26:12.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.633+0000 7fb8aeb61000 10 client.0 _ll_register_callbacks cb 0x55e6c5134ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:26:12.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.637+0000 7fb8a97cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.637+0000 7fb8a97cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58074/0 (socket says 172.21.15.91:58074) 2023-12-13T22:26:12.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.637+0000 7fb8a97cd640 1 -- 172.21.15.91:0/2727845988 learned_addr learned my addr 172.21.15.91:0/2727845988 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.634 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.637+0000 7fb8a9fce640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52f8f90 0x55e6c5337180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c5336a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a97cd640 1 -- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 msgr2=0x55e6c5336a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c5336a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a97cd640 1 -- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52f8f90 msgr2=0x55e6c5337180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52f8f90 0x55e6c5337180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.641+0000 7fb8a97cd640 1 -- 172.21.15.91:0/2727845988 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c9b60 con 0x55e6c529c4b0 2023-12-13T22:26:12.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.645+0000 7fb8a97cd640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00106c0 tx=0x7fb8a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8db55e5ac5f57e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.645+0000 7fb87ffff640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:26:12.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.653+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0006de0 con 0x55e6c529c4b0 2023-12-13T22:26:12.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.653+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8a0004230 con 0x55e6c529c4b0 2023-12-13T22:26:12.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.653+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6c52d58a0 con 0x55e6c529c4b0 2023-12-13T22:26:12.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.657+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a0005b10 con 0x55e6c529c4b0 2023-12-13T22:26:12.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.657+0000 7fb8aeb61000 10 client.4326 fetch_fsmap learned FSMap version 8 2023-12-13T22:26:12.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.657+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e6c4ddecc0 con 0x55e6c529c4b0 2023-12-13T22:26:12.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.661+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e6c52d58a0 con 0x55e6c529c4b0 2023-12-13T22:26:12.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.661+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fb8a00043f0 con 0x55e6c529c4b0 2023-12-13T22:26:12.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.661+0000 7fb8aeb61000 10 client.4326 fetch_fsmap finished waiting for FSMap version 8 2023-12-13T22:26:12.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8aeb61000 10 client.4326 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T22:26:12.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8aeb61000 20 client.4326 populate_metadata read hostname 'smithi091' 2023-12-13T22:26:12.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c5343630 0x55e6c5337e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8aeb61000 4 client.4326 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T22:26:12.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 --> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e6c5081f90 con 0x55e6c5343630 2023-12-13T22:26:12.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.665+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c5343630 0x55e6c5337e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.673+0000 7fb8a8fcc640 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c5343630 0x55e6c5337e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b105803afe6bad server_cookie=a2a8b9685ba88419 in_seq=0 out_seq=0 2023-12-13T22:26:12.670 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.673+0000 7fb87ffff640 10 client.4326 ms_handle_connect on v2:172.21.15.152:6834/3409704443 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb87ffff640 1 -- 172.21.15.91:0/2727845988 <== mds.0 v2:172.21.15.152:6834/3409704443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55e6c5081f90 con 0x55e6c5343630 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb87ffff640 10 client.4326 handle_command_reply: tid=0 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 client.4326 shutdown 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 msgr2=0x55e6c53364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00106c0 tx=0x7fb8a0015000 comp rx=0 tx=0).stop 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 shutdown_connections 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e6c52f8f90 0x55e6c5337180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55e6c5343630 0x55e6c5337e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55e6c52d6940 0x55e6c5336a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb87ffff640 0 client.4326 ms_handle_reset on v2:172.21.15.152:6834/3409704443 2023-12-13T22:26:12.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 --2- 172.21.15.91:0/2727845988 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55e6c529c4b0 0x55e6c53364e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 >> 172.21.15.91:0/2727845988 conn(0x55e6c52d31c0 msgr2=0x55e6c52ef3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 shutdown_connections 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 1 -- 172.21.15.91:0/2727845988 wait complete. 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.697+0000 7fb8aeb61000 20 client.4326 trim_cache size 0 max 16384 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "94ef47bf-5c6b-4a6a-817c-50fb411636d9", 2023-12-13T22:26:12.698 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4258, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 12.34264464, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 8, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 29, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 28, 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 28.484068074 2023-12-13T22:26:12.699 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 msgr2=0x7fb888068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 0x7fb888068d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00074a0 tx=0x7fb8a0007430 comp rx=0 tx=0).stop 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 msgr2=0x7fb8a40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb89400c370 tx=0x7fb89400c830 comp rx=0 tx=0).stop 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 shutdown_connections 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb888066840 0x7fb888068d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8a4157dc0 0x7fb8a41ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb8a41513b0 0x7fb8a40ca360 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 --2- 172.21.15.91:0/2582367183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8a40c6df0 0x7fb8a41ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 >> 172.21.15.91:0/2582367183 conn(0x7fb8a406c6a0 msgr2=0x7fb8a40c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 shutdown_connections 2023-12-13T22:26:12.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.701+0000 7fb8aba31640 1 -- 172.21.15.91:0/2582367183 wait complete. 2023-12-13T22:26:12.723 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-13T22:26:12.723 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:12.723 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-13T22:26:12.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.849+0000 7f020fd69640 1 Processor -- start 2023-12-13T22:26:12.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.849+0000 7f020fd69640 1 -- start start 2023-12-13T22:26:12.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020fd69640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 0x7f020815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020fd69640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f02080c2ac0 0x7f02080c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020fd69640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0208070010 con 0x7f020806f280 2023-12-13T22:26:12.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020fd69640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0208153d10 con 0x7f02080c2ac0 2023-12-13T22:26:12.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020fd69640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080c1500 con 0x7f0208153930 2023-12-13T22:26:12.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020e306640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f020806f280 0x7f020806a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53330/0 (socket says 172.21.15.91:53330) 2023-12-13T22:26:12.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.853+0000 7f020e306640 1 -- 172.21.15.91:0/358484324 learned_addr learned my addr 172.21.15.91:0/358484324 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:12.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586820910 0 0) 0x7f0208070010 con 0x7f020806f280 2023-12-13T22:26:12.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0003530 con 0x7f020806f280 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 288236736 0 0) 0x7f01f0003530 con 0x7f020806f280 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 msgr2=0x7f020815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 0x7f020815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 >> v2:172.21.15.152:3300/0 conn(0x7f02080c2ac0 msgr2=0x7f02080c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 --2- 172.21.15.91:0/358484324 >> v2:172.21.15.152:3300/0 conn(0x7f02080c2ac0 0x7f02080c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208159ee0 con 0x7f020806f280 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f01f8001680 con 0x7f020806f280 2023-12-13T22:26:12.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 >> v1:172.21.15.91:6789/0 conn(0x7f020806f280 legacy=0x7f020806a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01f00039f0 0x7f01f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 0x7f01f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01f0004e30 0x7f01f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208153d10 con 0x7f01f0004e30 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080c1500 con 0x7f01f00039f0 2023-12-13T22:26:12.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.857+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0005660 con 0x7f0208153930 2023-12-13T22:26:12.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.861+0000 7f020e306640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01f0004e30 0x7f01f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 -- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 msgr2=0x7f01f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0208153930 0x7f01f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 -- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01f00039f0 msgr2=0x7f01f0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:12.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01f00039f0 0x7f01f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 -- 172.21.15.91:0/358484324 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0003530 con 0x7f01f0004e30 2023-12-13T22:26:12.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.865+0000 7f020e306640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01f0004e30 0x7f01f000b990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c190 tx=0x7f01f801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f04fc73e4d3aeb server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80058e0 con 0x7f01f0004e30 2023-12-13T22:26:12.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8005a40 con 0x7f01f0004e30 2023-12-13T22:26:12.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020cb03640 1 -- 172.21.15.91:0/358484324 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8005e70 con 0x7f01f0004e30 2023-12-13T22:26:12.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020fd69640 1 -- 172.21.15.91:0/358484324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01f0004e30 msgr2=0x7f01f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020fd69640 1 --2- 172.21.15.91:0/358484324 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f01f0004e30 0x7f01f000b990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c190 tx=0x7f01f801cb80 comp rx=0 tx=0).stop 2023-12-13T22:26:12.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020e306640 1 -- 172.21.15.91:0/358484324 reap_dead start 2023-12-13T22:26:12.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020fd69640 1 -- 172.21.15.91:0/358484324 shutdown_connections 2023-12-13T22:26:12.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.869+0000 7f020fd69640 1 -- 172.21.15.91:0/358484324 >> 172.21.15.91:0/358484324 conn(0x7f020806b670 msgr2=0x7f020806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:12.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- 172.21.15.91:0/358484324 shutdown_connections 2023-12-13T22:26:12.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- 172.21.15.91:0/358484324 wait complete. 2023-12-13T22:26:12.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 Processor -- start 2023-12-13T22:26:12.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- start start 2023-12-13T22:26:12.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f02081520a0 0x7f020814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0208154ad0 0x7f020814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208157bd0 con 0x7f0208139940 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208152640 con 0x7f0208154ad0 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020fd69640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208139d20 con 0x7f02081520a0 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020db05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020db05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58092/0 (socket says 172.21.15.91:58092) 2023-12-13T22:26:12.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.873+0000 7f020db05640 1 -- 172.21.15.91:0/1297631490 learned_addr learned my addr 172.21.15.91:0/1297631490 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:12.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.877+0000 7f020db05640 1 -- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f02081520a0 msgr2=0x7f020814c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.877+0000 7f020db05640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f02081520a0 0x7f020814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.877+0000 7f020db05640 1 -- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0208154ad0 msgr2=0x7f020814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:12.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.877+0000 7f020db05640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0208154ad0 0x7f020814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:12.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.877+0000 7f020db05640 1 -- 172.21.15.91:0/1297631490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208157610 con 0x7f0208139940 2023-12-13T22:26:12.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.881+0000 7f020db05640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f020000b760 tx=0x7f020000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000c8a0 con 0x7f0208139940 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000ca20 con 0x7f0208139940 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000cdd0 con 0x7f0208139940 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02081578f0 con 0x7f0208139940 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02081542d0 con 0x7f0208139940 2023-12-13T22:26:12.882 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:12.885+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0208153e50 con 0x7f0208139940 2023-12-13T22:26:13.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.160+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f020001d3b0 con 0x7f0208139940 2023-12-13T22:26:13.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.160+0000 7f02067fc640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 0x7f01f4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:13.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.160+0000 7f020d304640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 0x7f01f4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:13.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.164+0000 7f020d304640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 0x7f01f4068d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f020814ed30 tx=0x7f01fc006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:13.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.192+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02000556e0 con 0x7f0208139940 2023-12-13T22:26:13.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.196+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0200051320 con 0x7f0208139940 2023-12-13T22:26:13.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.400+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0208153e50 con 0x7f0208139940 2023-12-13T22:26:13.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.424+0000 7f02067fc640 1 -- 172.21.15.91:0/1297631490 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0208153e50 con 0x7f0208139940 2023-12-13T22:26:13.423 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-13T22:26:13.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.424+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 msgr2=0x7f01f4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.424+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 0x7f01f4068d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f020814ed30 tx=0x7f01fc006ca0 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.424+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 msgr2=0x7f02081f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f020000b760 tx=0x7f020000bc20 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 shutdown_connections 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f01f4066840 0x7f01f4068d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0208154ad0 0x7f020814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f02081520a0 0x7f020814c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 --2- 172.21.15.91:0/1297631490 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0208139940 0x7f02081f24d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 >> 172.21.15.91:0/1297631490 conn(0x7f020806b670 msgr2=0x7f02080ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 shutdown_connections 2023-12-13T22:26:13.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:13.428+0000 7f020fd69640 1 -- 172.21.15.91:0/1297631490 wait complete. 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-13T22:26:13.442 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-13T22:26:13.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.443 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-12-13T22:26:13.448 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-13T22:26:13.448 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-13T22:26:13.448 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-13T22:26:13.449 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 42011sec preferred_lft 42011sec 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:8c:74:89:3e brd ff:ff:ff:ff:ff:ff 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:26:13.450 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-13T22:26:13.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-13T22:26:13.451 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:26:13.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.524 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-13T22:26:13.573 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-12-13T22:26:13.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.575 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-12-13T22:26:13.769 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:26:13.770 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:26:13.771 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:26:13.771 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-13T22:26:13.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-13T22:26:13.772 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:26:13.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.804 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-12-13T22:26:13.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.850 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-12-13T22:26:13.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.898 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:26:13.898 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:26:13.898 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:13.899 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-13T22:26:13.899 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:26:13.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-13T22:26:13.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-13T22:26:13.975 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:26:14.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:14.118 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:26:14.118 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:26:14.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-12-13T22:26:14.118 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-12-13T22:26:14.118 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:26:14.138 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-13T22:26:14.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T22:26:14.138 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:14.189 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-13T22:26:14.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T22:26:14.190 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:14.237 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:26:14.299 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:26:14.347 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:26:14.348 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:14.349 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:14.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:14.350 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:26:14.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-13T22:26:14.397 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-13T22:26:14.443 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:26:14.457 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:26:14.509 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:26:14.510 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:26:14.511 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:14.512 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:14.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:14.513 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:26:14.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:2023-12-13T22:26:14.540+0000 7feb8d6b5580 -1 init, newargv = 0x55a81f4824d0 newargc=15 2023-12-13T22:26:14.538 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[44511]: starting ceph client 2023-12-13T22:26:15.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[44511]: starting fuse 2023-12-13T22:26:15.643 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:26:15.659 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:26:15.707 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:26:15.707 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:26:15.707 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:26:15.708 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:26:15.709 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:15.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:15.710 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:26:15.758 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-12-13T22:26:15.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-12-13T22:26:15.758 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-12-13T22:26:15.758 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-12-13T22:26:15.759 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.admin")) 2023-12-13T22:26:15.760 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-12-13T22:26:15.883 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.admin.44511.asok 2023-12-13T22:26:15.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-13T22:26:15.895 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44511.asok 2023-12-13T22:26:15.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:15.895 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44511.asok status 2023-12-13T22:26:16.054 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "021ac1670a21c19759080c6da90baaeb42e7d175", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 19.0.0-157-g021ac167 (021ac1670a21c19759080c6da90baaeb42e7d175) squid (dev)", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "admin", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "44511", 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4338, 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-12-13T22:26:16.055 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4338 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 1344854261 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 1344854261 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4338 192.168.0.1:0/1344854261", 2023-12-13T22:26:16.056 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "192.168.0.1:0/1344854261", 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 8, 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 29, 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-12-13T22:26:16.057 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:26:16.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:16.069 DEBUG:teuthology.orchestra.run.smithi091:> stat --file-system '--printf=%T 2023-12-13T22:26:16.069 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:16.139 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-12-13T22:26:16.139 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:16.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:16.140 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:16.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:16.309 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-13T22:26:16.726 INFO:teuthology.orchestra.run.smithi091.stdout:# file: . 2023-12-13T22:26:16.727 INFO:teuthology.orchestra.run.smithi091.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-13T22:26:16.727 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:16.728 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:26:16.728 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T22:26:16.736 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:16.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 Processor -- start 2023-12-13T22:26:16.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 -- start start 2023-12-13T22:26:16.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3e640c4630 0x7f3e640c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3e640c4a10 0x7f3e641596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e6414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e640c4f40 con 0x7f3e640c4a10 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6415a6c0 con 0x7f3e640c4630 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6c69d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641560d0 con 0x7f3e64159c00 2023-12-13T22:26:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e69c38640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3e640c4a10 0x7f3e641596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e69c38640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f3e640c4a10 0x7f3e641596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58096/0 (socket says 172.21.15.91:58096) 2023-12-13T22:26:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e69c38640 1 -- 172.21.15.91:0/219448690 learned_addr learned my addr 172.21.15.91:0/219448690 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6a439640 1 --2- 172.21.15.91:0/219448690 >> v2:172.21.15.152:3300/0 conn(0x7f3e640c4630 0x7f3e640c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.908+0000 7f3e6ac3a640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e6414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.912+0000 7f3e69c38640 1 -- 172.21.15.91:0/219448690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 msgr2=0x7f3e6414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.912+0000 7f3e69c38640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e6414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.912+0000 7f3e69c38640 1 -- 172.21.15.91:0/219448690 >> v2:172.21.15.152:3300/0 conn(0x7f3e640c4630 msgr2=0x7f3e640c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.912+0000 7f3e69c38640 1 --2- 172.21.15.91:0/219448690 >> v2:172.21.15.152:3300/0 conn(0x7f3e640c4630 0x7f3e640c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.912+0000 7f3e69c38640 1 -- 172.21.15.91:0/219448690 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640c72b0 con 0x7f3e640c4a10 2023-12-13T22:26:16.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.916+0000 7f3e69c38640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e641596c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e6406f8a0 tx=0x7f3e580213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0766efb7d093756 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:16.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e69437640 1 -- 172.21.15.91:0/219448690 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580b1600 con 0x7f3e640c4a10 2023-12-13T22:26:16.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e69437640 1 -- 172.21.15.91:0/219448690 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e580ad050 con 0x7f3e640c4a10 2023-12-13T22:26:16.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e69437640 1 -- 172.21.15.91:0/219448690 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580b1980 con 0x7f3e640c4a10 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 -- 172.21.15.91:0/219448690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 msgr2=0x7f3e641596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e641596c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e6406f8a0 tx=0x7f3e580213c0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 -- 172.21.15.91:0/219448690 shutdown_connections 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e6414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/219448690 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e641596c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/219448690 >> v2:172.21.15.152:3300/0 conn(0x7f3e640c4630 0x7f3e640c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 -- 172.21.15.91:0/219448690 >> 172.21.15.91:0/219448690 conn(0x7f3e6406c6a0 msgr2=0x7f3e6406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:16.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 -- 172.21.15.91:0/219448690 shutdown_connections 2023-12-13T22:26:16.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.920+0000 7f3e6c69d640 1 -- 172.21.15.91:0/219448690 wait complete. 2023-12-13T22:26:16.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 Processor -- start 2023-12-13T22:26:16.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 -- start start 2023-12-13T22:26:16.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e640c4630 0x7f3e640c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e641464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641eb9a0 con 0x7f3e640c4a10 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64157520 con 0x7f3e640c4630 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6c69d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e641eabe0 con 0x7f3e64159c00 2023-12-13T22:26:16.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e69c38640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e69c38640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58104/0 (socket says 172.21.15.91:58104) 2023-12-13T22:26:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e69c38640 1 -- 172.21.15.91:0/4007801927 learned_addr learned my addr 172.21.15.91:0/4007801927 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6a439640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e640c4630 0x7f3e640c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.924+0000 7f3e6ac3a640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e641464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.928+0000 7f3e69c38640 1 -- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 msgr2=0x7f3e641464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.928+0000 7f3e69c38640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e641464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.928+0000 7f3e69c38640 1 -- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e640c4630 msgr2=0x7f3e640c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.928+0000 7f3e69c38640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e640c4630 0x7f3e640c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:16.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.928+0000 7f3e69c38640 1 -- 172.21.15.91:0/4007801927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5800b770 con 0x7f3e640c4a10 2023-12-13T22:26:16.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.932+0000 7f3e69c38640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e5801eff0 tx=0x7f3e5801e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580c1070 con 0x7f3e640c4a10 2023-12-13T22:26:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e580b1d60 con 0x7f3e640c4a10 2023-12-13T22:26:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580bb630 con 0x7f3e640c4a10 2023-12-13T22:26:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641eaec0 con 0x7f3e640c4a10 2023-12-13T22:26:16.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e641eb480 con 0x7f3e640c4a10 2023-12-13T22:26:16.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:16.936+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e641ead20 con 0x7f3e640c4a10 2023-12-13T22:26:17.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.240+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3e580b8070 con 0x7f3e640c4a10 2023-12-13T22:26:17.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.240+0000 7f3e62ffd640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 0x7f3e50068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.240+0000 7f3e6a439640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 0x7f3e50068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:17.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.244+0000 7f3e6a439640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 0x7f3e50068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009a40 tx=0x7f3e54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:17.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.268+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e580f5270 con 0x7f3e640c4a10 2023-12-13T22:26:17.268 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.268+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3e580f15b0 con 0x7f3e640c4a10 2023-12-13T22:26:17.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.440+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e641ead20 con 0x7f3e640c4a10 2023-12-13T22:26:17.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.548+0000 7f3e62ffd640 1 -- 172.21.15.91:0/4007801927 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f3e641ead20 con 0x7f3e640c4a10 2023-12-13T22:26:17.548 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:17.548 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 msgr2=0x7f3e50068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 0x7f3e50068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009a40 tx=0x7f3e54009190 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 msgr2=0x7f3e64140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e5801eff0 tx=0x7f3e5801e160 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 shutdown_connections 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3e50066870 0x7f3e50068d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e64159c00 0x7f3e641464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3e640c4a10 0x7f3e64140d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 --2- 172.21.15.91:0/4007801927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e640c4630 0x7f3e640c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 >> 172.21.15.91:0/4007801927 conn(0x7f3e6406c6a0 msgr2=0x7f3e640735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:17.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 shutdown_connections 2023-12-13T22:26:17.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.552+0000 7f3e6c69d640 1 -- 172.21.15.91:0/4007801927 wait complete. 2023-12-13T22:26:17.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:26:17.575 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:26:17.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 Processor -- start 2023-12-13T22:26:17.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 -- start start 2023-12-13T22:26:17.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7b64151460 0x7f7b640c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7b64157280 0x7f7b6406f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b640c21d0 con 0x7f7b640c9130 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6406ec00 con 0x7f7b64151460 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b6be05640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b64157750 con 0x7f7b64157280 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b69ba1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7b64151460 0x7f7b640c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b69ba1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f7b64151460 0x7f7b640c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58118/0 (socket says 172.21.15.91:58118) 2023-12-13T22:26:17.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.708+0000 7f7b69ba1640 1 -- 172.21.15.91:0/2024705236 learned_addr learned my addr 172.21.15.91:0/2024705236 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:17.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.712+0000 7f7b69ba1640 1 -- 172.21.15.91:0/2024705236 >> v2:172.21.15.152:3300/0 conn(0x7f7b64157280 msgr2=0x7f7b6406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:17.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.712+0000 7f7b69ba1640 1 --2- 172.21.15.91:0/2024705236 >> v2:172.21.15.152:3300/0 conn(0x7f7b64157280 0x7f7b6406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.712+0000 7f7b69ba1640 1 -- 172.21.15.91:0/2024705236 >> v1:172.21.15.91:6789/0 conn(0x7f7b640c9130 legacy=0x7f7b640ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.712+0000 7f7b69ba1640 1 -- 172.21.15.91:0/2024705236 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64157a30 con 0x7f7b64151460 2023-12-13T22:26:17.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.720+0000 7f7b69ba1640 1 --2- 172.21.15.91:0/2024705236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b640c8bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009870 tx=0x7f7b6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4733634760a95727 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:17.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.724+0000 7f7b68b9f640 1 -- 172.21.15.91:0/2024705236 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab640 con 0x7f7b64151460 2023-12-13T22:26:17.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.724+0000 7f7b68b9f640 1 -- 172.21.15.91:0/2024705236 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b600a7070 con 0x7f7b64151460 2023-12-13T22:26:17.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.724+0000 7f7b68b9f640 1 -- 172.21.15.91:0/2024705236 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab9c0 con 0x7f7b64151460 2023-12-13T22:26:17.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- 172.21.15.91:0/2024705236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 msgr2=0x7f7b640c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2024705236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b640c8bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009870 tx=0x7f7b6001c440 comp rx=0 tx=0).stop 2023-12-13T22:26:17.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- 172.21.15.91:0/2024705236 shutdown_connections 2023-12-13T22:26:17.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2024705236 >> v2:172.21.15.152:3300/0 conn(0x7f7b64157280 0x7f7b6406f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2024705236 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b640c8bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- 172.21.15.91:0/2024705236 >> 172.21.15.91:0/2024705236 conn(0x7f7b640708a0 msgr2=0x7f7b64070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:17.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- 172.21.15.91:0/2024705236 shutdown_connections 2023-12-13T22:26:17.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- 172.21.15.91:0/2024705236 wait complete. 2023-12-13T22:26:17.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 Processor -- start 2023-12-13T22:26:17.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- start start 2023-12-13T22:26:17.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b640c9130 0x7f7b64147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b64157280 0x7f7b6406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640c4ec0 con 0x7f7b64151460 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640c52e0 con 0x7f7b64157280 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6be05640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b64154c80 con 0x7f7b640c9130 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b693a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:17.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b693a0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58128/0 (socket says 172.21.15.91:58128) 2023-12-13T22:26:17.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b693a0640 1 -- 172.21.15.91:0/2345352020 learned_addr learned my addr 172.21.15.91:0/2345352020 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:17.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.728+0000 7f7b6a3a2640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b64157280 0x7f7b6406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:17.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b69ba1640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b640c9130 0x7f7b64147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:17.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b693a0640 1 -- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b640c9130 msgr2=0x7f7b64147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b693a0640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b640c9130 0x7f7b64147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b693a0640 1 -- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b64157280 msgr2=0x7f7b6406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:17.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b693a0640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b64157280 0x7f7b6406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:17.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.732+0000 7f7b693a0640 1 -- 172.21.15.91:0/2345352020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600094d0 con 0x7f7b64151460 2023-12-13T22:26:17.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.736+0000 7f7b693a0640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400b4b0 tx=0x7f7b5400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:17.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.736+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010610 con 0x7f7b64151460 2023-12-13T22:26:17.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.736+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b640af940 con 0x7f7b64151460 2023-12-13T22:26:17.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.736+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641549a0 con 0x7f7b64151460 2023-12-13T22:26:17.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.740+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b640c5000 con 0x7f7b64151460 2023-12-13T22:26:17.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.740+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b540092b0 con 0x7f7b64151460 2023-12-13T22:26:17.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:17.740+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010990 con 0x7f7b64151460 2023-12-13T22:26:18.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.020+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7b54010af0 con 0x7f7b64151460 2023-12-13T22:26:18.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.020+0000 7f7b5a7fc640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 0x7f7b48068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.020+0000 7f7b69ba1640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 0x7f7b48068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.024+0000 7f7b69ba1640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 0x7f7b48068cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b600b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:18.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.052+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b54054ef0 con 0x7f7b64151460 2023-12-13T22:26:18.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.052+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7b54054cc0 con 0x7f7b64151460 2023-12-13T22:26:18.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.216+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b640c5000 con 0x7f7b64151460 2023-12-13T22:26:18.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.228+0000 7f7b5a7fc640 1 -- 172.21.15.91:0/2345352020 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b640c5000 con 0x7f7b64151460 2023-12-13T22:26:18.229 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 msgr2=0x7f7b48068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 0x7f7b48068cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b600b6040 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 msgr2=0x7f7b641f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400b4b0 tx=0x7f7b5400b970 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 shutdown_connections 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7b480667f0 0x7f7b48068cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b64157280 0x7f7b6406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7b64151460 0x7f7b641f13c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 --2- 172.21.15.91:0/2345352020 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b640c9130 0x7f7b64147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 >> 172.21.15.91:0/2345352020 conn(0x7f7b640708a0 msgr2=0x7f7b640c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 shutdown_connections 2023-12-13T22:26:18.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.232+0000 7f7b6be05640 1 -- 172.21.15.91:0/2345352020 wait complete. 2023-12-13T22:26:18.248 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:26:18.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 Processor -- start 2023-12-13T22:26:18.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 -- start start 2023-12-13T22:26:18.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f45640c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f456406b7a0 0x7f45640c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564157450 con 0x7f45641511e0 2023-12-13T22:26:18.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4564158290 con 0x7f456406b7a0 2023-12-13T22:26:18.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456ab00640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4564157710 con 0x7f45641515c0 2023-12-13T22:26:18.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456889c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f45641511e0 0x7f456406a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:53350/0 (socket says 172.21.15.91:53350) 2023-12-13T22:26:18.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456889c640 1 -- 172.21.15.91:0/1219175746 learned_addr learned my addr 172.21.15.91:0/1219175746 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:18.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f456909d640 1 --2- 172.21.15.91:0/1219175746 >> v2:172.21.15.152:3300/0 conn(0x7f456406b7a0 0x7f45640c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.376+0000 7f4563fff640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f45640c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.380+0000 7f45637fe640 1 -- 172.21.15.91:0/1219175746 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184136284 0 0) 0x7f4564157450 con 0x7f45641511e0 2023-12-13T22:26:18.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.380+0000 7f45637fe640 1 -- 172.21.15.91:0/1219175746 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c003530 con 0x7f45641511e0 2023-12-13T22:26:18.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.384+0000 7f456909d640 1 -- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 msgr2=0x7f45640c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:18.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.384+0000 7f456909d640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f45640c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.384+0000 7f456909d640 1 -- 172.21.15.91:0/1219175746 >> v1:172.21.15.91:6789/0 conn(0x7f45641511e0 legacy=0x7f456406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.384+0000 7f456909d640 1 -- 172.21.15.91:0/1219175746 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45641579f0 con 0x7f456406b7a0 2023-12-13T22:26:18.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.392+0000 7f456909d640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f456406b7a0 0x7f45640c4f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d90 tx=0x7f455c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3076ea765c5b1ec4 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:18.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f45637fe640 1 -- 172.21.15.91:0/1219175746 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0af600 con 0x7f456406b7a0 2023-12-13T22:26:18.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f45637fe640 1 -- 172.21.15.91:0/1219175746 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c0ab050 con 0x7f456406b7a0 2023-12-13T22:26:18.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f45637fe640 1 -- 172.21.15.91:0/1219175746 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0af980 con 0x7f456406b7a0 2023-12-13T22:26:18.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f456406b7a0 msgr2=0x7f45640c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f456406b7a0 0x7f45640c4f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f455c009d90 tx=0x7f455c01f130 comp rx=0 tx=0).stop 2023-12-13T22:26:18.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- 172.21.15.91:0/1219175746 shutdown_connections 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f456406b7a0 0x7f45640c4f80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 --2- 172.21.15.91:0/1219175746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f45640c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- 172.21.15.91:0/1219175746 >> 172.21.15.91:0/1219175746 conn(0x7f456406d220 msgr2=0x7f456406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- 172.21.15.91:0/1219175746 shutdown_connections 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- 172.21.15.91:0/1219175746 wait complete. 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 Processor -- start 2023-12-13T22:26:18.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.400+0000 7f456ab00640 1 -- start start 2023-12-13T22:26:18.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45641511e0 0x7f4564139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f456413a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641f0900 con 0x7f456406b7a0 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4564158500 con 0x7f45641511e0 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456ab00640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45641587e0 con 0x7f45641515c0 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456889c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456889c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58132/0 (socket says 172.21.15.91:58132) 2023-12-13T22:26:18.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456889c640 1 -- 172.21.15.91:0/3464094437 learned_addr learned my addr 172.21.15.91:0/3464094437 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:18.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f456909d640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f456413a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.404+0000 7f4563fff640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45641511e0 0x7f4564139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 -- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 msgr2=0x7f456413a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f456413a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 -- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45641511e0 msgr2=0x7f4564139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45641511e0 0x7f4564139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 -- 172.21.15.91:0/3464094437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c009a70 con 0x7f456406b7a0 2023-12-13T22:26:18.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.408+0000 7f456889c640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f455400c480 tx=0x7f455400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:18.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554005cf0 con 0x7f456406b7a0 2023-12-13T22:26:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554005e50 con 0x7f456406b7a0 2023-12-13T22:26:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456406b5b0 con 0x7f456406b7a0 2023-12-13T22:26:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554007290 con 0x7f456406b7a0 2023-12-13T22:26:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45641f0dd0 con 0x7f456406b7a0 2023-12-13T22:26:18.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.412+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564073e70 con 0x7f456406b7a0 2023-12-13T22:26:18.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.688+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f45540073f0 con 0x7f456406b7a0 2023-12-13T22:26:18.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.688+0000 7f45617fa640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 0x7f4550068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:18.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.688+0000 7f4563fff640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 0x7f4550068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:18.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.692+0000 7f4563fff640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 0x7f4550068d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f456414fdc0 tx=0x7f4558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:18.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.708+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4554054b60 con 0x7f456406b7a0 2023-12-13T22:26:18.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.708+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4554050ea0 con 0x7f456406b7a0 2023-12-13T22:26:18.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.904+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45640c2570 con 0x7f456406b7a0 2023-12-13T22:26:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f45617fa640 1 -- 172.21.15.91:0/3464094437 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45540170a0 con 0x7f456406b7a0 2023-12-13T22:26:18.942 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 msgr2=0x7f4550068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 0x7f4550068d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f456414fdc0 tx=0x7f4558008040 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 msgr2=0x7f45640c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f455400c480 tx=0x7f455400c940 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 shutdown_connections 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4550066840 0x7f4550068d00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f45641515c0 0x7f456413a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45641511e0 0x7f4564139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 --2- 172.21.15.91:0/3464094437 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f456406b7a0 0x7f45640c4ca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 >> 172.21.15.91:0/3464094437 conn(0x7f456406d220 msgr2=0x7f456414f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 shutdown_connections 2023-12-13T22:26:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:18.944+0000 7f456ab00640 1 -- 172.21.15.91:0/3464094437 wait complete. 2023-12-13T22:26:18.962 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:26:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 Processor -- start 2023-12-13T22:26:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 -- start start 2023-12-13T22:26:19.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f391c0ce960 0x7f391c159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c153cd0 con 0x7f391c1538f0 2023-12-13T22:26:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0cda00 con 0x7f391c0ce960 2023-12-13T22:26:19.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.080+0000 7f3922910640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c159510 con 0x7f391c0cd090 2023-12-13T22:26:19.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.176+0000 7f3920ead640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:19.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.180+0000 7f3920ead640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:43018/0 (socket says 172.21.15.91:43018) 2023-12-13T22:26:19.178 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.180+0000 7f3920ead640 1 -- 172.21.15.91:0/275678971 learned_addr learned my addr 172.21.15.91:0/275678971 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:19.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.184+0000 7f3920ead640 1 -- 172.21.15.91:0/275678971 >> v2:172.21.15.152:3300/0 conn(0x7f391c0ce960 msgr2=0x7f391c159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:19.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.184+0000 7f3920ead640 1 --2- 172.21.15.91:0/275678971 >> v2:172.21.15.152:3300/0 conn(0x7f391c0ce960 0x7f391c159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.184+0000 7f3920ead640 1 -- 172.21.15.91:0/275678971 >> v1:172.21.15.152:6789/0 conn(0x7f391c1538f0 legacy=0x7f391c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:19.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.184+0000 7f3920ead640 1 -- 172.21.15.91:0/275678971 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0c9ff0 con 0x7f391c0cd090 2023-12-13T22:26:19.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.192+0000 7f3920ead640 1 --2- 172.21.15.91:0/275678971 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3914009e50 tx=0x7f391401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc690a66d6b62cc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f391b7fe640 1 -- 172.21.15.91:0/275678971 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140af400 con 0x7f391c0cd090 2023-12-13T22:26:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f391b7fe640 1 -- 172.21.15.91:0/275678971 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140ab050 con 0x7f391c0cd090 2023-12-13T22:26:19.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f391b7fe640 1 -- 172.21.15.91:0/275678971 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140af780 con 0x7f391c0cd090 2023-12-13T22:26:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 -- 172.21.15.91:0/275678971 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 msgr2=0x7f391c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 --2- 172.21.15.91:0/275678971 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3914009e50 tx=0x7f391401f1c0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 -- 172.21.15.91:0/275678971 shutdown_connections 2023-12-13T22:26:19.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 --2- 172.21.15.91:0/275678971 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd090 0x7f391c159ea0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 --2- 172.21.15.91:0/275678971 >> v2:172.21.15.152:3300/0 conn(0x7f391c0ce960 0x7f391c159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 -- 172.21.15.91:0/275678971 >> 172.21.15.91:0/275678971 conn(0x7f391c0b0920 msgr2=0x7f391c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 -- 172.21.15.91:0/275678971 shutdown_connections 2023-12-13T22:26:19.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.200+0000 7f3922910640 1 -- 172.21.15.91:0/275678971 wait complete. 2023-12-13T22:26:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 Processor -- start 2023-12-13T22:26:19.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 -- start start 2023-12-13T22:26:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f391c0cd090 0x7f391c143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c144200 0x7f391c1475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c145840 con 0x7f391c0cd090 2023-12-13T22:26:19.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c14a2f0 con 0x7f391c144200 2023-12-13T22:26:19.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.204+0000 7f3922910640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c143ff0 con 0x7f391c1538f0 2023-12-13T22:26:19.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.208+0000 7f39137fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.208+0000 7f39137fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:43020/0 (socket says 172.21.15.91:43020) 2023-12-13T22:26:19.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.208+0000 7f39137fe640 1 -- 172.21.15.91:0/367688476 learned_addr learned my addr 172.21.15.91:0/367688476 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:19.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.212+0000 7f3920ead640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c144200 0x7f391c1475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.216+0000 7f39137fe640 1 -- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c144200 msgr2=0x7f391c1475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.216+0000 7f39137fe640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c144200 0x7f391c1475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.216+0000 7f39137fe640 1 -- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f391c0cd090 msgr2=0x7f391c143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:19.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.216+0000 7f39137fe640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f391c0cd090 0x7f391c143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:19.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.216+0000 7f39137fe640 1 -- 172.21.15.91:0/367688476 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009b30 con 0x7f391c1538f0 2023-12-13T22:26:19.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.220+0000 7f39137fe640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f390400b550 tx=0x7f390400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904010870 con 0x7f391c1538f0 2023-12-13T22:26:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040109f0 con 0x7f391c1538f0 2023-12-13T22:26:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904010da0 con 0x7f391c1538f0 2023-12-13T22:26:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c144ee0 con 0x7f391c1538f0 2023-12-13T22:26:19.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c145180 con 0x7f391c1538f0 2023-12-13T22:26:19.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.228+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c145980 con 0x7f391c1538f0 2023-12-13T22:26:19.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.548+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3904023480 con 0x7f391c1538f0 2023-12-13T22:26:19.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.548+0000 7f39197fa640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 0x7f38fc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:19.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.548+0000 7f391bfff640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 0x7f38fc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:19.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.552+0000 7f391bfff640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 0x7f38fc068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f390c009650 tx=0x7f390c006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:19.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.560+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39040552f0 con 0x7f391c1538f0 2023-12-13T22:26:19.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.676+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3904051630 con 0x7f391c1538f0 2023-12-13T22:26:19.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:19.844+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f391c145980 con 0x7f391c1538f0 2023-12-13T22:26:20.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f39197fa640 1 -- 172.21.15.91:0/367688476 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f391c145980 con 0x7f391c1538f0 2023-12-13T22:26:20.030 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:26:20.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 msgr2=0x7f38fc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 0x7f38fc068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f390c009650 tx=0x7f390c006bb0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 msgr2=0x7f391c1470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f390400b550 tx=0x7f390400ba10 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 shutdown_connections 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f38fc066870 0x7f38fc068d30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c144200 0x7f391c1475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c1538f0 0x7f391c1470b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 --2- 172.21.15.91:0/367688476 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f391c0cd090 0x7f391c143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 >> 172.21.15.91:0/367688476 conn(0x7f391c0b0920 msgr2=0x7f391c1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:20.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 shutdown_connections 2023-12-13T22:26:20.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.032+0000 7f3922910640 1 -- 172.21.15.91:0/367688476 wait complete. 2023-12-13T22:26:20.055 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:26:20.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 Processor -- start 2023-12-13T22:26:20.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 -- start start 2023-12-13T22:26:20.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2fb00719c0 0x7f2fb0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00c31e0 con 0x7f2fb014fdc0 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00c25e0 con 0x7f2fb00c4490 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fb4802640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00c4070 con 0x7f2fb00719c0 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fae59c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2fb014fdc0 0x7f2fb00c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33926/0 (socket says 172.21.15.91:33926) 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fae59c640 1 -- 172.21.15.91:0/1393733016 learned_addr learned my addr 172.21.15.91:0/1393733016 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.184+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1393733016 >> v2:172.21.15.152:3300/0 conn(0x7f2fb00719c0 0x7f2fb0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.188+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512031082 0 0) 0x7f2fb00c31e0 con 0x7f2fb014fdc0 2023-12-13T22:26:20.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.188+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f98003450 con 0x7f2fb014fdc0 2023-12-13T22:26:20.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847215029 0 0) 0x7f2f98003450 con 0x7f2fb014fdc0 2023-12-13T22:26:20.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 >> v2:172.21.15.152:3300/0 conn(0x7f2fb00719c0 msgr2=0x7f2fb0070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 --2- 172.21.15.91:0/1393733016 >> v2:172.21.15.152:3300/0 conn(0x7f2fb00719c0 0x7f2fb0070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 >> v1:172.21.15.152:6789/0 conn(0x7f2fb00c4490 legacy=0x7f2fb006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00c3cd0 con 0x7f2fb014fdc0 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f2fa4001680 con 0x7f2fb014fdc0 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 >> v1:172.21.15.91:6789/0 conn(0x7f2fb014fdc0 legacy=0x7f2fb00c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f98003b30 0x7f2f98003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 0x7f2f9800ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f9800b5e0 0x7f2f9800daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c4070 con 0x7f2f980088b0 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9800e380 con 0x7f2f9800b5e0 2023-12-13T22:26:20.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9800e540 con 0x7f2f98003b30 2023-12-13T22:26:20.193 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.192+0000 7f2fae59c640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f98003b30 0x7f2f98003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 0x7f2f9800ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 -- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f98003b30 msgr2=0x7f2f98003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f98003b30 0x7f2f98003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 -- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f9800b5e0 msgr2=0x7f2f9800daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f9800b5e0 0x7f2f9800daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2fadd9b640 1 -- 172.21.15.91:0/1393733016 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98003450 con 0x7f2f980088b0 2023-12-13T22:26:20.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.196+0000 7f2faed9d640 1 -- 172.21.15.91:0/1393733016 reap_dead start 2023-12-13T22:26:20.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.200+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 0x7f2f9800ad40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009ab0 tx=0x7f2fa001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d710998aa961f046 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:20.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00a5620 con 0x7f2f980088b0 2023-12-13T22:26:20.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa00a5780 con 0x7f2f980088b0 2023-12-13T22:26:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fad59a640 1 -- 172.21.15.91:0/1393733016 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00a5b70 con 0x7f2f980088b0 2023-12-13T22:26:20.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 -- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 msgr2=0x7f2f9800ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 0x7f2f9800ad40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009ab0 tx=0x7f2fa001ca30 comp rx=0 tx=0).stop 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 -- 172.21.15.91:0/1393733016 shutdown_connections 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1393733016 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2f980088b0 0x7f2f9800ad40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 -- 172.21.15.91:0/1393733016 >> 172.21.15.91:0/1393733016 conn(0x7f2fb006c6a0 msgr2=0x7f2fb006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 -- 172.21.15.91:0/1393733016 shutdown_connections 2023-12-13T22:26:20.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.204+0000 7f2fb4802640 1 -- 172.21.15.91:0/1393733016 wait complete. 2023-12-13T22:26:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 Processor -- start 2023-12-13T22:26:20.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 -- start start 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f980088b0 0x7f2fb01f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb0157ec0 0x7f2fb01f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0143e00 con 0x7f2fb0141f00 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb01f1140 con 0x7f2fb0157ec0 2023-12-13T22:26:20.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fb4802640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0144b20 con 0x7f2f980088b0 2023-12-13T22:26:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2faed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2faed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53506/0 (socket says 172.21.15.91:53506) 2023-12-13T22:26:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2faed9d640 1 -- 172.21.15.91:0/1783504058 learned_addr learned my addr 172.21.15.91:0/1783504058 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:20.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.208+0000 7f2fae59c640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f980088b0 0x7f2fb01f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2fadd9b640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb0157ec0 0x7f2fb01f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2faed9d640 1 -- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f980088b0 msgr2=0x7f2fb01f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2faed9d640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f980088b0 0x7f2fb01f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2faed9d640 1 -- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb0157ec0 msgr2=0x7f2fb01f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2faed9d640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb0157ec0 0x7f2fb01f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.212+0000 7f2faed9d640 1 -- 172.21.15.91:0/1783504058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb01428c0 con 0x7f2fb0141f00 2023-12-13T22:26:20.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.216+0000 7f2faed9d640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fb006e0b0 tx=0x7f2fa800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8003c80 con 0x7f2fb0141f00 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80070d0 con 0x7f2fb0141f00 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb0156af0 con 0x7f2fb0141f00 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8007480 con 0x7f2fb0141f00 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb0144280 con 0x7f2fb0141f00 2023-12-13T22:26:20.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.220+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb01f1280 con 0x7f2fb0141f00 2023-12-13T22:26:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.240+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2fa80075e0 con 0x7f2fb0141f00 2023-12-13T22:26:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.240+0000 7f2f9effd640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 0x7f2f90068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.240+0000 7f2fae59c640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 0x7f2f90068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.240+0000 7f2fae59c640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 0x7f2f90068d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40017b0 tx=0x7f2fa4001b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:20.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.244+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fa8054800 con 0x7f2fb0141f00 2023-12-13T22:26:20.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.504+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2fa8050b40 con 0x7f2fb0141f00 2023-12-13T22:26:20.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.668+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fb01f1280 con 0x7f2fb0141f00 2023-12-13T22:26:20.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.676+0000 7f2f9effd640 1 -- 172.21.15.91:0/1783504058 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fb01f1280 con 0x7f2fb0141f00 2023-12-13T22:26:20.677 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 msgr2=0x7f2f90068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 0x7f2f90068d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40017b0 tx=0x7f2fa4001b80 comp rx=0 tx=0).stop 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 msgr2=0x7f2fb0142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fb006e0b0 tx=0x7f2fa800c890 comp rx=0 tx=0).stop 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 shutdown_connections 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2f90066870 0x7f2f90068d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fb0141f00 0x7f2fb0142380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fb0157ec0 0x7f2fb01f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 --2- 172.21.15.91:0/1783504058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f980088b0 0x7f2fb01f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 >> 172.21.15.91:0/1783504058 conn(0x7f2fb006c6a0 msgr2=0x7f2fb00c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 shutdown_connections 2023-12-13T22:26:20.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.680+0000 7f2fb4802640 1 -- 172.21.15.91:0/1783504058 wait complete. 2023-12-13T22:26:20.696 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T22:26:20.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 Processor -- start 2023-12-13T22:26:20.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 -- start start 2023-12-13T22:26:20.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb01511e0 0x7fdbb006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb006b7a0 0x7fdbb015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb0157450 con 0x7fdbb01515c0 2023-12-13T22:26:20.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb0158290 con 0x7fdbb01511e0 2023-12-13T22:26:20.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbb4f78640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0157710 con 0x7fdbb006b7a0 2023-12-13T22:26:20.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.812+0000 7fdbae59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb01511e0 0x7fdbb006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdbb01511e0 0x7fdbb006a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53512/0 (socket says 172.21.15.91:53512) 2023-12-13T22:26:20.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 -- 172.21.15.91:0/3197158276 learned_addr learned my addr 172.21.15.91:0/3197158276 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:20.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbaed9d640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb006b7a0 0x7fdbb015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 -- 172.21.15.91:0/3197158276 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb006b7a0 msgr2=0x7fdbb015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:20.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb006b7a0 0x7fdbb015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 -- 172.21.15.91:0/3197158276 >> v1:172.21.15.91:6789/0 conn(0x7fdbb01515c0 legacy=0x7fdbb00c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.816+0000 7fdbae59c640 1 -- 172.21.15.91:0/3197158276 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb01579f0 con 0x7fdbb01511e0 2023-12-13T22:26:20.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.824+0000 7fdbae59c640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb006a560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bf0ebe2dc626f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:20.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.828+0000 7fdbad59a640 1 -- 172.21.15.91:0/3197158276 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00a8a30 con 0x7fdbb01511e0 2023-12-13T22:26:20.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.828+0000 7fdbad59a640 1 -- 172.21.15.91:0/3197158276 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba00a8b90 con 0x7fdbb01511e0 2023-12-13T22:26:20.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.828+0000 7fdbad59a640 1 -- 172.21.15.91:0/3197158276 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00b0440 con 0x7fdbb01511e0 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- 172.21.15.91:0/3197158276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 msgr2=0x7fdbb006a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb006a560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009870 tx=0x7fdba001ed30 comp rx=0 tx=0).stop 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- 172.21.15.91:0/3197158276 shutdown_connections 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb006b7a0 0x7fdbb015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/3197158276 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb006a560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- 172.21.15.91:0/3197158276 >> 172.21.15.91:0/3197158276 conn(0x7fdbb006d220 msgr2=0x7fdbb006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- 172.21.15.91:0/3197158276 shutdown_connections 2023-12-13T22:26:20.830 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- 172.21.15.91:0/3197158276 wait complete. 2023-12-13T22:26:20.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 Processor -- start 2023-12-13T22:26:20.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- start start 2023-12-13T22:26:20.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbb006b7a0 0x7fdbb01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb01515c0 0x7fdbb014e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb014f470 con 0x7fdbb01511e0 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0156130 con 0x7fdbb006b7a0 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbb4f78640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01eb530 con 0x7fdbb01515c0 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbadd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbadd9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53520/0 (socket says 172.21.15.91:53520) 2023-12-13T22:26:20.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbadd9b640 1 -- 172.21.15.91:0/430902034 learned_addr learned my addr 172.21.15.91:0/430902034 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:20.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.832+0000 7fdbae59c640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbb006b7a0 0x7fdbb01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.836+0000 7fdbadd9b640 1 -- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb01515c0 msgr2=0x7fdbb014e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.836+0000 7fdbadd9b640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb01515c0 0x7fdbb014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.836+0000 7fdbadd9b640 1 -- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbb006b7a0 msgr2=0x7fdbb01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:20.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.836+0000 7fdbadd9b640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbb006b7a0 0x7fdbb01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:20.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.836+0000 7fdbadd9b640 1 -- 172.21.15.91:0/430902034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00094d0 con 0x7fdbb01511e0 2023-12-13T22:26:20.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.840+0000 7fdbadd9b640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c370 tx=0x7fdba400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:20.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40052d0 con 0x7fdbb01511e0 2023-12-13T22:26:20.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4005430 con 0x7fdbb01511e0 2023-12-13T22:26:20.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4007240 con 0x7fdbb01511e0 2023-12-13T22:26:20.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb01eb810 con 0x7fdbb01511e0 2023-12-13T22:26:20.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb014df30 con 0x7fdbb01511e0 2023-12-13T22:26:20.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.844+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb014daa0 con 0x7fdbb01511e0 2023-12-13T22:26:20.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.864+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdba40073a0 con 0x7fdbb01511e0 2023-12-13T22:26:20.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.864+0000 7fdb9effd640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 0x7fdb90068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:20.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.864+0000 7fdbae59c640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 0x7fdb90068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:20.862 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:20.864+0000 7fdbae59c640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 0x7fdb90068d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdba00b2000 tx=0x7fdba00aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:21.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.116+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdba4007650 con 0x7fdbb01511e0 2023-12-13T22:26:21.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.116+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdba4050bf0 con 0x7fdbb01511e0 2023-12-13T22:26:21.283 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.284+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdbb014e150 con 0x7fdbb01511e0 2023-12-13T22:26:21.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.360+0000 7fdb9effd640 1 -- 172.21.15.91:0/430902034 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdba4020020 con 0x7fdbb01511e0 2023-12-13T22:26:21.358 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 msgr2=0x7fdb90068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 0x7fdb90068d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdba00b2000 tx=0x7fdba00aa070 comp rx=0 tx=0).stop 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 msgr2=0x7fdbb014e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c370 tx=0x7fdba400c830 comp rx=0 tx=0).stop 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 shutdown_connections 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb90066840 0x7fdb90068d00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbb01515c0 0x7fdbb014e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdbb01511e0 0x7fdbb014e450 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 --2- 172.21.15.91:0/430902034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbb006b7a0 0x7fdbb01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 >> 172.21.15.91:0/430902034 conn(0x7fdbb006d220 msgr2=0x7fdbb0143f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:21.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 shutdown_connections 2023-12-13T22:26:21.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.364+0000 7fdbb4f78640 1 -- 172.21.15.91:0/430902034 wait complete. 2023-12-13T22:26:21.382 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:26:21.382 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T22:26:21.387 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 Processor -- start 2023-12-13T22:26:21.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 -- start start 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 0x7fe84006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe8400c40e0 0x7fe8400c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84006f4a0 con 0x7fe840151720 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe840072570 con 0x7fe8400c40e0 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe847d79640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe840070be0 con 0x7fe840151340 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe845314640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe840151720 0x7fe840157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33934/0 (socket says 172.21.15.91:33934) 2023-12-13T22:26:21.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.544+0000 7fe845314640 1 -- 172.21.15.91:0/1887629455 learned_addr learned my addr 172.21.15.91:0/1887629455 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.548+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302685395 0 0) 0x7fe84006f4a0 con 0x7fe840151720 2023-12-13T22:26:21.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.548+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c003530 con 0x7fe840151720 2023-12-13T22:26:21.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462676227 0 0) 0x7fe82c003530 con 0x7fe840151720 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 msgr2=0x7fe84006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 0x7fe84006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 >> v2:172.21.15.152:3300/0 conn(0x7fe8400c40e0 msgr2=0x7fe8400c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 --2- 172.21.15.91:0/1887629455 >> v2:172.21.15.152:3300/0 conn(0x7fe8400c40e0 0x7fe8400c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840070e80 con 0x7fe840151720 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fe830001680 con 0x7fe840151720 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 >> v1:172.21.15.91:6789/0 conn(0x7fe840151720 legacy=0x7fe840157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c0039f0 0x7fe82c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe82c0047d0 0x7fe82c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 0x7fe82c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840070be0 con 0x7fe82c0047d0 2023-12-13T22:26:21.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c005540 con 0x7fe82c0039f0 2023-12-13T22:26:21.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c00bed0 con 0x7fe840151340 2023-12-13T22:26:21.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.552+0000 7fe845314640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe82c0047d0 0x7fe82c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:21.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.556+0000 7fe845314640 1 -- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 msgr2=0x7fe82c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:21.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.556+0000 7fe845314640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe840151340 0x7fe82c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.556+0000 7fe845314640 1 -- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c0039f0 msgr2=0x7fe82c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:21.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.556+0000 7fe845314640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c0039f0 0x7fe82c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.555 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.556+0000 7fe845314640 1 -- 172.21.15.91:0/1887629455 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c003530 con 0x7fe82c0047d0 2023-12-13T22:26:21.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.560+0000 7fe845314640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe82c0047d0 0x7fe82c004c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c160 tx=0x7fe83001f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4747ea746801fce server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:21.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830005ae0 con 0x7fe82c0047d0 2023-12-13T22:26:21.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8300ab070 con 0x7fe82c0047d0 2023-12-13T22:26:21.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe844b13640 1 -- 172.21.15.91:0/1887629455 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830007070 con 0x7fe82c0047d0 2023-12-13T22:26:21.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 -- 172.21.15.91:0/1887629455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe82c0047d0 msgr2=0x7fe82c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 --2- 172.21.15.91:0/1887629455 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe82c0047d0 0x7fe82c004c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe83000c160 tx=0x7fe83001f2f0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe846316640 1 -- 172.21.15.91:0/1887629455 reap_dead start 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 -- 172.21.15.91:0/1887629455 shutdown_connections 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 -- 172.21.15.91:0/1887629455 >> 172.21.15.91:0/1887629455 conn(0x7fe84006c6a0 msgr2=0x7fe84006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 -- 172.21.15.91:0/1887629455 shutdown_connections 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.564+0000 7fe847d79640 1 -- 172.21.15.91:0/1887629455 wait complete. 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 Processor -- start 2023-12-13T22:26:21.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 -- start start 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8401585f0 0x7fe8400c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe8401589d0 0x7fe8400c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401efd10 con 0x7fe840159e80 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401ef140 con 0x7fe8401585f0 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe847d79640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401ef3e0 con 0x7fe8401589d0 2023-12-13T22:26:21.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe846316640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:21.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe846316640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53534/0 (socket says 172.21.15.91:53534) 2023-12-13T22:26:21.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.568+0000 7fe846316640 1 -- 172.21.15.91:0/368390892 learned_addr learned my addr 172.21.15.91:0/368390892 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:21.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.572+0000 7fe846316640 1 -- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe8401589d0 msgr2=0x7fe8400c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.572+0000 7fe846316640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe8401589d0 0x7fe8400c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.572+0000 7fe846316640 1 -- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8401585f0 msgr2=0x7fe8400c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:21.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.572+0000 7fe846316640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8401585f0 0x7fe8400c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:21.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.572+0000 7fe846316640 1 -- 172.21.15.91:0/368390892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8401ef6c0 con 0x7fe840159e80 2023-12-13T22:26:21.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.576+0000 7fe846316640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe840158360 tx=0x7fe83800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:21.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.576+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800a810 con 0x7fe840159e80 2023-12-13T22:26:21.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.576+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8401ef9a0 con 0x7fe840159e80 2023-12-13T22:26:21.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.576+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840149d90 con 0x7fe840159e80 2023-12-13T22:26:21.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.576+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8400c6cb0 con 0x7fe840159e80 2023-12-13T22:26:21.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.580+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838003fe0 con 0x7fe840159e80 2023-12-13T22:26:21.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.580+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800ab70 con 0x7fe840159e80 2023-12-13T22:26:21.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.860+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe838005d50 con 0x7fe840159e80 2023-12-13T22:26:21.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.860+0000 7fe8367fc640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 0x7fe824068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:21.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.860+0000 7fe845b15640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 0x7fe824068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:21.860 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.860+0000 7fe845b15640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 0x7fe824068cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0096b0 tx=0x7fe83c006cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:21.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.896+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe838055260 con 0x7fe840159e80 2023-12-13T22:26:21.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:21.896+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe838054930 con 0x7fe840159e80 2023-12-13T22:26:22.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.060+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe840067520 con 0x7fe840159e80 2023-12-13T22:26:22.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.156+0000 7fe8367fc640 1 -- 172.21.15.91:0/368390892 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fe8380544c0 con 0x7fe840159e80 2023-12-13T22:26:22.155 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:22.156 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:22.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 msgr2=0x7fe824068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 0x7fe824068cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0096b0 tx=0x7fe83c006cb0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 msgr2=0x7fe8400c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe840158360 tx=0x7fe83800cb60 comp rx=0 tx=0).stop 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 shutdown_connections 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe8240667f0 0x7fe824068cb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe840159e80 0x7fe8400c2510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe8401589d0 0x7fe8400c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 --2- 172.21.15.91:0/368390892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8401585f0 0x7fe8400c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 >> 172.21.15.91:0/368390892 conn(0x7fe84006c6a0 msgr2=0x7fe8400c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 shutdown_connections 2023-12-13T22:26:22.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.160+0000 7fe847d79640 1 -- 172.21.15.91:0/368390892 wait complete. 2023-12-13T22:26:22.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:26:22.179 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:26:22.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.308+0000 7fdaa3c02640 1 Processor -- start 2023-12-13T22:26:22.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.308+0000 7fdaa3c02640 1 -- start start 2023-12-13T22:26:22.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.308+0000 7fdaa3c02640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 0x7fda9c0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.308+0000 7fdaa3c02640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda9c0c66d0 0x7fda9c0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.312+0000 7fdaa3c02640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c159590 con 0x7fda9c159a20 2023-12-13T22:26:22.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.312+0000 7fdaa3c02640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c155fa0 con 0x7fda9c0c66d0 2023-12-13T22:26:22.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.312+0000 7fdaa3c02640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c072c10 con 0x7fda9c0722f0 2023-12-13T22:26:22.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.388+0000 7fdaa219f640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fda9c159a20 0x7fda9c0c2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:38428/0 (socket says 172.21.15.91:38428) 2023-12-13T22:26:22.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.388+0000 7fdaa219f640 1 -- 172.21.15.91:0/3630139206 learned_addr learned my addr 172.21.15.91:0/3630139206 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:22.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.388+0000 7fdaa199e640 1 --2- 172.21.15.91:0/3630139206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 0x7fda9c0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.392+0000 7fdaa119d640 1 --2- 172.21.15.91:0/3630139206 >> v2:172.21.15.152:3300/0 conn(0x7fda9c0c66d0 0x7fda9c0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.396+0000 7fdaa199e640 1 -- 172.21.15.91:0/3630139206 >> v2:172.21.15.152:3300/0 conn(0x7fda9c0c66d0 msgr2=0x7fda9c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:22.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.396+0000 7fdaa199e640 1 --2- 172.21.15.91:0/3630139206 >> v2:172.21.15.152:3300/0 conn(0x7fda9c0c66d0 0x7fda9c0c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.396+0000 7fdaa199e640 1 -- 172.21.15.91:0/3630139206 >> v1:172.21.15.152:6789/0 conn(0x7fda9c159a20 legacy=0x7fda9c0c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.396+0000 7fdaa199e640 1 -- 172.21.15.91:0/3630139206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c156190 con 0x7fda9c0722f0 2023-12-13T22:26:22.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.404+0000 7fdaa199e640 1 --2- 172.21.15.91:0/3630139206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 0x7fda9c0726d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda98009d90 tx=0x7fda9801eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce2fc7880d29ac server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:22.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.404+0000 7fdaa099c640 1 -- 172.21.15.91:0/3630139206 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980a7b70 con 0x7fda9c0722f0 2023-12-13T22:26:22.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa099c640 1 -- 172.21.15.91:0/3630139206 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980a7cd0 con 0x7fda9c0722f0 2023-12-13T22:26:22.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa099c640 1 -- 172.21.15.91:0/3630139206 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980af660 con 0x7fda9c0722f0 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 -- 172.21.15.91:0/3630139206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 msgr2=0x7fda9c0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/3630139206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 0x7fda9c0726d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda98009d90 tx=0x7fda9801eaa0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 -- 172.21.15.91:0/3630139206 shutdown_connections 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/3630139206 >> v2:172.21.15.152:3300/0 conn(0x7fda9c0c66d0 0x7fda9c0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/3630139206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0722f0 0x7fda9c0726d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 -- 172.21.15.91:0/3630139206 >> 172.21.15.91:0/3630139206 conn(0x7fda9c06b670 msgr2=0x7fda9c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 -- 172.21.15.91:0/3630139206 shutdown_connections 2023-12-13T22:26:22.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.408+0000 7fdaa3c02640 1 -- 172.21.15.91:0/3630139206 wait complete. 2023-12-13T22:26:22.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 Processor -- start 2023-12-13T22:26:22.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 -- start start 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c0722f0 0x7fda9c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0c66d0 0x7fda9c144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1556a0 con 0x7fda9c159a20 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1592b0 con 0x7fda9c0722f0 2023-12-13T22:26:22.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa3c02640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1578e0 con 0x7fda9c0c66d0 2023-12-13T22:26:22.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa219f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa199e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c0722f0 0x7fda9c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa219f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53550/0 (socket says 172.21.15.91:53550) 2023-12-13T22:26:22.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.412+0000 7fdaa219f640 1 -- 172.21.15.91:0/2877694249 learned_addr learned my addr 172.21.15.91:0/2877694249 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:22.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa119d640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0c66d0 0x7fda9c144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa219f640 1 -- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0c66d0 msgr2=0x7fda9c144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa219f640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0c66d0 0x7fda9c144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa219f640 1 -- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c0722f0 msgr2=0x7fda9c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa219f640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c0722f0 0x7fda9c157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.420+0000 7fdaa219f640 1 -- 172.21.15.91:0/2877694249 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009a70 con 0x7fda9c159a20 2023-12-13T22:26:22.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.432+0000 7fdaa219f640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c430 tx=0x7fda9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94005cf0 con 0x7fda9c159a20 2023-12-13T22:26:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94005e50 con 0x7fda9c159a20 2023-12-13T22:26:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940072d0 con 0x7fda9c159a20 2023-12-13T22:26:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c158d70 con 0x7fda9c159a20 2023-12-13T22:26:22.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1582b0 con 0x7fda9c159a20 2023-12-13T22:26:22.435 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.436+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c1f6d90 con 0x7fda9c159a20 2023-12-13T22:26:22.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.720+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fda94007430 con 0x7fda9c159a20 2023-12-13T22:26:22.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.720+0000 7fda927fc640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 0x7fda80068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:22.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.720+0000 7fdaa199e640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 0x7fda80068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:22.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.720+0000 7fdaa199e640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 0x7fda80068d30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1000 tx=0x7fda980a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:22.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.760+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda94054b20 con 0x7fda9c159a20 2023-12-13T22:26:22.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.764+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fda94050e60 con 0x7fda9c159a20 2023-12-13T22:26:22.932 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.932+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda9c157a50 con 0x7fda9c159a20 2023-12-13T22:26:22.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.968+0000 7fda927fc640 1 -- 172.21.15.91:0/2877694249 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda940170a0 con 0x7fda9c159a20 2023-12-13T22:26:22.968 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 msgr2=0x7fda80068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 0x7fda80068d30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda980b1000 tx=0x7fda980a9070 comp rx=0 tx=0).stop 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 msgr2=0x7fda9c1454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c430 tx=0x7fda9400c8f0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 shutdown_connections 2023-12-13T22:26:22.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda80066870 0x7fda80068d30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda9c159a20 0x7fda9c1454c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0c66d0 0x7fda9c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 --2- 172.21.15.91:0/2877694249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c0722f0 0x7fda9c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 >> 172.21.15.91:0/2877694249 conn(0x7fda9c06b670 msgr2=0x7fda9c146370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 shutdown_connections 2023-12-13T22:26:22.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:22.972+0000 7fdaa3c02640 1 -- 172.21.15.91:0/2877694249 wait complete. 2023-12-13T22:26:22.990 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:26:23.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 Processor -- start 2023-12-13T22:26:23.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 -- start start 2023-12-13T22:26:23.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 0x7f5f900ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5f9015a280 0x7f5f90163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900cd9a0 con 0x7f5f900ce0c0 2023-12-13T22:26:23.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900ca550 con 0x7f5f9015a280 2023-12-13T22:26:23.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f981dc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900ce9e0 con 0x7f5f900cc3c0 2023-12-13T22:26:23.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f95f78640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5f900ce0c0 0x7f5f90159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33948/0 (socket says 172.21.15.91:33948) 2023-12-13T22:26:23.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.120+0000 7f5f95f78640 1 -- 172.21.15.91:0/600101744 learned_addr learned my addr 172.21.15.91:0/600101744 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:23.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.124+0000 7f5f95777640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 0x7f5f900ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.124+0000 7f5f96779640 1 --2- 172.21.15.91:0/600101744 >> v2:172.21.15.152:3300/0 conn(0x7f5f9015a280 0x7f5f90163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.124+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138267070 0 0) 0x7f5f900cd9a0 con 0x7f5f900ce0c0 2023-12-13T22:26:23.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.124+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f7c003530 con 0x7f5f900ce0c0 2023-12-13T22:26:23.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073222138 0 0) 0x7f5f7c003530 con 0x7f5f900ce0c0 2023-12-13T22:26:23.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 msgr2=0x7f5f900ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 0x7f5f900ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 >> v2:172.21.15.152:3300/0 conn(0x7f5f9015a280 msgr2=0x7f5f90163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 --2- 172.21.15.91:0/600101744 >> v2:172.21.15.152:3300/0 conn(0x7f5f9015a280 0x7f5f90163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f901596c0 con 0x7f5f900ce0c0 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f5f88001680 con 0x7f5f900ce0c0 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 >> v1:172.21.15.91:6789/0 conn(0x7f5f900ce0c0 legacy=0x7f5f90159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f7c0039f0 0x7f5f7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c0047d0 0x7f5f7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 0x7f5f7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900ce9e0 con 0x7f5f7c0039f0 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c00b990 con 0x7f5f7c0047d0 2023-12-13T22:26:23.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.128+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c00bb20 con 0x7f5f900cc3c0 2023-12-13T22:26:23.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.132+0000 7f5f95f78640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f7c0039f0 0x7f5f7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95777640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c0047d0 0x7f5f7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95f78640 1 -- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 msgr2=0x7f5f7c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95f78640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f900cc3c0 0x7f5f7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95f78640 1 -- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c0047d0 msgr2=0x7f5f7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95f78640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f7c0047d0 0x7f5f7c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.136+0000 7f5f95f78640 1 -- 172.21.15.91:0/600101744 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c003530 con 0x7f5f7c0039f0 2023-12-13T22:26:23.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.140+0000 7f5f95f78640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f7c0039f0 0x7f5f7c003e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c110 tx=0x7f5f8801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf1968929e0ad32 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:23.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880058e0 con 0x7f5f7c0039f0 2023-12-13T22:26:23.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88005a40 con 0x7f5f7c0039f0 2023-12-13T22:26:23.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f94f76640 1 -- 172.21.15.91:0/600101744 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88005e30 con 0x7f5f7c0039f0 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- 172.21.15.91:0/600101744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f7c0039f0 msgr2=0x7f5f7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 --2- 172.21.15.91:0/600101744 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f7c0039f0 0x7f5f7c003e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c110 tx=0x7f5f8801cb60 comp rx=0 tx=0).stop 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f96779640 1 -- 172.21.15.91:0/600101744 reap_dead start 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- 172.21.15.91:0/600101744 shutdown_connections 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- 172.21.15.91:0/600101744 >> 172.21.15.91:0/600101744 conn(0x7f5f900b07c0 msgr2=0x7f5f900b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- 172.21.15.91:0/600101744 shutdown_connections 2023-12-13T22:26:23.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- 172.21.15.91:0/600101744 wait complete. 2023-12-13T22:26:23.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 Processor -- start 2023-12-13T22:26:23.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.144+0000 7f5f981dc640 1 -- start start 2023-12-13T22:26:23.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f901e9ef0 0x7f5f901f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f900c8780 0x7f5f9014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f901f77c0 con 0x7f5f901e9b10 2023-12-13T22:26:23.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c8f80 con 0x7f5f900c8780 2023-12-13T22:26:23.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f981dc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f901f6a40 con 0x7f5f901e9ef0 2023-12-13T22:26:23.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f95f78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f96779640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f900c8780 0x7f5f9014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f95f78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53564/0 (socket says 172.21.15.91:53564) 2023-12-13T22:26:23.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f95f78640 1 -- 172.21.15.91:0/2295376835 learned_addr learned my addr 172.21.15.91:0/2295376835 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:23.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.148+0000 7f5f95777640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f901e9ef0 0x7f5f901f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 -- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f901e9ef0 msgr2=0x7f5f901f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f901e9ef0 0x7f5f901f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 -- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f900c8780 msgr2=0x7f5f9014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f900c8780 0x7f5f9014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 -- 172.21.15.91:0/2295376835 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900c8ca0 con 0x7f5f901e9b10 2023-12-13T22:26:23.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.152+0000 7f5f95f78640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f8801d400 tx=0x7f5f7c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:23.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88006ec0 con 0x7f5f901e9b10 2023-12-13T22:26:23.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880048b0 con 0x7f5f901e9b10 2023-12-13T22:26:23.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88004c60 con 0x7f5f901e9b10 2023-12-13T22:26:23.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f901f6ce0 con 0x7f5f901e9b10 2023-12-13T22:26:23.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901f72a0 con 0x7f5f901e9b10 2023-12-13T22:26:23.161 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.160+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f901f7460 con 0x7f5f901e9b10 2023-12-13T22:26:23.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.184+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5f88007040 con 0x7f5f901e9b10 2023-12-13T22:26:23.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.184+0000 7f5f827fc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 0x7f5f74068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.184+0000 7f5f95777640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 0x7f5f74068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.184+0000 7f5f95777640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 0x7f5f74068d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f901f44d0 tx=0x7f5f8c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:23.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.456+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f880eeb80 con 0x7f5f901e9b10 2023-12-13T22:26:23.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.456+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5f880ea7c0 con 0x7f5f901e9b10 2023-12-13T22:26:23.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.624+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f9006ccd0 con 0x7f5f901e9b10 2023-12-13T22:26:23.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.636+0000 7f5f827fc640 1 -- 172.21.15.91:0/2295376835 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f880bc020 con 0x7f5f901e9b10 2023-12-13T22:26:23.637 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 msgr2=0x7f5f74068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 0x7f5f74068d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5f901f44d0 tx=0x7f5f8c00d040 comp rx=0 tx=0).stop 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 msgr2=0x7f5f900c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f8801d400 tx=0x7f5f7c005800 comp rx=0 tx=0).stop 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 shutdown_connections 2023-12-13T22:26:23.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5f74066870 0x7f5f74068d30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f900c8780 0x7f5f9014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f901e9ef0 0x7f5f901f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 --2- 172.21.15.91:0/2295376835 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5f901e9b10 0x7f5f900c8240 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 >> 172.21.15.91:0/2295376835 conn(0x7f5f900b07c0 msgr2=0x7f5f90152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 shutdown_connections 2023-12-13T22:26:23.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.640+0000 7f5f981dc640 1 -- 172.21.15.91:0/2295376835 wait complete. 2023-12-13T22:26:23.656 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:26:23.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 Processor -- start 2023-12-13T22:26:23.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 -- start start 2023-12-13T22:26:23.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fc91006ad60 0x7fc9100cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc910072400 con 0x7fc9101513c0 2023-12-13T22:26:23.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc910157cc0 con 0x7fc91006ad60 2023-12-13T22:26:23.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.784+0000 7fc91788f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910157fa0 con 0x7fc910072890 2023-12-13T22:26:23.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.808+0000 7fc915e2c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.808+0000 7fc915e2c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:43130/0 (socket says 172.21.15.91:43130) 2023-12-13T22:26:23.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.808+0000 7fc915e2c640 1 -- 172.21.15.91:0/1002932159 learned_addr learned my addr 172.21.15.91:0/1002932159 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:23.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.816+0000 7fc915e2c640 1 -- 172.21.15.91:0/1002932159 >> v2:172.21.15.91:3300/0 conn(0x7fc91006ad60 msgr2=0x7fc9100cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.816+0000 7fc915e2c640 1 --2- 172.21.15.91:0/1002932159 >> v2:172.21.15.91:3300/0 conn(0x7fc91006ad60 0x7fc9100cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.816+0000 7fc915e2c640 1 -- 172.21.15.91:0/1002932159 >> v1:172.21.15.91:6789/0 conn(0x7fc9101513c0 legacy=0x7fc9101571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:23.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.816+0000 7fc915e2c640 1 -- 172.21.15.91:0/1002932159 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910071db0 con 0x7fc910072890 2023-12-13T22:26:23.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.924+0000 7fc915e2c640 1 --2- 172.21.15.91:0/1002932159 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc2761a48a673c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:23.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.932+0000 7fc907fff640 1 -- 172.21.15.91:0/1002932159 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0ac630 con 0x7fc910072890 2023-12-13T22:26:23.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc907fff640 1 -- 172.21.15.91:0/1002932159 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c0ac790 con 0x7fc910072890 2023-12-13T22:26:23.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc907fff640 1 -- 172.21.15.91:0/1002932159 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0acb20 con 0x7fc910072890 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 -- 172.21.15.91:0/1002932159 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 msgr2=0x7fc9100c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 --2- 172.21.15.91:0/1002932159 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c01c500 comp rx=0 tx=0).stop 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 -- 172.21.15.91:0/1002932159 shutdown_connections 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 --2- 172.21.15.91:0/1002932159 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc910072890 0x7fc9100c5080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 --2- 172.21.15.91:0/1002932159 >> v2:172.21.15.91:3300/0 conn(0x7fc91006ad60 0x7fc9100cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 -- 172.21.15.91:0/1002932159 >> 172.21.15.91:0/1002932159 conn(0x7fc91006b670 msgr2=0x7fc91006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 -- 172.21.15.91:0/1002932159 shutdown_connections 2023-12-13T22:26:23.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.936+0000 7fc91788f640 1 -- 172.21.15.91:0/1002932159 wait complete. 2023-12-13T22:26:23.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 Processor -- start 2023-12-13T22:26:23.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 -- start start 2023-12-13T22:26:23.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 0x7fc91014e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc910072890 0x7fc9100c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 0x7fc9100c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:23.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100c4c50 con 0x7fc910072890 2023-12-13T22:26:23.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101f23a0 con 0x7fc9101513c0 2023-12-13T22:26:23.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc91788f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101f2680 con 0x7fc91006ad60 2023-12-13T22:26:23.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.940+0000 7fc915e2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 0x7fc9100c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.944+0000 7fc91562b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 0x7fc91014e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:23.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.944+0000 7fc915e2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 0x7fc9100c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:50324/0 (socket says 172.21.15.91:50324) 2023-12-13T22:26:23.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.944+0000 7fc915e2c640 1 -- 172.21.15.91:0/1207918297 learned_addr learned my addr 172.21.15.91:0/1207918297 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.952+0000 7fc91562b640 1 -- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 msgr2=0x7fc9100c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.952+0000 7fc91562b640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 0x7fc9100c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.952+0000 7fc91562b640 1 -- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc910072890 msgr2=0x7fc9100c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.952+0000 7fc91562b640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc910072890 0x7fc9100c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:23.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.952+0000 7fc91562b640 1 -- 172.21.15.91:0/1207918297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094d0 con 0x7fc91006ad60 2023-12-13T22:26:23.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.960+0000 7fc91562b640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 0x7fc91014e020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc90800be20 tx=0x7fc908009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:23.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.968+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90800ce70 con 0x7fc91006ad60 2023-12-13T22:26:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.968+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908014440 con 0x7fc91006ad60 2023-12-13T22:26:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.968+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908014830 con 0x7fc91006ad60 2023-12-13T22:26:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.968+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9101f2960 con 0x7fc91006ad60 2023-12-13T22:26:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.968+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9101f2f20 con 0x7fc91006ad60 2023-12-13T22:26:23.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:23.972+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9100cc7e0 con 0x7fc91006ad60 2023-12-13T22:26:24.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.356+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc90801d3b0 con 0x7fc91006ad60 2023-12-13T22:26:24.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.356+0000 7fc905ffb640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 0x7fc8f4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.356+0000 7fc914e2a640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 0x7fc8f4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.360+0000 7fc914e2a640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 0x7fc8f4068d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9100c4180 tx=0x7fc900006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:24.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.368+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9080556e0 con 0x7fc91006ad60 2023-12-13T22:26:24.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.400+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc908051a20 con 0x7fc91006ad60 2023-12-13T22:26:24.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.572+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc910073e70 con 0x7fc91006ad60 2023-12-13T22:26:24.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.580+0000 7fc905ffb640 1 -- 172.21.15.91:0/1207918297 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc908019020 con 0x7fc91006ad60 2023-12-13T22:26:24.580 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:26:24.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 msgr2=0x7fc8f4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 0x7fc8f4068d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9100c4180 tx=0x7fc900006ca0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 msgr2=0x7fc91014e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 0x7fc91014e020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc90800be20 tx=0x7fc908009f70 comp rx=0 tx=0).stop 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 shutdown_connections 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc8f4066870 0x7fc8f4068d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9101513c0 0x7fc9100c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc910072890 0x7fc9100c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 --2- 172.21.15.91:0/1207918297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91006ad60 0x7fc91014e020 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 >> 172.21.15.91:0/1207918297 conn(0x7fc91006b670 msgr2=0x7fc9100ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:24.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 shutdown_connections 2023-12-13T22:26:24.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.584+0000 7fc91788f640 1 -- 172.21.15.91:0/1207918297 wait complete. 2023-12-13T22:26:24.600 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:26:24.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.736+0000 7f24376dd640 1 Processor -- start 2023-12-13T22:26:24.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.736+0000 7f24376dd640 1 -- start start 2023-12-13T22:26:24.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f24376dd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2430151340 0x7f243006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f24376dd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f24300c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f24376dd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243006f4a0 con 0x7f2430151720 2023-12-13T22:26:24.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f24376dd640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2430072570 con 0x7f2430151340 2023-12-13T22:26:24.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f24376dd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2430070be0 con 0x7f24300c40e0 2023-12-13T22:26:24.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f2434c78640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2430151720 0x7f2430157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:33964/0 (socket says 172.21.15.91:33964) 2023-12-13T22:26:24.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f2434c78640 1 -- 172.21.15.91:0/3057206956 learned_addr learned my addr 172.21.15.91:0/3057206956 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:24.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f2435479640 1 --2- 172.21.15.91:0/3057206956 >> v2:172.21.15.152:3300/0 conn(0x7f2430151340 0x7f243006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.740+0000 7f2435c7a640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f24300c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.744+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420894372 0 0) 0x7f243006f4a0 con 0x7f2430151720 2023-12-13T22:26:24.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.744+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f241c003530 con 0x7f2430151720 2023-12-13T22:26:24.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186466351 0 0) 0x7f241c003530 con 0x7f2430151720 2023-12-13T22:26:24.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 msgr2=0x7f24300c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:24.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f24300c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 >> v2:172.21.15.152:3300/0 conn(0x7f2430151340 msgr2=0x7f243006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:24.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 --2- 172.21.15.91:0/3057206956 >> v2:172.21.15.152:3300/0 conn(0x7f2430151340 0x7f243006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430070e80 con 0x7f2430151720 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f24200016a0 con 0x7f2430151720 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 >> v1:172.21.15.91:6789/0 conn(0x7f2430151720 legacy=0x7f2430157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0039f0 0x7f241c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f241c0047d0 0x7f241c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f241c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430070be0 con 0x7f241c0047d0 2023-12-13T22:26:24.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00b990 con 0x7f241c0039f0 2023-12-13T22:26:24.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c00bb00 con 0x7f24300c40e0 2023-12-13T22:26:24.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.748+0000 7f2434c78640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f241c0047d0 0x7f241c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.752+0000 7f2435479640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0039f0 0x7f241c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.752+0000 7f2435c7a640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f241c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.756+0000 7f2434c78640 1 -- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 msgr2=0x7f241c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:24.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.756+0000 7f2434c78640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24300c40e0 0x7f241c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.756+0000 7f2434c78640 1 -- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0039f0 msgr2=0x7f241c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:24.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.756+0000 7f2434c78640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0039f0 0x7f241c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.756+0000 7f2434c78640 1 -- 172.21.15.91:0/3057206956 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c003530 con 0x7f241c0047d0 2023-12-13T22:26:24.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.764+0000 7f2434c78640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f241c0047d0 0x7f241c004c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f243006d6a0 tx=0x7f242001f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f1d480c5a5d3bc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:24.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200a8df0 con 0x7f241c0047d0 2023-12-13T22:26:24.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200058e0 con 0x7f241c0047d0 2023-12-13T22:26:24.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f2427fff640 1 -- 172.21.15.91:0/3057206956 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420005cd0 con 0x7f241c0047d0 2023-12-13T22:26:24.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- 172.21.15.91:0/3057206956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f241c0047d0 msgr2=0x7f241c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 --2- 172.21.15.91:0/3057206956 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f241c0047d0 0x7f241c004c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f243006d6a0 tx=0x7f242001f2d0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f2435c7a640 1 -- 172.21.15.91:0/3057206956 reap_dead start 2023-12-13T22:26:24.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- 172.21.15.91:0/3057206956 shutdown_connections 2023-12-13T22:26:24.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- 172.21.15.91:0/3057206956 >> 172.21.15.91:0/3057206956 conn(0x7f243006c6a0 msgr2=0x7f243006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:24.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- 172.21.15.91:0/3057206956 shutdown_connections 2023-12-13T22:26:24.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- 172.21.15.91:0/3057206956 wait complete. 2023-12-13T22:26:24.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 Processor -- start 2023-12-13T22:26:24.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.768+0000 7f24376dd640 1 -- start start 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0047d0 0x7f2430158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f243014acf0 0x7f243014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243014a860 con 0x7f24301eda50 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2430158e40 con 0x7f241c0047d0 2023-12-13T22:26:24.770 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f24376dd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243014b6e0 con 0x7f243014acf0 2023-12-13T22:26:24.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f2434c78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:24.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f2434c78640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53612/0 (socket says 172.21.15.91:53612) 2023-12-13T22:26:24.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.772+0000 7f2434c78640 1 -- 172.21.15.91:0/2110666090 learned_addr learned my addr 172.21.15.91:0/2110666090 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:24.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 -- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f243014acf0 msgr2=0x7f243014b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f243014acf0 0x7f243014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 -- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0047d0 msgr2=0x7f2430158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:24.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0047d0 0x7f2430158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:24.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 -- 172.21.15.91:0/2110666090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24301ef8a0 con 0x7f24301eda50 2023-12-13T22:26:24.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.776+0000 7f2434c78640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f242000c220 tx=0x7f241c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:24.783 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200b7070 con 0x7f24301eda50 2023-12-13T22:26:24.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420005a50 con 0x7f24301eda50 2023-12-13T22:26:24.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420005dc0 con 0x7f24301eda50 2023-12-13T22:26:24.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24301eed20 con 0x7f24301eda50 2023-12-13T22:26:24.784 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24301ef2e0 con 0x7f24301eda50 2023-12-13T22:26:24.785 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:24.784+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24300c6cb0 con 0x7f24301eda50 2023-12-13T22:26:25.093 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.092+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f24200047f0 con 0x7f24301eda50 2023-12-13T22:26:25.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.096+0000 7f2425ffb640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 0x7f2414068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.096+0000 7f2435479640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 0x7f2414068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.096+0000 7f2435479640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 0x7f2414068d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f242c009930 tx=0x7f242c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:25.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.132+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24200af370 con 0x7f24301eda50 2023-12-13T22:26:25.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.132+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f24200ee660 con 0x7f24301eda50 2023-12-13T22:26:25.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.300+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2430067520 con 0x7f24301eda50 2023-12-13T22:26:25.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f2425ffb640 1 -- 172.21.15.91:0/2110666090 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24200f1c80 con 0x7f24301eda50 2023-12-13T22:26:25.390 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 msgr2=0x7f2414068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 0x7f2414068d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f242c009930 tx=0x7f242c008040 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 msgr2=0x7f2430153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f242000c220 tx=0x7f241c005800 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 shutdown_connections 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2414066870 0x7f2414068d30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f243014acf0 0x7f243014b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24301eda50 0x7f2430153640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 --2- 172.21.15.91:0/2110666090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f241c0047d0 0x7f2430158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 >> 172.21.15.91:0/2110666090 conn(0x7f243006c6a0 msgr2=0x7f24300ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 shutdown_connections 2023-12-13T22:26:25.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.392+0000 7f24376dd640 1 -- 172.21.15.91:0/2110666090 wait complete. 2023-12-13T22:26:25.415 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T22:26:25.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 Processor -- start 2023-12-13T22:26:25.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 -- start start 2023-12-13T22:26:25.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef040ce0c0 0x7fef040ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040cc3c0 0x7fef04159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040cd9a0 con 0x7fef040cdb70 2023-12-13T22:26:25.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040ca550 con 0x7fef040ce0c0 2023-12-13T22:26:25.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.536+0000 7fef091b4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040ce9e0 con 0x7fef040cc3c0 2023-12-13T22:26:25.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef040ce0c0 0x7fef040ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fef040ce0c0 0x7fef040ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53628/0 (socket says 172.21.15.91:53628) 2023-12-13T22:26:25.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 -- 172.21.15.91:0/100636087 learned_addr learned my addr 172.21.15.91:0/100636087 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 -- 172.21.15.91:0/100636087 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040cc3c0 msgr2=0x7fef04159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 --2- 172.21.15.91:0/100636087 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040cc3c0 0x7fef04159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 -- 172.21.15.91:0/100636087 >> v1:172.21.15.152:6789/0 conn(0x7fef040cdb70 legacy=0x7fef0415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:25.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.540+0000 7fef02d9d640 1 -- 172.21.15.91:0/100636087 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef041596c0 con 0x7fef040ce0c0 2023-12-13T22:26:25.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.548+0000 7fef02d9d640 1 --2- 172.21.15.91:0/100636087 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040ce0c0 0x7fef040ce4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feef8009870 tx=0x7feef801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedd232ad4edfc66 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:25.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.548+0000 7fef01d9b640 1 -- 172.21.15.91:0/100636087 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80aa620 con 0x7fef040ce0c0 2023-12-13T22:26:25.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.548+0000 7fef01d9b640 1 -- 172.21.15.91:0/100636087 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef80aa780 con 0x7fef040ce0c0 2023-12-13T22:26:25.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.548+0000 7fef01d9b640 1 -- 172.21.15.91:0/100636087 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80aab10 con 0x7fef040ce0c0 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- 172.21.15.91:0/100636087 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040ce0c0 msgr2=0x7fef040ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- 172.21.15.91:0/100636087 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040ce0c0 0x7fef040ce4a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feef8009870 tx=0x7feef801c500 comp rx=0 tx=0).stop 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- 172.21.15.91:0/100636087 shutdown_connections 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- 172.21.15.91:0/100636087 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040cc3c0 0x7fef04159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- 172.21.15.91:0/100636087 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040ce0c0 0x7fef040ce4a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- 172.21.15.91:0/100636087 >> 172.21.15.91:0/100636087 conn(0x7fef040b07c0 msgr2=0x7fef040b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- 172.21.15.91:0/100636087 shutdown_connections 2023-12-13T22:26:25.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- 172.21.15.91:0/100636087 wait complete. 2023-12-13T22:26:25.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 Processor -- start 2023-12-13T22:26:25.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- start start 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef040cdb70 0x7fef041463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040ce0c0 0x7fef041468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0415ba90 con 0x7fef040cc3c0 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04145f50 con 0x7fef040cdb70 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef091b4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0415c280 con 0x7fef040ce0c0 2023-12-13T22:26:25.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef02d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef02d9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53644/0 (socket says 172.21.15.91:53644) 2023-12-13T22:26:25.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef02d9d640 1 -- 172.21.15.91:0/3072773692 learned_addr learned my addr 172.21.15.91:0/3072773692 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:25.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.552+0000 7fef0359e640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040ce0c0 0x7fef041468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef0259c640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef040cdb70 0x7fef041463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef02d9d640 1 -- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040ce0c0 msgr2=0x7fef041468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:25.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef02d9d640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040ce0c0 0x7fef041468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef02d9d640 1 -- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef040cdb70 msgr2=0x7fef041463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:25.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef02d9d640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef040cdb70 0x7fef041463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:25.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.556+0000 7fef02d9d640 1 -- 172.21.15.91:0/3072773692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80094d0 con 0x7fef040cc3c0 2023-12-13T22:26:25.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.560+0000 7fef02d9d640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feef80ac040 tx=0x7feef801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:25.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80bd5f0 con 0x7fef040cc3c0 2023-12-13T22:26:25.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef80bd770 con 0x7fef040cc3c0 2023-12-13T22:26:25.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80bdb20 con 0x7fef040cc3c0 2023-12-13T22:26:25.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0414a700 con 0x7fef040cc3c0 2023-12-13T22:26:25.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef041479e0 con 0x7fef040cc3c0 2023-12-13T22:26:25.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.564+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef04147840 con 0x7fef040cc3c0 2023-12-13T22:26:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.584+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7feef80b33f0 con 0x7fef040cc3c0 2023-12-13T22:26:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.584+0000 7feeeb7fe640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 0x7feef0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.584+0000 7fef0259c640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 0x7feef0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:25.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.584+0000 7fef0259c640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 0x7feef0068d00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef04074040 tx=0x7feef4006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:25.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.588+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feef80aae30 con 0x7fef040cc3c0 2023-12-13T22:26:25.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:25.836+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7feef80ec4a0 con 0x7fef040cc3c0 2023-12-13T22:26:26.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.008+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef04147840 con 0x7fef040cc3c0 2023-12-13T22:26:26.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7feeeb7fe640 1 -- 172.21.15.91:0/3072773692 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef04147840 con 0x7fef040cc3c0 2023-12-13T22:26:26.014 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 msgr2=0x7feef0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 0x7feef0068d00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef04074040 tx=0x7feef4006f90 comp rx=0 tx=0).stop 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 msgr2=0x7fef0414bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feef80ac040 tx=0x7feef801ad40 comp rx=0 tx=0).stop 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 shutdown_connections 2023-12-13T22:26:26.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feef0066840 0x7feef0068d00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fef040ce0c0 0x7fef041468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef040cdb70 0x7fef041463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 --2- 172.21.15.91:0/3072773692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fef040cc3c0 0x7fef0414bcd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.016+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 >> 172.21.15.91:0/3072773692 conn(0x7fef040b07c0 msgr2=0x7fef0414e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.020+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 shutdown_connections 2023-12-13T22:26:26.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:26.020+0000 7fef091b4640 1 -- 172.21.15.91:0/3072773692 wait complete. 2023-12-13T22:26:26.033 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-12-13T22:26:26.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:26.034 DEBUG:teuthology.orchestra.run.smithi091:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-13T22:26:26.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi091.stderr:ceph-fuse[44511]: fuse finished with error 0 and tester_r 0 2023-12-13T22:26:26.167 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:26:29.175 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:26:29.178 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:26:32.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:26:32.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:26:32.268 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-13T22:26:32.350 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:32.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 Processor -- start 2023-12-13T22:26:32.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 -- start start 2023-12-13T22:26:32.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a940c8e10 0x7f9a9415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94151950 con 0x7f9a94151570 2023-12-13T22:26:32.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a940c7d40 con 0x7f9a940c8e10 2023-12-13T22:26:32.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a9a4cd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940c8610 con 0x7f9a9406a560 2023-12-13T22:26:32.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a98a6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a940c8e10 0x7f9a9415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a98a6a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9a940c8e10 0x7f9a9415b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57812/0 (socket says 172.21.15.91:57812) 2023-12-13T22:26:32.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a98a6a640 1 -- 172.21.15.91:0/3661089010 learned_addr learned my addr 172.21.15.91:0/3661089010 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:32.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.484+0000 7f9a937fe640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.488+0000 7f9a98a6a640 1 -- 172.21.15.91:0/3661089010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 msgr2=0x7f9a94157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:32.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.488+0000 7f9a98a6a640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:32.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.488+0000 7f9a98a6a640 1 -- 172.21.15.91:0/3661089010 >> v1:172.21.15.152:6789/0 conn(0x7f9a94151570 legacy=0x7f9a940c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:32.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.488+0000 7f9a98a6a640 1 -- 172.21.15.91:0/3661089010 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9406ab80 con 0x7f9a940c8e10 2023-12-13T22:26:32.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.492+0000 7f9a98a6a640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a940c8e10 0x7f9a9415b2e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009e50 tx=0x7f9a8c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c9807356fc49e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:32.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a92ffd640 1 -- 172.21.15.91:0/3661089010 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a5810 con 0x7f9a940c8e10 2023-12-13T22:26:32.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a92ffd640 1 -- 172.21.15.91:0/3661089010 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0a5970 con 0x7f9a940c8e10 2023-12-13T22:26:32.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a92ffd640 1 -- 172.21.15.91:0/3661089010 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a5d00 con 0x7f9a940c8e10 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/3661089010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a940c8e10 msgr2=0x7f9a9415b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a940c8e10 0x7f9a9415b2e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009e50 tx=0x7f9a8c01c950 comp rx=0 tx=0).stop 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/3661089010 shutdown_connections 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a940c8e10 0x7f9a9415b2e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/3661089010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/3661089010 >> 172.21.15.91:0/3661089010 conn(0x7f9a94070160 msgr2=0x7f9a9406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/3661089010 shutdown_connections 2023-12-13T22:26:32.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/3661089010 wait complete. 2023-12-13T22:26:32.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 Processor -- start 2023-12-13T22:26:32.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.496+0000 7f9a9a4cd640 1 -- start start 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a940c8e10 0x7f9a94159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941548c0 con 0x7f9a94151570 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9414dbb0 con 0x7f9a940c8e10 2023-12-13T22:26:32.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a9a4cd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941501b0 con 0x7f9a9406a560 2023-12-13T22:26:32.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a98a6a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a98a6a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57820/0 (socket says 172.21.15.91:57820) 2023-12-13T22:26:32.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a98a6a640 1 -- 172.21.15.91:0/4216206061 learned_addr learned my addr 172.21.15.91:0/4216206061 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:32.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a937fe640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a940c8e10 0x7f9a94159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.500+0000 7f9a93fff640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 -- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 msgr2=0x7f9a94148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:32.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:32.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 -- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a940c8e10 msgr2=0x7f9a94159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:32.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a940c8e10 0x7f9a94159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:32.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 -- 172.21.15.91:0/4216206061 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009b30 con 0x7f9a94151570 2023-12-13T22:26:32.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.504+0000 7f9a98a6a640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c01b000 tx=0x7f9a8c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:32.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0b8670 con 0x7f9a94151570 2023-12-13T22:26:32.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0b87d0 con 0x7f9a94151570 2023-12-13T22:26:32.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0b8b80 con 0x7f9a94151570 2023-12-13T22:26:32.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a941f42a0 con 0x7f9a94151570 2023-12-13T22:26:32.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a94150400 con 0x7f9a94151570 2023-12-13T22:26:32.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.508+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94154a00 con 0x7f9a94151570 2023-12-13T22:26:32.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.528+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9a8c0b8ce0 con 0x7f9a94151570 2023-12-13T22:26:32.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.528+0000 7f9a90ff9640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 0x7f9a80068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:32.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.528+0000 7f9a93fff640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 0x7f9a80068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:32.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.528+0000 7f9a93fff640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 0x7f9a80068d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001650 tx=0x7f9a84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:32.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.528+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a8c0f10f0 con 0x7f9a94151570 2023-12-13T22:26:32.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.804+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9a8c0ecd30 con 0x7f9a94151570 2023-12-13T22:26:32.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:32.984+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a94154a00 con 0x7f9a94151570 2023-12-13T22:26:33.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.072+0000 7f9a90ff9640 1 -- 172.21.15.91:0/4216206061 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f9a94154a00 con 0x7f9a94151570 2023-12-13T22:26:33.073 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:33.073 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:33.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 msgr2=0x7f9a80068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 0x7f9a80068d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001650 tx=0x7f9a84009040 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 msgr2=0x7f9a94159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c01b000 tx=0x7f9a8c0196f0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 shutdown_connections 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a80066840 0x7f9a80068d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9a94151570 0x7f9a94159b70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a940c8e10 0x7f9a94159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 --2- 172.21.15.91:0/4216206061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a9406a560 0x7f9a94148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 >> 172.21.15.91:0/4216206061 conn(0x7f9a94070160 msgr2=0x7f9a9414a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 shutdown_connections 2023-12-13T22:26:33.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.076+0000 7f9a9a4cd640 1 -- 172.21.15.91:0/4216206061 wait complete. 2023-12-13T22:26:33.096 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 Processor -- start 2023-12-13T22:26:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 -- start start 2023-12-13T22:26:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 0x7fe2cc0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0c21d0 con 0x7fe2cc157280 2023-12-13T22:26:33.222 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc157750 con 0x7fe2cc151460 2023-12-13T22:26:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2d1714640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06ec00 con 0x7fe2cc0ccad0 2023-12-13T22:26:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2ca7fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fe2cc157280 0x7fe2cc06f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:48964/0 (socket says 172.21.15.91:48964) 2023-12-13T22:26:33.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2ca7fc640 1 -- 172.21.15.91:0/766273534 learned_addr learned my addr 172.21.15.91:0/766273534 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:33.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.224+0000 7fe2cb7fe640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 0x7fe2cc0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.228+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991444522 0 0) 0x7fe2cc0c21d0 con 0x7fe2cc157280 2023-12-13T22:26:33.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.228+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b8003530 con 0x7fe2cc157280 2023-12-13T22:26:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476617265 0 0) 0x7fe2b8003530 con 0x7fe2cc157280 2023-12-13T22:26:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 msgr2=0x7fe2cc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:33.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 0x7fe2cc0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 >> v1:172.21.15.152:6789/0 conn(0x7fe2cc151460 legacy=0x7fe2cc0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc157a30 con 0x7fe2cc157280 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fe2b4001680 con 0x7fe2cc157280 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 >> v1:172.21.15.91:6789/0 conn(0x7fe2cc157280 legacy=0x7fe2cc06f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2b8003a20 0x7fe2b8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 0x7fe2b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8004d10 0x7fe2b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06ec00 con 0x7fe2b8003a20 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b800bb20 con 0x7fe2b8004d10 2023-12-13T22:26:33.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.232+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b800bce0 con 0x7fe2cc0ccad0 2023-12-13T22:26:33.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2b8003a20 0x7fe2b8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 -- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 msgr2=0x7fe2b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2cc0ccad0 0x7fe2b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 -- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8004d10 msgr2=0x7fe2b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8004d10 0x7fe2b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.236+0000 7fe2caffd640 1 -- 172.21.15.91:0/766273534 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8003530 con 0x7fe2b8003a20 2023-12-13T22:26:33.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.240+0000 7fe2caffd640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2b8003a20 0x7fe2b8003e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001780 tx=0x7fe2bc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773c80c46d7fbe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:33.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.244+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0052d0 con 0x7fe2b8003a20 2023-12-13T22:26:33.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.244+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0a7050 con 0x7fe2b8003a20 2023-12-13T22:26:33.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.244+0000 7fe2c9ffb640 1 -- 172.21.15.91:0/766273534 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc003840 con 0x7fe2b8003a20 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- 172.21.15.91:0/766273534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2b8003a20 msgr2=0x7fe2b8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 --2- 172.21.15.91:0/766273534 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2b8003a20 0x7fe2b8003e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001780 tx=0x7fe2bc01c3d0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2cb7fe640 1 -- 172.21.15.91:0/766273534 reap_dead start 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- 172.21.15.91:0/766273534 shutdown_connections 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- 172.21.15.91:0/766273534 >> 172.21.15.91:0/766273534 conn(0x7fe2cc0708a0 msgr2=0x7fe2cc070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- 172.21.15.91:0/766273534 shutdown_connections 2023-12-13T22:26:33.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- 172.21.15.91:0/766273534 wait complete. 2023-12-13T22:26:33.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 Processor -- start 2023-12-13T22:26:33.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- start start 2023-12-13T22:26:33.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2b8003a20 0x7fe2cc1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2cc148f30 0x7fe2cc1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1498f0 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1f2310 con 0x7fe2cc148f30 2023-12-13T22:26:33.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.248+0000 7fe2d1714640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc06d6d0 con 0x7fe2b8003a20 2023-12-13T22:26:33.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.252+0000 7fe2caffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2b8003a20 0x7fe2cc1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.252+0000 7fe2cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2cc148f30 0x7fe2cc1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.252+0000 7fe2ca7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.252+0000 7fe2ca7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57828/0 (socket says 172.21.15.91:57828) 2023-12-13T22:26:33.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.252+0000 7fe2ca7fc640 1 -- 172.21.15.91:0/78138577 learned_addr learned my addr 172.21.15.91:0/78138577 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:33.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 -- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2b8003a20 msgr2=0x7fe2cc1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2b8003a20 0x7fe2cc1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 -- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2cc148f30 msgr2=0x7fe2cc1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2cc148f30 0x7fe2cc1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 -- 172.21.15.91:0/78138577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc06ce30 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.256+0000 7fe2ca7fc640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c760 tx=0x7fe2b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:33.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40074e0 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4007640 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4004a10 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc06d110 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1f1fa0 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.260+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc1f1e00 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.544+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe2b4004b70 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.544+0000 7fe2c37fe640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 0x7fe2ac068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.544+0000 7fe2caffd640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 0x7fe2ac068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.544+0000 7fe2caffd640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 0x7fe2ac068ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001750 tx=0x7fe2bc0011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:33.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.584+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2b4054540 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.584+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe2b4050880 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.736+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2cc1f24c0 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.824+0000 7fe2c37fe640 1 -- 172.21.15.91:0/78138577 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fe2cc1f24c0 con 0x7fe2cc06c8d0 2023-12-13T22:26:33.825 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:33.825 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 msgr2=0x7fe2ac068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 0x7fe2ac068ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001750 tx=0x7fe2bc0011a0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 msgr2=0x7fe2cc156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c760 tx=0x7fe2b400cc20 comp rx=0 tx=0).stop 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 shutdown_connections 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fe2ac066820 0x7fe2ac068ce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2cc148f30 0x7fe2cc1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fe2cc06c8d0 0x7fe2cc156270 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 --2- 172.21.15.91:0/78138577 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2b8003a20 0x7fe2cc1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 >> 172.21.15.91:0/78138577 conn(0x7fe2cc0708a0 msgr2=0x7fe2cc0c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:33.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 shutdown_connections 2023-12-13T22:26:33.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.828+0000 7fe2d1714640 1 -- 172.21.15.91:0/78138577 wait complete. 2023-12-13T22:26:33.848 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-13T22:26:33.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.972+0000 7fda4f57b640 1 Processor -- start 2023-12-13T22:26:33.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.972+0000 7fda4f57b640 1 -- start start 2023-12-13T22:26:33.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4f57b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda480ce0c0 0x7fda480ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4f57b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cc3c0 0x7fda48159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4f57b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480cd9a0 con 0x7fda480cdb70 2023-12-13T22:26:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4f57b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480ca550 con 0x7fda480ce0c0 2023-12-13T22:26:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4f57b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480ce9e0 con 0x7fda480cc3c0 2023-12-13T22:26:33.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4d317640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda480ce0c0 0x7fda480ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4d317640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fda480ce0c0 0x7fda480ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57840/0 (socket says 172.21.15.91:57840) 2023-12-13T22:26:33.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.976+0000 7fda4d317640 1 -- 172.21.15.91:0/2286678268 learned_addr learned my addr 172.21.15.91:0/2286678268 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:33.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.980+0000 7fda4d317640 1 -- 172.21.15.91:0/2286678268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cc3c0 msgr2=0x7fda48159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:33.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.980+0000 7fda4d317640 1 --2- 172.21.15.91:0/2286678268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cc3c0 0x7fda48159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.980+0000 7fda4d317640 1 -- 172.21.15.91:0/2286678268 >> v1:172.21.15.152:6789/0 conn(0x7fda480cdb70 legacy=0x7fda4815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:33.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.980+0000 7fda4d317640 1 -- 172.21.15.91:0/2286678268 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda481596c0 con 0x7fda480ce0c0 2023-12-13T22:26:33.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.984+0000 7fda4d317640 1 --2- 172.21.15.91:0/2286678268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda480ce4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda44009870 tx=0x7fda4401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c80a50b11b7f0c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:33.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.984+0000 7fda3ffff640 1 -- 172.21.15.91:0/2286678268 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440aa620 con 0x7fda480ce0c0 2023-12-13T22:26:33.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda3ffff640 1 -- 172.21.15.91:0/2286678268 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda440aa780 con 0x7fda480ce0c0 2023-12-13T22:26:33.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda3ffff640 1 -- 172.21.15.91:0/2286678268 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440aab10 con 0x7fda480ce0c0 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- 172.21.15.91:0/2286678268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 msgr2=0x7fda480ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2286678268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda480ce4a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda44009870 tx=0x7fda4401c500 comp rx=0 tx=0).stop 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- 172.21.15.91:0/2286678268 shutdown_connections 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2286678268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cc3c0 0x7fda48159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2286678268 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda480ce4a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- 172.21.15.91:0/2286678268 >> 172.21.15.91:0/2286678268 conn(0x7fda480b07c0 msgr2=0x7fda480b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- 172.21.15.91:0/2286678268 shutdown_connections 2023-12-13T22:26:33.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- 172.21.15.91:0/2286678268 wait complete. 2023-12-13T22:26:33.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 Processor -- start 2023-12-13T22:26:33.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- start start 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda480cc3c0 0x7fda481484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cdb70 0x7fda481f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481574c0 con 0x7fda480ce0c0 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481f7020 con 0x7fda480cc3c0 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4f57b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda48157760 con 0x7fda480cdb70 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4db18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4db18640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57850/0 (socket says 172.21.15.91:57850) 2023-12-13T22:26:33.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.988+0000 7fda4db18640 1 -- 172.21.15.91:0/2537691258 learned_addr learned my addr 172.21.15.91:0/2537691258 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.992+0000 7fda4db18640 1 -- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cdb70 msgr2=0x7fda481f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.992+0000 7fda4db18640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cdb70 0x7fda481f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.992+0000 7fda4db18640 1 -- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda480cc3c0 msgr2=0x7fda481484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.992+0000 7fda4db18640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda480cc3c0 0x7fda481484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:33.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.992+0000 7fda4db18640 1 -- 172.21.15.91:0/2537691258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440094d0 con 0x7fda480ce0c0 2023-12-13T22:26:33.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:33.996+0000 7fda4db18640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c780 tx=0x7fda4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40003d90 con 0x7fda480ce0c0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000ce90 con 0x7fda480ce0c0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda48157a40 con 0x7fda480ce0c0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400052b0 con 0x7fda480ce0c0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda481f7300 con 0x7fda480ce0c0 2023-12-13T22:26:33.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.000+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48157f60 con 0x7fda480ce0c0 2023-12-13T22:26:34.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.020+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fda40005410 con 0x7fda480ce0c0 2023-12-13T22:26:34.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.020+0000 7fda3dffb640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 0x7fda2c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:34.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.020+0000 7fda4d317640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 0x7fda2c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:34.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.020+0000 7fda4d317640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 0x7fda2c068d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda440ae000 tx=0x7fda44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.300+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda400552d0 con 0x7fda480ce0c0 2023-12-13T22:26:34.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.300+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fda40050f10 con 0x7fda480ce0c0 2023-12-13T22:26:34.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:34.536+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fda48157f60 con 0x7fda480ce0c0 2023-12-13T22:26:35.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.680+0000 7fda3dffb640 1 -- 172.21.15.91:0/2537691258 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 118+0+0 (secure 0 0 0) 0x7fda48157f60 con 0x7fda480ce0c0 2023-12-13T22:26:35.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 msgr2=0x7fda2c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:35.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 0x7fda2c068d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda440ae000 tx=0x7fda44008040 comp rx=0 tx=0).stop 2023-12-13T22:26:35.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 msgr2=0x7fda481f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:35.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c780 tx=0x7fda4000cc40 comp rx=0 tx=0).stop 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 shutdown_connections 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fda2c066870 0x7fda2c068d30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fda480ce0c0 0x7fda481f3540 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda480cdb70 0x7fda481f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 --2- 172.21.15.91:0/2537691258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda480cc3c0 0x7fda481484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 >> 172.21.15.91:0/2537691258 conn(0x7fda480b07c0 msgr2=0x7fda480735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 shutdown_connections 2023-12-13T22:26:35.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.684+0000 7fda4f57b640 1 -- 172.21.15.91:0/2537691258 wait complete. 2023-12-13T22:26:35.709 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2023-12-13T22:26:35.709 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-13T22:26:35.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 Processor -- start 2023-12-13T22:26:35.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 -- start start 2023-12-13T22:26:35.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5e6c151570 0x7f5e6c157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5e6c06a560 0x7f5e6c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c151950 con 0x7f5e6c0c8e10 2023-12-13T22:26:35.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.836+0000 7f5e726e7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c0c7d40 con 0x7f5e6c151570 2023-12-13T22:26:35.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.840+0000 7f5e726e7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c0c8610 con 0x7f5e6c06a560 2023-12-13T22:26:35.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.840+0000 7f5e70c84640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5e6c0c8e10 0x7f5e6c0c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:38992/0 (socket says 172.21.15.91:38992) 2023-12-13T22:26:35.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.840+0000 7f5e70c84640 1 -- 172.21.15.91:0/3431905259 learned_addr learned my addr 172.21.15.91:0/3431905259 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:35.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.840+0000 7f5e6b7fe640 1 --2- 172.21.15.91:0/3431905259 >> v2:172.21.15.152:3300/0 conn(0x7f5e6c06a560 0x7f5e6c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.844+0000 7f5e6bfff640 1 --2- 172.21.15.91:0/3431905259 >> v2:172.21.15.91:3300/0 conn(0x7f5e6c151570 0x7f5e6c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.848+0000 7f5e6b7fe640 1 -- 172.21.15.91:0/3431905259 >> v2:172.21.15.91:3300/0 conn(0x7f5e6c151570 msgr2=0x7f5e6c157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:35.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.848+0000 7f5e6b7fe640 1 --2- 172.21.15.91:0/3431905259 >> v2:172.21.15.91:3300/0 conn(0x7f5e6c151570 0x7f5e6c157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.848+0000 7f5e6b7fe640 1 -- 172.21.15.91:0/3431905259 >> v1:172.21.15.152:6789/0 conn(0x7f5e6c0c8e10 legacy=0x7f5e6c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:35.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.848+0000 7f5e6b7fe640 1 -- 172.21.15.91:0/3431905259 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c06ab80 con 0x7f5e6c06a560 2023-12-13T22:26:35.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.856+0000 7f5e6b7fe640 1 --2- 172.21.15.91:0/3431905259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c15b2e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c072c10 tx=0x7f5e5401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6909ef84f271ff6f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:35.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e6affd640 1 -- 172.21.15.91:0/3431905259 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540ab5f0 con 0x7f5e6c06a560 2023-12-13T22:26:35.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e6affd640 1 -- 172.21.15.91:0/3431905259 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e540ab750 con 0x7f5e6c06a560 2023-12-13T22:26:35.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e6affd640 1 -- 172.21.15.91:0/3431905259 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540abae0 con 0x7f5e6c06a560 2023-12-13T22:26:35.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 -- 172.21.15.91:0/3431905259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 msgr2=0x7f5e6c15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:35.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3431905259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c15b2e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c072c10 tx=0x7f5e5401c3f0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 -- 172.21.15.91:0/3431905259 shutdown_connections 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3431905259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c15b2e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3431905259 >> v2:172.21.15.91:3300/0 conn(0x7f5e6c151570 0x7f5e6c157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 -- 172.21.15.91:0/3431905259 >> 172.21.15.91:0/3431905259 conn(0x7f5e6c070160 msgr2=0x7f5e6c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 -- 172.21.15.91:0/3431905259 shutdown_connections 2023-12-13T22:26:35.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.868+0000 7f5e726e7640 1 -- 172.21.15.91:0/3431905259 wait complete. 2023-12-13T22:26:35.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 Processor -- start 2023-12-13T22:26:35.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 -- start start 2023-12-13T22:26:35.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e6c0c8e10 0x7f5e6c149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c14f840 con 0x7f5e6c151570 2023-12-13T22:26:35.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c159490 con 0x7f5e6c06a560 2023-12-13T22:26:35.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e726e7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c14eac0 con 0x7f5e6c0c8e10 2023-12-13T22:26:35.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e70c84640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e70c84640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57876/0 (socket says 172.21.15.91:57876) 2023-12-13T22:26:35.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.872+0000 7f5e70c84640 1 -- 172.21.15.91:0/3608388220 learned_addr learned my addr 172.21.15.91:0/3608388220 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:35.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.876+0000 7f5e6bfff640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.876+0000 7f5e6b7fe640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e6c0c8e10 0x7f5e6c149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 -- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e6c0c8e10 msgr2=0x7f5e6c149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:35.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e6c0c8e10 0x7f5e6c149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 -- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 msgr2=0x7f5e6c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:35.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:35.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 -- 172.21.15.91:0/3608388220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009420 con 0x7f5e6c151570 2023-12-13T22:26:35.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.880+0000 7f5e70c84640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400caf0 tx=0x7f5e6400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400aca0 con 0x7f5e6c151570 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6400ae20 con 0x7f5e6c151570 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64012640 con 0x7f5e6c151570 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c14eda0 con 0x7f5e6c151570 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c158750 con 0x7f5e6c151570 2023-12-13T22:26:35.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.888+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c073e70 con 0x7f5e6c151570 2023-12-13T22:26:35.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.912+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5e640127a0 con 0x7f5e6c151570 2023-12-13T22:26:35.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.912+0000 7f5e68ff9640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 0x7f5e4c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:35.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.912+0000 7f5e6bfff640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 0x7f5e4c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:35.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:35.912+0000 7f5e6bfff640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 0x7f5e4c068d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009ac0 tx=0x7f5e5c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:36.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.184+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e64055fc0 con 0x7f5e6c151570 2023-12-13T22:26:36.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.184+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5e64052300 con 0x7f5e6c151570 2023-12-13T22:26:36.381 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.384+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f5e6c154c30 con 0x7f5e6c151570 2023-12-13T22:26:36.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e68ff9640 1 -- 172.21.15.91:0/3608388220 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5e64055920 con 0x7f5e6c151570 2023-12-13T22:26:36.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 msgr2=0x7f5e4c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 0x7f5e4c068d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009ac0 tx=0x7f5e5c009190 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 msgr2=0x7f5e6c1f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400caf0 tx=0x7f5e6400a060 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 shutdown_connections 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5e4c066870 0x7f5e4c068d30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5e6c151570 0x7f5e6c1f3340 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e6c0c8e10 0x7f5e6c149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 --2- 172.21.15.91:0/3608388220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e6c06a560 0x7f5e6c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 >> 172.21.15.91:0/3608388220 conn(0x7f5e6c070160 msgr2=0x7f5e6c0c5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 shutdown_connections 2023-12-13T22:26:36.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:36.876+0000 7f5e726e7640 1 -- 172.21.15.91:0/3608388220 wait complete. 2023-12-13T22:26:36.894 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-13T22:26:37.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.028+0000 7f5edbcc4640 1 Processor -- start 2023-12-13T22:26:37.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.028+0000 7f5edbcc4640 1 -- start start 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5edbcc4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed40c1ed0 0x7f5ed406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5edbcc4640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5ed4070ab0 0x7f5ed406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5edbcc4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40c3b10 con 0x7f5ed414f850 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5edbcc4640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40c46b0 con 0x7f5ed4070ab0 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5edbcc4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414fc30 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.030 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5eda261640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5ed4070ab0 0x7f5ed406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:37.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5eda261640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5ed4070ab0 0x7f5ed406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57886/0 (socket says 172.21.15.91:57886) 2023-12-13T22:26:37.031 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.032+0000 7f5eda261640 1 -- 172.21.15.91:0/4065302145 learned_addr learned my addr 172.21.15.91:0/4065302145 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:37.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.036+0000 7f5eda261640 1 -- 172.21.15.91:0/4065302145 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed40c1ed0 msgr2=0x7f5ed406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:37.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.036+0000 7f5eda261640 1 --2- 172.21.15.91:0/4065302145 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed40c1ed0 0x7f5ed406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.036+0000 7f5eda261640 1 -- 172.21.15.91:0/4065302145 >> v1:172.21.15.152:6789/0 conn(0x7f5ed414f850 legacy=0x7f5ed40c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:37.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.036+0000 7f5eda261640 1 -- 172.21.15.91:0/4065302145 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40c11e0 con 0x7f5ed4070ab0 2023-12-13T22:26:37.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.040+0000 7f5eda261640 1 --2- 172.21.15.91:0/4065302145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed4070ab0 0x7f5ed406ea70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009e50 tx=0x7f5ecc01daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a9d5c0d77c5245 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5ed8a5e640 1 -- 172.21.15.91:0/4065302145 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0a69b0 con 0x7f5ed4070ab0 2023-12-13T22:26:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5ed8a5e640 1 -- 172.21.15.91:0/4065302145 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc0a6b10 con 0x7f5ed4070ab0 2023-12-13T22:26:37.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5ed8a5e640 1 -- 172.21.15.91:0/4065302145 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0a6ea0 con 0x7f5ed4070ab0 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- 172.21.15.91:0/4065302145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed4070ab0 msgr2=0x7f5ed406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/4065302145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed4070ab0 0x7f5ed406ea70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009e50 tx=0x7f5ecc01daf0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- 172.21.15.91:0/4065302145 shutdown_connections 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/4065302145 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed4070ab0 0x7f5ed406ea70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/4065302145 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed40c1ed0 0x7f5ed406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- 172.21.15.91:0/4065302145 >> 172.21.15.91:0/4065302145 conn(0x7f5ed406c6a0 msgr2=0x7f5ed406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- 172.21.15.91:0/4065302145 shutdown_connections 2023-12-13T22:26:37.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- 172.21.15.91:0/4065302145 wait complete. 2023-12-13T22:26:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 Processor -- start 2023-12-13T22:26:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- start start 2023-12-13T22:26:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed4070ab0 0x7f5ed413f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.048 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed414f850 0x7f5ed41f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414d3a0 con 0x7f5ed414f850 2023-12-13T22:26:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414bed0 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.048+0000 7f5edbcc4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414cd50 con 0x7f5ed4070ab0 2023-12-13T22:26:37.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.052+0000 7f5ed925f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:37.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.052+0000 7f5ed9a60640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed4070ab0 0x7f5ed413f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:37.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.052+0000 7f5ed925f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:43680/0 (socket says 172.21.15.91:43680) 2023-12-13T22:26:37.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.052+0000 7f5ed925f640 1 -- 172.21.15.91:0/3777004670 learned_addr learned my addr 172.21.15.91:0/3777004670 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.060+0000 7f5ed925f640 1 -- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed4070ab0 msgr2=0x7f5ed413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.060+0000 7f5ed925f640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed4070ab0 0x7f5ed413f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.060+0000 7f5ed925f640 1 -- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed414f850 msgr2=0x7f5ed41f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:37.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.060+0000 7f5ed925f640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed414f850 0x7f5ed41f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:37.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.060+0000 7f5ed925f640 1 -- 172.21.15.91:0/3777004670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc009b30 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.068+0000 7f5ed925f640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400b420 tx=0x7f5ec400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:37.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.076+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011830 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.076+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40119b0 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.080+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011d60 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.080+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed415f950 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.077 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.080+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed414cfc0 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.080+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed414d4e0 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.412+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5ec401b460 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.412+0000 7f5eca7fc640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 0x7f5eb8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:37.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.412+0000 7f5ed9a60640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 0x7f5eb8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:37.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.416+0000 7f5ed9a60640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 0x7f5eb8068d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0007fd0 tx=0x7f5ed0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:37.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.424+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ec4055d90 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.484+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5ec40519d0 con 0x7f5ed40c1ed0 2023-12-13T22:26:37.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:37.688+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ed4067520 con 0x7f5ed40c1ed0 2023-12-13T22:26:38.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.528+0000 7f5eca7fc640 1 -- 172.21.15.91:0/3777004670 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ec4054ff0 con 0x7f5ed40c1ed0 2023-12-13T22:26:38.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 msgr2=0x7f5eb8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 0x7f5eb8068d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0007fd0 tx=0x7f5ed0009040 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 msgr2=0x7f5ed4145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400b420 tx=0x7f5ec400b8e0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 shutdown_connections 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5eb8066870 0x7f5eb8068d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5ed414f850 0x7f5ed41f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ed40c1ed0 0x7f5ed4145a40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 --2- 172.21.15.91:0/3777004670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ed4070ab0 0x7f5ed413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 >> 172.21.15.91:0/3777004670 conn(0x7f5ed406c6a0 msgr2=0x7f5ed40c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 shutdown_connections 2023-12-13T22:26:38.530 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.532+0000 7f5edbcc4640 1 -- 172.21.15.91:0/3777004670 wait complete. 2023-12-13T22:26:38.554 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-13T22:26:38.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 Processor -- start 2023-12-13T22:26:38.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 -- start start 2023-12-13T22:26:38.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c88c0 0x7f1fa80c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa806ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa81575c0 con 0x7f1fa8070290 2023-12-13T22:26:38.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa81578a0 con 0x7f1fa80c88c0 2023-12-13T22:26:38.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fad536640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8157b80 con 0x7f1fa80c8ca0 2023-12-13T22:26:38.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fa6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c88c0 0x7f1fa80c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fa77fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa806ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fa6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f1fa80c88c0 0x7f1fa80c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57900/0 (socket says 172.21.15.91:57900) 2023-12-13T22:26:38.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.688+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/3139277970 learned_addr learned my addr 172.21.15.91:0/3139277970 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.692+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/3139277970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 msgr2=0x7f1fa806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.692+0000 7f1fa6ffd640 1 --2- 172.21.15.91:0/3139277970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa806ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.692+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/3139277970 >> v1:172.21.15.91:6789/0 conn(0x7f1fa8070290 legacy=0x7f1fa8151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:38.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.692+0000 7f1fa6ffd640 1 -- 172.21.15.91:0/3139277970 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8157e60 con 0x7f1fa80c88c0 2023-12-13T22:26:38.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.696+0000 7f1fa6ffd640 1 --2- 172.21.15.91:0/3139277970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa80c9c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009870 tx=0x7f1f9c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f154d6132c15642c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:38.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fa5ffb640 1 -- 172.21.15.91:0/3139277970 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0ac630 con 0x7f1fa80c88c0 2023-12-13T22:26:38.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fa5ffb640 1 -- 172.21.15.91:0/3139277970 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0ac790 con 0x7f1fa80c88c0 2023-12-13T22:26:38.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fa5ffb640 1 -- 172.21.15.91:0/3139277970 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0acb20 con 0x7f1fa80c88c0 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 -- 172.21.15.91:0/3139277970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 msgr2=0x7f1fa80c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 --2- 172.21.15.91:0/3139277970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa80c9c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009870 tx=0x7f1f9c01c500 comp rx=0 tx=0).stop 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 -- 172.21.15.91:0/3139277970 shutdown_connections 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 --2- 172.21.15.91:0/3139277970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa806ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 --2- 172.21.15.91:0/3139277970 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa80c9c90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 -- 172.21.15.91:0/3139277970 >> 172.21.15.91:0/3139277970 conn(0x7f1fa8070900 msgr2=0x7f1fa8070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 -- 172.21.15.91:0/3139277970 shutdown_connections 2023-12-13T22:26:38.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.700+0000 7f1fad536640 1 -- 172.21.15.91:0/3139277970 wait complete. 2023-12-13T22:26:38.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 Processor -- start 2023-12-13T22:26:38.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 -- start start 2023-12-13T22:26:38.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8070290 0x7f1fa8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81496c0 con 0x7f1fa80c88c0 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa813bf60 con 0x7f1fa8070290 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fad536640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8146750 con 0x7f1fa80c8ca0 2023-12-13T22:26:38.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fa67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fa67fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57904/0 (socket says 172.21.15.91:57904) 2023-12-13T22:26:38.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fa67fc640 1 -- 172.21.15.91:0/962046739 learned_addr learned my addr 172.21.15.91:0/962046739 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:38.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fa77fe640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.704+0000 7f1fa6ffd640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8070290 0x7f1fa8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 -- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 msgr2=0x7f1fa814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:38.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 -- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8070290 msgr2=0x7f1fa8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8070290 0x7f1fa8156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:38.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 -- 172.21.15.91:0/962046739 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0094d0 con 0x7f1fa80c88c0 2023-12-13T22:26:38.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.708+0000 7f1fa67fc640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c410 tx=0x7f1f9800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:38.712 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.712+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011790 con 0x7f1fa80c88c0 2023-12-13T22:26:38.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.712+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f980118f0 con 0x7f1fa80c88c0 2023-12-13T22:26:38.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.712+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa813e180 con 0x7f1fa80c88c0 2023-12-13T22:26:38.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.712+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011ce0 con 0x7f1fa80c88c0 2023-12-13T22:26:38.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.712+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa80c9c90 con 0x7f1fa80c88c0 2023-12-13T22:26:38.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.716+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8073e70 con 0x7f1fa80c88c0 2023-12-13T22:26:38.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.996+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1f98007020 con 0x7f1fa80c88c0 2023-12-13T22:26:38.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:38.996+0000 7f1f8f7fe640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 0x7f1f94068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:38.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.000+0000 7f1fa6ffd640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 0x7f1f94068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:38.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.000+0000 7f1fa6ffd640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 0x7f1f94068d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ae000 tx=0x7f1f9c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:39.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.040+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f98011e40 con 0x7f1fa80c88c0 2023-12-13T22:26:39.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.092+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1f98051d70 con 0x7f1fa80c88c0 2023-12-13T22:26:39.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.296+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1fa8150cc0 con 0x7f1fa80c88c0 2023-12-13T22:26:39.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.720+0000 7f1f8f7fe640 1 -- 172.21.15.91:0/962046739 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1f98055390 con 0x7f1fa80c88c0 2023-12-13T22:26:39.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 msgr2=0x7f1f94068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:39.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 0x7f1f94068d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ae000 tx=0x7f1f9c0a7000 comp rx=0 tx=0).stop 2023-12-13T22:26:39.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 msgr2=0x7f1fa8149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:39.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c410 tx=0x7f1f9800c8d0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 shutdown_connections 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1f94066840 0x7f1f94068d00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1fa80c8ca0 0x7f1fa814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1fa80c88c0 0x7f1fa8149f10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 --2- 172.21.15.91:0/962046739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1fa8070290 0x7f1fa8156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 >> 172.21.15.91:0/962046739 conn(0x7f1fa8070900 msgr2=0x7f1fa806f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 shutdown_connections 2023-12-13T22:26:39.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.724+0000 7f1fad536640 1 -- 172.21.15.91:0/962046739 wait complete. 2023-12-13T22:26:39.747 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-13T22:26:39.748 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:26:39.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.876+0000 7efca3dd5640 1 Processor -- start 2023-12-13T22:26:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.876+0000 7efca3dd5640 1 -- start start 2023-12-13T22:26:39.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca3dd5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc9c15c5a0 0x7efc9c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca3dd5640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efc9c15b620 0x7efc9c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca3dd5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c15a4a0 con 0x7efc9c15c1c0 2023-12-13T22:26:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca3dd5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06d560 con 0x7efc9c15c5a0 2023-12-13T22:26:39.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca3dd5640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06cc00 con 0x7efc9c15b620 2023-12-13T22:26:39.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca1370640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc9c15c5a0 0x7efc9c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:39.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca1370640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7efc9c15c5a0 0x7efc9c159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57852/0 (socket says 172.21.15.91:57852) 2023-12-13T22:26:39.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.880+0000 7efca1370640 1 -- 172.21.15.91:0/3259772527 learned_addr learned my addr 172.21.15.91:0/3259772527 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.884+0000 7efca1370640 1 -- 172.21.15.91:0/3259772527 >> v2:172.21.15.152:3300/0 conn(0x7efc9c15b620 msgr2=0x7efc9c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.884+0000 7efca1370640 1 --2- 172.21.15.91:0/3259772527 >> v2:172.21.15.152:3300/0 conn(0x7efc9c15b620 0x7efc9c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.884+0000 7efca1370640 1 -- 172.21.15.91:0/3259772527 >> v1:172.21.15.152:6789/0 conn(0x7efc9c15c1c0 legacy=0x7efc9c15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:39.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.884+0000 7efca1370640 1 -- 172.21.15.91:0/3259772527 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c06c680 con 0x7efc9c15c5a0 2023-12-13T22:26:39.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.888+0000 7efca1370640 1 --2- 172.21.15.91:0/3259772527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c5a0 0x7efc9c159f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0cf9b0 tx=0x7efc8c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb81b83e14ce258 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:39.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca0b6f640 1 -- 172.21.15.91:0/3259772527 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0aa5f0 con 0x7efc9c15c5a0 2023-12-13T22:26:39.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca0b6f640 1 -- 172.21.15.91:0/3259772527 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c0aa750 con 0x7efc9c15c5a0 2023-12-13T22:26:39.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca0b6f640 1 -- 172.21.15.91:0/3259772527 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0aaae0 con 0x7efc9c15c5a0 2023-12-13T22:26:39.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- 172.21.15.91:0/3259772527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c5a0 msgr2=0x7efc9c159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:39.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- 172.21.15.91:0/3259772527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c5a0 0x7efc9c159f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0cf9b0 tx=0x7efc8c01c490 comp rx=0 tx=0).stop 2023-12-13T22:26:39.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- 172.21.15.91:0/3259772527 shutdown_connections 2023-12-13T22:26:39.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- 172.21.15.91:0/3259772527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c5a0 0x7efc9c159f60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- 172.21.15.91:0/3259772527 >> v2:172.21.15.152:3300/0 conn(0x7efc9c15b620 0x7efc9c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- 172.21.15.91:0/3259772527 >> 172.21.15.91:0/3259772527 conn(0x7efc9c060fd0 msgr2=0x7efc9c0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:39.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- 172.21.15.91:0/3259772527 shutdown_connections 2023-12-13T22:26:39.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- 172.21.15.91:0/3259772527 wait complete. 2023-12-13T22:26:39.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 Processor -- start 2023-12-13T22:26:39.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 -- start start 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc9c15b620 0x7efc9c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.896+0000 7efca3dd5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c15c5a0 0x7efc9c0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca3dd5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1f4ea0 con 0x7efc9c15c1c0 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca3dd5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1f5e40 con 0x7efc9c15c5a0 2023-12-13T22:26:39.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca3dd5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c14cc10 con 0x7efc9c15b620 2023-12-13T22:26:39.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca1370640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:39.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca1370640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57856/0 (socket says 172.21.15.91:57856) 2023-12-13T22:26:39.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca1370640 1 -- 172.21.15.91:0/455852409 learned_addr learned my addr 172.21.15.91:0/455852409 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:39.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.900+0000 7efca1b71640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc9c15b620 0x7efc9c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:39.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 -- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc9c15b620 msgr2=0x7efc9c0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:39.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc9c15b620 0x7efc9c0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 -- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c15c5a0 msgr2=0x7efc9c0c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:39.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c15c5a0 0x7efc9c0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:39.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 -- 172.21.15.91:0/455852409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0094d0 con 0x7efc9c15c1c0 2023-12-13T22:26:39.904 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.904+0000 7efca1370640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ac040 tx=0x7efc8c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:39.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.908+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0b4810 con 0x7efc9c15c1c0 2023-12-13T22:26:39.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.908+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c0b8070 con 0x7efc9c15c1c0 2023-12-13T22:26:39.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.908+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0b4bb0 con 0x7efc9c15c1c0 2023-12-13T22:26:39.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.908+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0bfe60 con 0x7efc9c15c1c0 2023-12-13T22:26:39.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.908+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c1f5360 con 0x7efc9c15c1c0 2023-12-13T22:26:39.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:39.912+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c067d50 con 0x7efc9c15c1c0 2023-12-13T22:26:40.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.176+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7efc8c0b4d10 con 0x7efc9c15c1c0 2023-12-13T22:26:40.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.176+0000 7efc927fc640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 0x7efc80068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.176+0000 7efca1b71640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 0x7efc80068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.180+0000 7efca1b71640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 0x7efc80068d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc98007fd0 tx=0x7efc98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:40.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.208+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc8c0ba070 con 0x7efc9c15c1c0 2023-12-13T22:26:40.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.208+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7efc8c0ec790 con 0x7efc9c15c1c0 2023-12-13T22:26:40.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.400+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc9c15a4a0 con 0x7efc9c15c1c0 2023-12-13T22:26:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.420+0000 7efc927fc640 1 -- 172.21.15.91:0/455852409 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6528 (secure 0 0 0) 0x7efc9c15a4a0 con 0x7efc9c15c1c0 2023-12-13T22:26:40.419 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:40.419 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:39.813720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:26:40.419 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 14 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 msgr2=0x7efc80068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 0x7efc80068d30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc98007fd0 tx=0x7efc98009040 comp rx=0 tx=0).stop 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 msgr2=0x7efc9c154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0ac040 tx=0x7efc8c019230 comp rx=0 tx=0).stop 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 shutdown_connections 2023-12-13T22:26:40.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7efc80066870 0x7efc80068d30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c15c5a0 0x7efc9c0c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7efc9c15c1c0 0x7efc9c154c90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 --2- 172.21.15.91:0/455852409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc9c15b620 0x7efc9c0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 >> 172.21.15.91:0/455852409 conn(0x7efc9c060fd0 msgr2=0x7efc9c0613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 shutdown_connections 2023-12-13T22:26:40.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.424+0000 7efca3dd5640 1 -- 172.21.15.91:0/455852409 wait complete. 2023-12-13T22:26:40.440 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:40.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.556+0000 7f89282d7640 1 Processor -- start 2023-12-13T22:26:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.556+0000 7f89282d7640 1 -- start start 2023-12-13T22:26:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006ef30 0x7f8920156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.557 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f89200c5d30 0x7f89200c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f892006b720 0x7f892015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8920159db0 con 0x7f892006b720 2023-12-13T22:26:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8920159780 con 0x7f89200c5d30 2023-12-13T22:26:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f89282d7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c7410 con 0x7f892006ef30 2023-12-13T22:26:40.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f8926874640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f892006b720 0x7f892015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f8926073640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006ef30 0x7f8920156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f8926874640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f892006b720 0x7f892015a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57872/0 (socket says 172.21.15.91:57872) 2023-12-13T22:26:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f8926874640 1 -- 172.21.15.91:0/610782147 learned_addr learned my addr 172.21.15.91:0/610782147 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:40.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.560+0000 7f8925872640 1 --2- 172.21.15.91:0/610782147 >> v2:172.21.15.152:3300/0 conn(0x7f89200c5d30 0x7f89200c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.564+0000 7f8926874640 1 -- 172.21.15.91:0/610782147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006ef30 msgr2=0x7f8920156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:40.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.564+0000 7f8926874640 1 --2- 172.21.15.91:0/610782147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006ef30 0x7f8920156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.564+0000 7f8926874640 1 -- 172.21.15.91:0/610782147 >> v2:172.21.15.152:3300/0 conn(0x7f89200c5d30 msgr2=0x7f89200c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.564+0000 7f8926874640 1 --2- 172.21.15.91:0/610782147 >> v2:172.21.15.152:3300/0 conn(0x7f89200c5d30 0x7f89200c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.564+0000 7f8926874640 1 -- 172.21.15.91:0/610782147 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200c76f0 con 0x7f892006b720 2023-12-13T22:26:40.566 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.568+0000 7f8926874640 1 --2- 172.21.15.91:0/610782147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f892006b720 0x7f892015a1d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89200c8ef0 tx=0x7f891801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcca34b14b6d82c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:40.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f8925071640 1 -- 172.21.15.91:0/610782147 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180a57c0 con 0x7f892006b720 2023-12-13T22:26:40.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f8925071640 1 -- 172.21.15.91:0/610782147 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89180a5920 con 0x7f892006b720 2023-12-13T22:26:40.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f8925071640 1 -- 172.21.15.91:0/610782147 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180a5cb0 con 0x7f892006b720 2023-12-13T22:26:40.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 -- 172.21.15.91:0/610782147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f892006b720 msgr2=0x7f892015a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:40.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 --2- 172.21.15.91:0/610782147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f892006b720 0x7f892015a1d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89200c8ef0 tx=0x7f891801c940 comp rx=0 tx=0).stop 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 -- 172.21.15.91:0/610782147 shutdown_connections 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 --2- 172.21.15.91:0/610782147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f892006b720 0x7f892015a1d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 --2- 172.21.15.91:0/610782147 >> v2:172.21.15.152:3300/0 conn(0x7f89200c5d30 0x7f89200c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 --2- 172.21.15.91:0/610782147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006ef30 0x7f8920156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 -- 172.21.15.91:0/610782147 >> 172.21.15.91:0/610782147 conn(0x7f892006d200 msgr2=0x7f892006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 -- 172.21.15.91:0/610782147 shutdown_connections 2023-12-13T22:26:40.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.572+0000 7f89282d7640 1 -- 172.21.15.91:0/610782147 wait complete. 2023-12-13T22:26:40.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 Processor -- start 2023-12-13T22:26:40.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 -- start start 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006b720 0x7f8920162750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89200c5d30 0x7f8920144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892015fd40 con 0x7f89200c5d30 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89201618c0 con 0x7f892006ef30 2023-12-13T22:26:40.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f89282d7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8920150aa0 con 0x7f892006b720 2023-12-13T22:26:40.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f8925872640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.576+0000 7f8926073640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006b720 0x7f8920162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.580+0000 7f8925872640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54164/0 (socket says 172.21.15.91:54164) 2023-12-13T22:26:40.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.580+0000 7f8925872640 1 -- 172.21.15.91:0/3403968190 learned_addr learned my addr 172.21.15.91:0/3403968190 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:40.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.588+0000 7f8925872640 1 -- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006b720 msgr2=0x7f8920162750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:40.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.588+0000 7f8925872640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006b720 0x7f8920162750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.588+0000 7f8925872640 1 -- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89200c5d30 msgr2=0x7f8920144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:40.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.588+0000 7f8925872640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89200c5d30 0x7f8920144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:40.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.588+0000 7f8925872640 1 -- 172.21.15.91:0/3403968190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009b30 con 0x7f892006ef30 2023-12-13T22:26:40.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.596+0000 7f8925872640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f891000e8a0 tx=0x7f891000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910009510 con 0x7f892006ef30 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000c8e0 con 0x7f892006ef30 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8920160c40 con 0x7f892006ef30 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000cc50 con 0x7f892006ef30 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8920161200 con 0x7f892006ef30 2023-12-13T22:26:40.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.608+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920067520 con 0x7f892006ef30 2023-12-13T22:26:40.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.948+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8910026480 con 0x7f892006ef30 2023-12-13T22:26:40.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.948+0000 7f8916ffd640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 0x7f8904068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:40.948 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.948+0000 7f8926073640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 0x7f8904068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:40.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.952+0000 7f8926073640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 0x7f8904068d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f891c009ae0 tx=0x7f891c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:40.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.956+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89100559c0 con 0x7f892006ef30 2023-12-13T22:26:40.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:40.984+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8910051d00 con 0x7f892006ef30 2023-12-13T22:26:41.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.144+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f892006bd70 con 0x7f892006ef30 2023-12-13T22:26:41.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.244+0000 7f8916ffd640 1 -- 172.21.15.91:0/3403968190 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f8910017090 con 0x7f892006ef30 2023-12-13T22:26:41.245 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:41.245 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 msgr2=0x7f8904068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 0x7f8904068d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f891c009ae0 tx=0x7f891c009190 comp rx=0 tx=0).stop 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 msgr2=0x7f892013cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f891000e8a0 tx=0x7f891000eca0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 shutdown_connections 2023-12-13T22:26:41.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8904066840 0x7f8904068d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f89200c5d30 0x7f8920144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f892006ef30 0x7f892013cc00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 --2- 172.21.15.91:0/3403968190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f892006b720 0x7f8920162750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 >> 172.21.15.91:0/3403968190 conn(0x7f892006d200 msgr2=0x7f89201586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 shutdown_connections 2023-12-13T22:26:41.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.248+0000 7f89282d7640 1 -- 172.21.15.91:0/3403968190 wait complete. 2023-12-13T22:26:41.272 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-13T22:26:41.272 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:26:41.310 INFO:tasks.ceph.mds.f.smithi152.stderr:2023-12-13T22:26:41.297+0000 f9b4640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-12-13T22:26:41.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.392+0000 7fd02d2e3640 1 Processor -- start 2023-12-13T22:26:41.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.392+0000 7fd02d2e3640 1 -- start start 2023-12-13T22:26:41.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.396+0000 7fd02d2e3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd0280ce0c0 0x7fd0280ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.396+0000 7fd02d2e3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd02815a280 0x7fd028163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.396+0000 7fd02d2e3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0280cd9a0 con 0x7fd0280cc3c0 2023-12-13T22:26:41.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.396+0000 7fd02d2e3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0280ca550 con 0x7fd0280ce0c0 2023-12-13T22:26:41.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.396+0000 7fd02d2e3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280ce9e0 con 0x7fd02815a280 2023-12-13T22:26:41.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.468+0000 7fd0267fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd0280cc3c0 0x7fd028159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52494/0 (socket says 172.21.15.91:52494) 2023-12-13T22:26:41.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.468+0000 7fd0267fc640 1 -- 172.21.15.91:0/3905270345 learned_addr learned my addr 172.21.15.91:0/3905270345 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:41.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.468+0000 7fd026ffd640 1 --2- 172.21.15.91:0/3905270345 >> v2:172.21.15.152:3300/0 conn(0x7fd0280ce0c0 0x7fd0280ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.476+0000 7fd026ffd640 1 -- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd02815a280 msgr2=0x7fd028163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.476+0000 7fd026ffd640 1 --2- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd02815a280 0x7fd028163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.476+0000 7fd026ffd640 1 -- 172.21.15.91:0/3905270345 >> v1:172.21.15.152:6789/0 conn(0x7fd0280cc3c0 legacy=0x7fd028159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.476+0000 7fd026ffd640 1 -- 172.21.15.91:0/3905270345 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0281596c0 con 0x7fd0280ce0c0 2023-12-13T22:26:41.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.480+0000 7fd026ffd640 1 --2- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280ce0c0 0x7fd0280ce4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0097c0 tx=0x7fd01c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57af50f50f1c265c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:41.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd025ffb640 1 -- 172.21.15.91:0/3905270345 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0ab680 con 0x7fd0280ce0c0 2023-12-13T22:26:41.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd025ffb640 1 -- 172.21.15.91:0/3905270345 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0ab7e0 con 0x7fd0280ce0c0 2023-12-13T22:26:41.486 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd025ffb640 1 -- 172.21.15.91:0/3905270345 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0abb70 con 0x7fd0280ce0c0 2023-12-13T22:26:41.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 -- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280ce0c0 msgr2=0x7fd0280ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280ce0c0 0x7fd0280ce4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0097c0 tx=0x7fd01c01c480 comp rx=0 tx=0).stop 2023-12-13T22:26:41.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 -- 172.21.15.91:0/3905270345 shutdown_connections 2023-12-13T22:26:41.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd02815a280 0x7fd028163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/3905270345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280ce0c0 0x7fd0280ce4a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 -- 172.21.15.91:0/3905270345 >> 172.21.15.91:0/3905270345 conn(0x7fd0280b07c0 msgr2=0x7fd0280b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:41.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 -- 172.21.15.91:0/3905270345 shutdown_connections 2023-12-13T22:26:41.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.488+0000 7fd02d2e3640 1 -- 172.21.15.91:0/3905270345 wait complete. 2023-12-13T22:26:41.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 Processor -- start 2023-12-13T22:26:41.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 -- start start 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280cc3c0 0x7fd02815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0280ce0c0 0x7fd0281f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02815d760 con 0x7fd02815a280 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0281f3960 con 0x7fd0280cc3c0 2023-12-13T22:26:41.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd02d2e3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02815ba80 con 0x7fd0280ce0c0 2023-12-13T22:26:41.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd0277fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:41.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd026ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280cc3c0 0x7fd02815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:41.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd0277fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57888/0 (socket says 172.21.15.91:57888) 2023-12-13T22:26:41.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.492+0000 7fd0277fe640 1 -- 172.21.15.91:0/4268734772 learned_addr learned my addr 172.21.15.91:0/4268734772 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:41.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.500+0000 7fd0277fe640 1 -- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0280ce0c0 msgr2=0x7fd0281f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.500+0000 7fd0277fe640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0280ce0c0 0x7fd0281f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.500+0000 7fd0277fe640 1 -- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280cc3c0 msgr2=0x7fd02815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:41.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.500+0000 7fd0277fe640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280cc3c0 0x7fd02815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:41.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.500+0000 7fd0277fe640 1 -- 172.21.15.91:0/4268734772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c009420 con 0x7fd02815a280 2023-12-13T22:26:41.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.508+0000 7fd0277fe640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b970 tx=0x7fd02000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:41.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.512+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000cb40 con 0x7fd02815a280 2023-12-13T22:26:41.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.512+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000ccc0 con 0x7fd02815a280 2023-12-13T22:26:41.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.512+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020014680 con 0x7fd02815a280 2023-12-13T22:26:41.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.516+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02815bd60 con 0x7fd02815a280 2023-12-13T22:26:41.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.516+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02815c320 con 0x7fd02815a280 2023-12-13T22:26:41.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.516+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02815c840 con 0x7fd02815a280 2023-12-13T22:26:41.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.540+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd02001d3b0 con 0x7fd02815a280 2023-12-13T22:26:41.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.540+0000 7fd00f7fe640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 0x7fd014068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:41.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.540+0000 7fd026ffd640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 0x7fd014068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:41.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.540+0000 7fd026ffd640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 0x7fd014068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0af000 tx=0x7fd01c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:41.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.772+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd02000ce30 con 0x7fd02815a280 2023-12-13T22:26:41.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.808+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd0200515e0 con 0x7fd02815a280 2023-12-13T22:26:41.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.980+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0280cb3d0 con 0x7fd014066840 2023-12-13T22:26:41.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:41.996+0000 7fd00f7fe640 1 -- 172.21.15.91:0/4268734772 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367769 (secure 0 0 0) 0x7fd01c0aba00 con 0x7fd014066840 2023-12-13T22:26:41.998 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:42.001 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 msgr2=0x7fd014068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 0x7fd014068d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0af000 tx=0x7fd01c0a7000 comp rx=0 tx=0).stop 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 msgr2=0x7fd02806bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd02000b970 tx=0x7fd02000be30 comp rx=0 tx=0).stop 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 shutdown_connections 2023-12-13T22:26:42.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd014066840 0x7fd014068d00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd02815a280 0x7fd02806bd60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0280ce0c0 0x7fd0281f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 --2- 172.21.15.91:0/4268734772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0280cc3c0 0x7fd02815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 >> 172.21.15.91:0/4268734772 conn(0x7fd0280b07c0 msgr2=0x7fd0280aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 shutdown_connections 2023-12-13T22:26:42.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.000+0000 7fd02d2e3640 1 -- 172.21.15.91:0/4268734772 wait complete. 2023-12-13T22:26:42.017 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-12-13T22:26:40.576278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":216,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219744,"kb_used_data":3596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754976,"statfs":{"total":773094113280,"available":772869095424,"internally_reserved":0,"allocated":3682304,"data_stored":2162116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004689"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858970+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:26:06.858970+0000","last_peered":"2023-12-13T22:26:06.858970+0000","last_clean":"2023-12-13T22:26:06.858970+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:26:06.858970+0000","last_undegraded":"2023-12-13T22:26:06.858970+0000","last_fullsized":"2023-12-13T22:26:06.858970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282945+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:26:07.282945+0000","last_peered":"2023-12-13T22:26:07.282945+0000","last_clean":"2023-12-13T22:26:07.282945+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:26:07.282945+0000","last_undegraded":"2023-12-13T22:26:07.282945+0000","last_fullsized":"2023-12-13T22:26:07.282945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283063+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:26:07.283063+0000","last_peered":"2023-12-13T22:26:07.283063+0000","last_clean":"2023-12-13T22:26:07.283063+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:26:07.283063+0000","last_undegraded":"2023-12-13T22:26:07.283063+0000","last_fullsized":"2023-12-13T22:26:07.283063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858067+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:26:06.858067+0000","last_peered":"2023-12-13T22:26:06.858067+0000","last_clean":"2023-12-13T22:26:06.858067+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:26:06.858067+0000","last_undegraded":"2023-12-13T22:26:06.858067+0000","last_fullsized":"2023-12-13T22:26:06.858067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017099+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:26:08.017099+0000","last_peered":"2023-12-13T22:26:08.017099+0000","last_clean":"2023-12-13T22:26:08.017099+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:26:08.017099+0000","last_undegraded":"2023-12-13T22:26:08.017099+0000","last_fullsized":"2023-12-13T22:26:08.017099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891225+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:26:06.891225+0000","last_peered":"2023-12-13T22:26:06.891225+0000","last_clean":"2023-12-13T22:26:06.891225+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:26:06.891225+0000","last_undegraded":"2023-12-13T22:26:06.891225+0000","last_fullsized":"2023-12-13T22:26:06.891225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994069+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:26:06.994069+0000","last_peered":"2023-12-13T22:26:06.994069+0000","last_clean":"2023-12-13T22:26:06.994069+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:26:06.994069+0000","last_undegraded":"2023-12-13T22:26:06.994069+0000","last_fullsized":"2023-12-13T22:26:06.994069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017831+0000","last_change":"2023-12-13T22:26:05.940088+0000","last_active":"2023-12-13T22:26:08.017831+0000","last_peered":"2023-12-13T22:26:08.017831+0000","last_clean":"2023-12-13T22:26:08.017831+0000","last_became_active":"2023-12-13T22:26:05.939662+0000","last_became_peered":"2023-12-13T22:26:05.939662+0000","last_unstale":"2023-12-13T22:26:08.017831+0000","last_undegraded":"2023-12-13T22:26:08.017831+0000","last_fullsized":"2023-12-13T22:26:08.017831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:15.268425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890675+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:26:06.890675+0000","last_peered":"2023-12-13T22:26:06.890675+0000","last_clean":"2023-12-13T22:26:06.890675+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:26:06.890675+0000","last_undegraded":"2023-12-13T22:26:06.890675+0000","last_fullsized":"2023-12-13T22:26:06.890675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994756+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:26:06.994756+0000","last_peered":"2023-12-13T22:26:06.994756+0000","last_clean":"2023-12-13T22:26:06.994756+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:26:06.994756+0000","last_undegraded":"2023-12-13T22:26:06.994756+0000","last_fullsized":"2023-12-13T22:26:06.994756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017505+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:26:08.017505+0000","last_peered":"2023-12-13T22:26:08.017505+0000","last_clean":"2023-12-13T22:26:08.017505+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:26:08.017505+0000","last_undegraded":"2023-12-13T22:26:08.017505+0000","last_fullsized":"2023-12-13T22:26:08.017505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911212+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:26:06.911212+0000","last_peered":"2023-12-13T22:26:06.911212+0000","last_clean":"2023-12-13T22:26:06.911212+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:26:06.911212+0000","last_undegraded":"2023-12-13T22:26:06.911212+0000","last_fullsized":"2023-12-13T22:26:06.911212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890954+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:26:06.890954+0000","last_peered":"2023-12-13T22:26:06.890954+0000","last_clean":"2023-12-13T22:26:06.890954+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:26:06.890954+0000","last_undegraded":"2023-12-13T22:26:06.890954+0000","last_fullsized":"2023-12-13T22:26:06.890954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018802+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:26:08.018802+0000","last_peered":"2023-12-13T22:26:08.018802+0000","last_clean":"2023-12-13T22:26:08.018802+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:26:08.018802+0000","last_undegraded":"2023-12-13T22:26:08.018802+0000","last_fullsized":"2023-12-13T22:26:08.018802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282430+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:26:07.282430+0000","last_peered":"2023-12-13T22:26:07.282430+0000","last_clean":"2023-12-13T22:26:07.282430+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:26:07.282430+0000","last_undegraded":"2023-12-13T22:26:07.282430+0000","last_fullsized":"2023-12-13T22:26:07.282430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286594+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:26:07.286594+0000","last_peered":"2023-12-13T22:26:07.286594+0000","last_clean":"2023-12-13T22:26:07.286594+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:26:07.286594+0000","last_undegraded":"2023-12-13T22:26:07.286594+0000","last_fullsized":"2023-12-13T22:26:07.286594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019042+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:26:08.019042+0000","last_peered":"2023-12-13T22:26:08.019042+0000","last_clean":"2023-12-13T22:26:08.019042+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:26:08.019042+0000","last_undegraded":"2023-12-13T22:26:08.019042+0000","last_fullsized":"2023-12-13T22:26:08.019042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282270+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:26:07.282270+0000","last_peered":"2023-12-13T22:26:07.282270+0000","last_clean":"2023-12-13T22:26:07.282270+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:26:07.282270+0000","last_undegraded":"2023-12-13T22:26:07.282270+0000","last_fullsized":"2023-12-13T22:26:07.282270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285922+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:26:07.285922+0000","last_peered":"2023-12-13T22:26:07.285922+0000","last_clean":"2023-12-13T22:26:07.285922+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:26:07.285922+0000","last_undegraded":"2023-12-13T22:26:07.285922+0000","last_fullsized":"2023-12-13T22:26:07.285922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062830+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:26:09.062830+0000","last_peered":"2023-12-13T22:26:09.062830+0000","last_clean":"2023-12-13T22:26:09.062830+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:26:09.062830+0000","last_undegraded":"2023-12-13T22:26:09.062830+0000","last_fullsized":"2023-12-13T22:26:09.062830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291842+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:26:07.291842+0000","last_peered":"2023-12-13T22:26:07.291842+0000","last_clean":"2023-12-13T22:26:07.291842+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:26:07.291842+0000","last_undegraded":"2023-12-13T22:26:07.291842+0000","last_fullsized":"2023-12-13T22:26:07.291842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889239+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:26:06.889239+0000","last_peered":"2023-12-13T22:26:06.889239+0000","last_clean":"2023-12-13T22:26:06.889239+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:26:06.889239+0000","last_undegraded":"2023-12-13T22:26:06.889239+0000","last_fullsized":"2023-12-13T22:26:06.889239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018910+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:26:08.018910+0000","last_peered":"2023-12-13T22:26:08.018910+0000","last_clean":"2023-12-13T22:26:08.018910+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:26:08.018910+0000","last_undegraded":"2023-12-13T22:26:08.018910+0000","last_fullsized":"2023-12-13T22:26:08.018910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858749+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:26:06.858749+0000","last_peered":"2023-12-13T22:26:06.858749+0000","last_clean":"2023-12-13T22:26:06.858749+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:26:06.858749+0000","last_undegraded":"2023-12-13T22:26:06.858749+0000","last_fullsized":"2023-12-13T22:26:06.858749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912410+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:26:06.912410+0000","last_peered":"2023-12-13T22:26:06.912410+0000","last_clean":"2023-12-13T22:26:06.912410+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:26:06.912410+0000","last_undegraded":"2023-12-13T22:26:06.912410+0000","last_fullsized":"2023-12-13T22:26:06.912410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017812+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:26:08.017812+0000","last_peered":"2023-12-13T22:26:08.017812+0000","last_clean":"2023-12-13T22:26:08.017812+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:26:08.017812+0000","last_undegraded":"2023-12-13T22:26:08.017812+0000","last_fullsized":"2023-12-13T22:26:08.017812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283278+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:26:07.283278+0000","last_peered":"2023-12-13T22:26:07.283278+0000","last_clean":"2023-12-13T22:26:07.283278+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:26:07.283278+0000","last_undegraded":"2023-12-13T22:26:07.283278+0000","last_fullsized":"2023-12-13T22:26:07.283278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:21.331008+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:26:21.331008+0000","last_peered":"2023-12-13T22:26:21.331008+0000","last_clean":"2023-12-13T22:26:21.331008+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:26:21.331008+0000","last_undegraded":"2023-12-13T22:26:21.331008+0000","last_fullsized":"2023-12-13T22:26:21.331008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063386+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:26:09.063386+0000","last_peered":"2023-12-13T22:26:09.063386+0000","last_clean":"2023-12-13T22:26:09.063386+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:26:09.063386+0000","last_undegraded":"2023-12-13T22:26:09.063386+0000","last_fullsized":"2023-12-13T22:26:09.063386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286245+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:26:07.286245+0000","last_peered":"2023-12-13T22:26:07.286245+0000","last_clean":"2023-12-13T22:26:07.286245+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:26:07.286245+0000","last_undegraded":"2023-12-13T22:26:07.286245+0000","last_fullsized":"2023-12-13T22:26:07.286245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891472+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:26:06.891472+0000","last_peered":"2023-12-13T22:26:06.891472+0000","last_clean":"2023-12-13T22:26:06.891472+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:26:06.891472+0000","last_undegraded":"2023-12-13T22:26:06.891472+0000","last_fullsized":"2023-12-13T22:26:06.891472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.983999+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:26:07.983999+0000","last_peered":"2023-12-13T22:26:07.983999+0000","last_clean":"2023-12-13T22:26:07.983999+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:26:07.983999+0000","last_undegraded":"2023-12-13T22:26:07.983999+0000","last_fullsized":"2023-12-13T22:26:07.983999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994774+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:26:06.994774+0000","last_peered":"2023-12-13T22:26:06.994774+0000","last_clean":"2023-12-13T22:26:06.994774+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:26:06.994774+0000","last_undegraded":"2023-12-13T22:26:06.994774+0000","last_fullsized":"2023-12-13T22:26:06.994774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286309+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:26:07.286309+0000","last_peered":"2023-12-13T22:26:07.286309+0000","last_clean":"2023-12-13T22:26:07.286309+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:26:07.286309+0000","last_undegraded":"2023-12-13T22:26:07.286309+0000","last_fullsized":"2023-12-13T22:26:07.286309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061487+0000","last_change":"2023-12-13T22:26:05.944559+0000","last_active":"2023-12-13T22:26:09.061487+0000","last_peered":"2023-12-13T22:26:09.061487+0000","last_clean":"2023-12-13T22:26:09.061487+0000","last_became_active":"2023-12-13T22:26:05.943841+0000","last_became_peered":"2023-12-13T22:26:05.943841+0000","last_unstale":"2023-12-13T22:26:09.061487+0000","last_undegraded":"2023-12-13T22:26:09.061487+0000","last_fullsized":"2023-12-13T22:26:09.061487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291954+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:26:07.291954+0000","last_peered":"2023-12-13T22:26:07.291954+0000","last_clean":"2023-12-13T22:26:07.291954+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:26:07.291954+0000","last_undegraded":"2023-12-13T22:26:07.291954+0000","last_fullsized":"2023-12-13T22:26:07.291954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994286+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:26:06.994286+0000","last_peered":"2023-12-13T22:26:06.994286+0000","last_clean":"2023-12-13T22:26:06.994286+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:26:06.994286+0000","last_undegraded":"2023-12-13T22:26:06.994286+0000","last_fullsized":"2023-12-13T22:26:06.994286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062075+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:26:09.062075+0000","last_peered":"2023-12-13T22:26:09.062075+0000","last_clean":"2023-12-13T22:26:09.062075+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:26:09.062075+0000","last_undegraded":"2023-12-13T22:26:09.062075+0000","last_fullsized":"2023-12-13T22:26:09.062075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285856+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:26:07.285856+0000","last_peered":"2023-12-13T22:26:07.285856+0000","last_clean":"2023-12-13T22:26:07.285856+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:26:07.285856+0000","last_undegraded":"2023-12-13T22:26:07.285856+0000","last_fullsized":"2023-12-13T22:26:07.285856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827039+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:26:07.827039+0000","last_peered":"2023-12-13T22:26:07.827039+0000","last_clean":"2023-12-13T22:26:07.827039+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:26:07.827039+0000","last_undegraded":"2023-12-13T22:26:07.827039+0000","last_fullsized":"2023-12-13T22:26:07.827039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063001+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:26:09.063001+0000","last_peered":"2023-12-13T22:26:09.063001+0000","last_clean":"2023-12-13T22:26:09.063001+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:26:09.063001+0000","last_undegraded":"2023-12-13T22:26:09.063001+0000","last_fullsized":"2023-12-13T22:26:09.063001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857511+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:26:06.857511+0000","last_peered":"2023-12-13T22:26:06.857511+0000","last_clean":"2023-12-13T22:26:06.857511+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:26:06.857511+0000","last_undegraded":"2023-12-13T22:26:06.857511+0000","last_fullsized":"2023-12-13T22:26:06.857511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889254+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:26:06.889254+0000","last_peered":"2023-12-13T22:26:06.889254+0000","last_clean":"2023-12-13T22:26:06.889254+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:26:06.889254+0000","last_undegraded":"2023-12-13T22:26:06.889254+0000","last_fullsized":"2023-12-13T22:26:06.889254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984268+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:26:07.984268+0000","last_peered":"2023-12-13T22:26:07.984268+0000","last_clean":"2023-12-13T22:26:07.984268+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:26:07.984268+0000","last_undegraded":"2023-12-13T22:26:07.984268+0000","last_fullsized":"2023-12-13T22:26:07.984268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282052+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:26:07.282052+0000","last_peered":"2023-12-13T22:26:07.282052+0000","last_clean":"2023-12-13T22:26:07.282052+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:26:07.282052+0000","last_undegraded":"2023-12-13T22:26:07.282052+0000","last_fullsized":"2023-12-13T22:26:07.282052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994125+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:26:06.994125+0000","last_peered":"2023-12-13T22:26:06.994125+0000","last_clean":"2023-12-13T22:26:06.994125+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:26:06.994125+0000","last_undegraded":"2023-12-13T22:26:06.994125+0000","last_fullsized":"2023-12-13T22:26:06.994125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889497+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:26:06.889497+0000","last_peered":"2023-12-13T22:26:06.889497+0000","last_clean":"2023-12-13T22:26:06.889497+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:26:06.889497+0000","last_undegraded":"2023-12-13T22:26:06.889497+0000","last_fullsized":"2023-12-13T22:26:06.889497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924748+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:26:07.924748+0000","last_peered":"2023-12-13T22:26:07.924748+0000","last_clean":"2023-12-13T22:26:07.924748+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:26:07.924748+0000","last_undegraded":"2023-12-13T22:26:07.924748+0000","last_fullsized":"2023-12-13T22:26:07.924748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890978+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:26:06.890978+0000","last_peered":"2023-12-13T22:26:06.890978+0000","last_clean":"2023-12-13T22:26:06.890978+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:26:06.890978+0000","last_undegraded":"2023-12-13T22:26:06.890978+0000","last_fullsized":"2023-12-13T22:26:06.890978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827405+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:26:07.827405+0000","last_peered":"2023-12-13T22:26:07.827405+0000","last_clean":"2023-12-13T22:26:07.827405+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:26:07.827405+0000","last_undegraded":"2023-12-13T22:26:07.827405+0000","last_fullsized":"2023-12-13T22:26:07.827405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924406+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:26:07.924406+0000","last_peered":"2023-12-13T22:26:07.924406+0000","last_clean":"2023-12-13T22:26:07.924406+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:26:07.924406+0000","last_undegraded":"2023-12-13T22:26:07.924406+0000","last_fullsized":"2023-12-13T22:26:07.924406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994199+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:26:06.994199+0000","last_peered":"2023-12-13T22:26:06.994199+0000","last_clean":"2023-12-13T22:26:06.994199+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:26:06.994199+0000","last_undegraded":"2023-12-13T22:26:06.994199+0000","last_fullsized":"2023-12-13T22:26:06.994199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286596+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:26:07.286596+0000","last_peered":"2023-12-13T22:26:07.286596+0000","last_clean":"2023-12-13T22:26:07.286596+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:26:07.286596+0000","last_undegraded":"2023-12-13T22:26:07.286596+0000","last_fullsized":"2023-12-13T22:26:07.286596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984240+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:26:07.984240+0000","last_peered":"2023-12-13T22:26:07.984240+0000","last_clean":"2023-12-13T22:26:07.984240+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:26:07.984240+0000","last_undegraded":"2023-12-13T22:26:07.984240+0000","last_fullsized":"2023-12-13T22:26:07.984240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893338+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:26:06.893338+0000","last_peered":"2023-12-13T22:26:06.893338+0000","last_clean":"2023-12-13T22:26:06.893338+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:26:06.893338+0000","last_undegraded":"2023-12-13T22:26:06.893338+0000","last_fullsized":"2023-12-13T22:26:06.893338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827411+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:26:07.827411+0000","last_peered":"2023-12-13T22:26:07.827411+0000","last_clean":"2023-12-13T22:26:07.827411+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:26:07.827411+0000","last_undegraded":"2023-12-13T22:26:07.827411+0000","last_fullsized":"2023-12-13T22:26:07.827411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.060442+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:26:09.060442+0000","last_peered":"2023-12-13T22:26:09.060442+0000","last_clean":"2023-12-13T22:26:09.060442+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:26:09.060442+0000","last_undegraded":"2023-12-13T22:26:09.060442+0000","last_fullsized":"2023-12-13T22:26:09.060442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891642+0000","last_change":"2023-12-13T22:26:00.418974+0000","last_active":"2023-12-13T22:26:06.891642+0000","last_peered":"2023-12-13T22:26:06.891642+0000","last_clean":"2023-12-13T22:26:06.891642+0000","last_became_active":"2023-12-13T22:26:00.418573+0000","last_became_peered":"2023-12-13T22:26:00.418573+0000","last_unstale":"2023-12-13T22:26:06.891642+0000","last_undegraded":"2023-12-13T22:26:06.891642+0000","last_fullsized":"2023-12-13T22:26:06.891642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292790+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:26:07.292790+0000","last_peered":"2023-12-13T22:26:07.292790+0000","last_clean":"2023-12-13T22:26:07.292790+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:26:07.292790+0000","last_undegraded":"2023-12-13T22:26:07.292790+0000","last_fullsized":"2023-12-13T22:26:07.292790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017051+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:26:08.017051+0000","last_peered":"2023-12-13T22:26:08.017051+0000","last_clean":"2023-12-13T22:26:08.017051+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:26:08.017051+0000","last_undegraded":"2023-12-13T22:26:08.017051+0000","last_fullsized":"2023-12-13T22:26:08.017051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889629+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:26:06.889629+0000","last_peered":"2023-12-13T22:26:06.889629+0000","last_clean":"2023-12-13T22:26:06.889629+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:26:06.889629+0000","last_undegraded":"2023-12-13T22:26:06.889629+0000","last_fullsized":"2023-12-13T22:26:06.889629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.826618+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:26:07.826618+0000","last_peered":"2023-12-13T22:26:07.826618+0000","last_clean":"2023-12-13T22:26:07.826618+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:26:07.826618+0000","last_undegraded":"2023-12-13T22:26:07.826618+0000","last_fullsized":"2023-12-13T22:26:07.826618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984199+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:26:07.984199+0000","last_peered":"2023-12-13T22:26:07.984199+0000","last_clean":"2023-12-13T22:26:07.984199+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:26:07.984199+0000","last_undegraded":"2023-12-13T22:26:07.984199+0000","last_fullsized":"2023-12-13T22:26:07.984199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909876+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:26:06.909876+0000","last_peered":"2023-12-13T22:26:06.909876+0000","last_clean":"2023-12-13T22:26:06.909876+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:26:06.909876+0000","last_undegraded":"2023-12-13T22:26:06.909876+0000","last_fullsized":"2023-12-13T22:26:06.909876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910183+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:26:06.910183+0000","last_peered":"2023-12-13T22:26:06.910183+0000","last_clean":"2023-12-13T22:26:06.910183+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:26:06.910183+0000","last_undegraded":"2023-12-13T22:26:06.910183+0000","last_fullsized":"2023-12-13T22:26:06.910183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064384+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:26:09.064384+0000","last_peered":"2023-12-13T22:26:09.064384+0000","last_clean":"2023-12-13T22:26:09.064384+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:26:09.064384+0000","last_undegraded":"2023-12-13T22:26:09.064384+0000","last_fullsized":"2023-12-13T22:26:09.064384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890397+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:26:06.890397+0000","last_peered":"2023-12-13T22:26:06.890397+0000","last_clean":"2023-12-13T22:26:06.890397+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:26:06.890397+0000","last_undegraded":"2023-12-13T22:26:06.890397+0000","last_fullsized":"2023-12-13T22:26:06.890397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994235+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:26:06.994235+0000","last_peered":"2023-12-13T22:26:06.994235+0000","last_clean":"2023-12-13T22:26:06.994235+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:26:06.994235+0000","last_undegraded":"2023-12-13T22:26:06.994235+0000","last_fullsized":"2023-12-13T22:26:06.994235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064123+0000","last_change":"2023-12-13T22:26:06.547843+0000","last_active":"2023-12-13T22:26:09.064123+0000","last_peered":"2023-12-13T22:26:09.064123+0000","last_clean":"2023-12-13T22:26:09.064123+0000","last_became_active":"2023-12-13T22:26:06.546738+0000","last_became_peered":"2023-12-13T22:26:06.546738+0000","last_unstale":"2023-12-13T22:26:09.064123+0000","last_undegraded":"2023-12-13T22:26:09.064123+0000","last_fullsized":"2023-12-13T22:26:09.064123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:02:37.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858138+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:26:06.858138+0000","last_peered":"2023-12-13T22:26:06.858138+0000","last_clean":"2023-12-13T22:26:06.858138+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:26:06.858138+0000","last_undegraded":"2023-12-13T22:26:06.858138+0000","last_fullsized":"2023-12-13T22:26:06.858138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.691734+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:26:38.691734+0000","last_peered":"2023-12-13T22:26:38.691734+0000","last_clean":"2023-12-13T22:26:38.691734+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:26:38.691734+0000","last_undegraded":"2023-12-13T22:26:38.691734+0000","last_fullsized":"2023-12-13T22:26:38.691734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061946+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:26:09.061946+0000","last_peered":"2023-12-13T22:26:09.061946+0000","last_clean":"2023-12-13T22:26:09.061946+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:26:09.061946+0000","last_undegraded":"2023-12-13T22:26:09.061946+0000","last_fullsized":"2023-12-13T22:26:09.061946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890732+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:26:06.890732+0000","last_peered":"2023-12-13T22:26:06.890732+0000","last_clean":"2023-12-13T22:26:06.890732+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:26:06.890732+0000","last_undegraded":"2023-12-13T22:26:06.890732+0000","last_fullsized":"2023-12-13T22:26:06.890732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'11","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:16.680554+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:26:16.680554+0000","last_peered":"2023-12-13T22:26:16.680554+0000","last_clean":"2023-12-13T22:26:16.680554+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:26:16.680554+0000","last_undegraded":"2023-12-13T22:26:16.680554+0000","last_fullsized":"2023-12-13T22:26:16.680554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061708+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:26:09.061708+0000","last_peered":"2023-12-13T22:26:09.061708+0000","last_clean":"2023-12-13T22:26:09.061708+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:26:09.061708+0000","last_undegraded":"2023-12-13T22:26:09.061708+0000","last_fullsized":"2023-12-13T22:26:09.061708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292771+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:26:07.292771+0000","last_peered":"2023-12-13T22:26:07.292771+0000","last_clean":"2023-12-13T22:26:07.292771+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:26:07.292771+0000","last_undegraded":"2023-12-13T22:26:07.292771+0000","last_fullsized":"2023-12-13T22:26:07.292771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286461+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:26:07.286461+0000","last_peered":"2023-12-13T22:26:07.286461+0000","last_clean":"2023-12-13T22:26:07.286461+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:26:07.286461+0000","last_undegraded":"2023-12-13T22:26:07.286461+0000","last_fullsized":"2023-12-13T22:26:07.286461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018583+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:26:08.018583+0000","last_peered":"2023-12-13T22:26:08.018583+0000","last_clean":"2023-12-13T22:26:08.018583+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:26:08.018583+0000","last_undegraded":"2023-12-13T22:26:08.018583+0000","last_fullsized":"2023-12-13T22:26:08.018583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858759+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:26:06.858759+0000","last_peered":"2023-12-13T22:26:06.858759+0000","last_clean":"2023-12-13T22:26:06.858759+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:26:06.858759+0000","last_undegraded":"2023-12-13T22:26:06.858759+0000","last_fullsized":"2023-12-13T22:26:06.858759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994934+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:26:06.994934+0000","last_peered":"2023-12-13T22:26:06.994934+0000","last_clean":"2023-12-13T22:26:06.994934+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:26:06.994934+0000","last_undegraded":"2023-12-13T22:26:06.994934+0000","last_fullsized":"2023-12-13T22:26:06.994934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063423+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:26:09.063423+0000","last_peered":"2023-12-13T22:26:09.063423+0000","last_clean":"2023-12-13T22:26:09.063423+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:26:09.063423+0000","last_undegraded":"2023-12-13T22:26:09.063423+0000","last_fullsized":"2023-12-13T22:26:09.063423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994895+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:26:06.994895+0000","last_peered":"2023-12-13T22:26:06.994895+0000","last_clean":"2023-12-13T22:26:06.994895+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:26:06.994895+0000","last_undegraded":"2023-12-13T22:26:06.994895+0000","last_fullsized":"2023-12-13T22:26:06.994895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912203+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:26:06.912203+0000","last_peered":"2023-12-13T22:26:06.912203+0000","last_clean":"2023-12-13T22:26:06.912203+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:26:06.912203+0000","last_undegraded":"2023-12-13T22:26:06.912203+0000","last_fullsized":"2023-12-13T22:26:06.912203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984083+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:26:07.984083+0000","last_peered":"2023-12-13T22:26:07.984083+0000","last_clean":"2023-12-13T22:26:07.984083+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:26:07.984083+0000","last_undegraded":"2023-12-13T22:26:07.984083+0000","last_fullsized":"2023-12-13T22:26:07.984083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285814+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:26:07.285814+0000","last_peered":"2023-12-13T22:26:07.285814+0000","last_clean":"2023-12-13T22:26:07.285814+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:26:07.285814+0000","last_undegraded":"2023-12-13T22:26:07.285814+0000","last_fullsized":"2023-12-13T22:26:07.285814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994410+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:26:06.994410+0000","last_peered":"2023-12-13T22:26:06.994410+0000","last_clean":"2023-12-13T22:26:06.994410+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:26:06.994410+0000","last_undegraded":"2023-12-13T22:26:06.994410+0000","last_fullsized":"2023-12-13T22:26:06.994410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.925274+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:26:07.925274+0000","last_peered":"2023-12-13T22:26:07.925274+0000","last_clean":"2023-12-13T22:26:07.925274+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:26:07.925274+0000","last_undegraded":"2023-12-13T22:26:07.925274+0000","last_fullsized":"2023-12-13T22:26:07.925274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282151+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:26:07.282151+0000","last_peered":"2023-12-13T22:26:07.282151+0000","last_clean":"2023-12-13T22:26:07.282151+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:26:07.282151+0000","last_undegraded":"2023-12-13T22:26:07.282151+0000","last_fullsized":"2023-12-13T22:26:07.282151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282440+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:26:07.282440+0000","last_peered":"2023-12-13T22:26:07.282440+0000","last_clean":"2023-12-13T22:26:07.282440+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:26:07.282440+0000","last_undegraded":"2023-12-13T22:26:07.282440+0000","last_fullsized":"2023-12-13T22:26:07.282440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911470+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:26:06.911470+0000","last_peered":"2023-12-13T22:26:06.911470+0000","last_clean":"2023-12-13T22:26:06.911470+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:26:06.911470+0000","last_undegraded":"2023-12-13T22:26:06.911470+0000","last_fullsized":"2023-12-13T22:26:06.911470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858860+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:26:06.858860+0000","last_peered":"2023-12-13T22:26:06.858860+0000","last_clean":"2023-12-13T22:26:06.858860+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:26:06.858860+0000","last_undegraded":"2023-12-13T22:26:06.858860+0000","last_fullsized":"2023-12-13T22:26:06.858860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.815590+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:26:08.815590+0000","last_peered":"2023-12-13T22:26:08.815590+0000","last_clean":"2023-12-13T22:26:08.815590+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:26:08.815590+0000","last_undegraded":"2023-12-13T22:26:08.815590+0000","last_fullsized":"2023-12-13T22:26:08.815590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282467+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:26:07.282467+0000","last_peered":"2023-12-13T22:26:07.282467+0000","last_clean":"2023-12-13T22:26:07.282467+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:26:07.282467+0000","last_undegraded":"2023-12-13T22:26:07.282467+0000","last_fullsized":"2023-12-13T22:26:07.282467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291838+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:26:07.291838+0000","last_peered":"2023-12-13T22:26:07.291838+0000","last_clean":"2023-12-13T22:26:07.291838+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:26:07.291838+0000","last_undegraded":"2023-12-13T22:26:07.291838+0000","last_fullsized":"2023-12-13T22:26:07.291838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064331+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:26:09.064331+0000","last_peered":"2023-12-13T22:26:09.064331+0000","last_clean":"2023-12-13T22:26:09.064331+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:26:09.064331+0000","last_undegraded":"2023-12-13T22:26:09.064331+0000","last_fullsized":"2023-12-13T22:26:09.064331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909726+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:26:06.909726+0000","last_peered":"2023-12-13T22:26:06.909726+0000","last_clean":"2023-12-13T22:26:06.909726+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:26:06.909726+0000","last_undegraded":"2023-12-13T22:26:06.909726+0000","last_fullsized":"2023-12-13T22:26:06.909726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.826916+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:26:07.826916+0000","last_peered":"2023-12-13T22:26:07.826916+0000","last_clean":"2023-12-13T22:26:07.826916+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:26:07.826916+0000","last_undegraded":"2023-12-13T22:26:07.826916+0000","last_fullsized":"2023-12-13T22:26:07.826916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994203+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:26:06.994203+0000","last_peered":"2023-12-13T22:26:06.994203+0000","last_clean":"2023-12-13T22:26:06.994203+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:26:06.994203+0000","last_undegraded":"2023-12-13T22:26:06.994203+0000","last_fullsized":"2023-12-13T22:26:06.994203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858620+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:26:06.858620+0000","last_peered":"2023-12-13T22:26:06.858620+0000","last_clean":"2023-12-13T22:26:06.858620+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:26:06.858620+0000","last_undegraded":"2023-12-13T22:26:06.858620+0000","last_fullsized":"2023-12-13T22:26:06.858620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282688+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:26:07.282688+0000","last_peered":"2023-12-13T22:26:07.282688+0000","last_clean":"2023-12-13T22:26:07.282688+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:26:07.282688+0000","last_undegraded":"2023-12-13T22:26:07.282688+0000","last_fullsized":"2023-12-13T22:26:07.282688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286261+0000","last_change":"2023-12-13T22:26:00.413885+0000","last_active":"2023-12-13T22:26:07.286261+0000","last_peered":"2023-12-13T22:26:07.286261+0000","last_clean":"2023-12-13T22:26:07.286261+0000","last_became_active":"2023-12-13T22:26:00.413588+0000","last_became_peered":"2023-12-13T22:26:00.413588+0000","last_unstale":"2023-12-13T22:26:07.286261+0000","last_undegraded":"2023-12-13T22:26:07.286261+0000","last_fullsized":"2023-12-13T22:26:07.286261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912253+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:26:06.912253+0000","last_peered":"2023-12-13T22:26:06.912253+0000","last_clean":"2023-12-13T22:26:06.912253+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:26:06.912253+0000","last_undegraded":"2023-12-13T22:26:06.912253+0000","last_fullsized":"2023-12-13T22:26:06.912253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283197+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:26:07.283197+0000","last_peered":"2023-12-13T22:26:07.283197+0000","last_clean":"2023-12-13T22:26:07.283197+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:26:07.283197+0000","last_undegraded":"2023-12-13T22:26:07.283197+0000","last_fullsized":"2023-12-13T22:26:07.283197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994173+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:26:06.994173+0000","last_peered":"2023-12-13T22:26:06.994173+0000","last_clean":"2023-12-13T22:26:06.994173+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:26:06.994173+0000","last_undegraded":"2023-12-13T22:26:06.994173+0000","last_fullsized":"2023-12-13T22:26:06.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282308+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:26:07.282308+0000","last_peered":"2023-12-13T22:26:07.282308+0000","last_clean":"2023-12-13T22:26:07.282308+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282308+0000","last_undegraded":"2023-12-13T22:26:07.282308+0000","last_fullsized":"2023-12-13T22:26:07.282308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994078+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:26:06.994078+0000","last_peered":"2023-12-13T22:26:06.994078+0000","last_clean":"2023-12-13T22:26:06.994078+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:26:06.994078+0000","last_undegraded":"2023-12-13T22:26:06.994078+0000","last_fullsized":"2023-12-13T22:26:06.994078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858162+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:26:06.858162+0000","last_peered":"2023-12-13T22:26:06.858162+0000","last_clean":"2023-12-13T22:26:06.858162+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:26:06.858162+0000","last_undegraded":"2023-12-13T22:26:06.858162+0000","last_fullsized":"2023-12-13T22:26:06.858162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910747+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:26:06.910747+0000","last_peered":"2023-12-13T22:26:06.910747+0000","last_clean":"2023-12-13T22:26:06.910747+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:26:06.910747+0000","last_undegraded":"2023-12-13T22:26:06.910747+0000","last_fullsized":"2023-12-13T22:26:06.910747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891457+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:26:06.891457+0000","last_peered":"2023-12-13T22:26:06.891457+0000","last_clean":"2023-12-13T22:26:06.891457+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:26:06.891457+0000","last_undegraded":"2023-12-13T22:26:06.891457+0000","last_fullsized":"2023-12-13T22:26:06.891457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827315+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:26:07.827315+0000","last_peered":"2023-12-13T22:26:07.827315+0000","last_clean":"2023-12-13T22:26:07.827315+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:26:07.827315+0000","last_undegraded":"2023-12-13T22:26:07.827315+0000","last_fullsized":"2023-12-13T22:26:07.827315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.995002+0000","last_change":"2023-12-13T22:26:00.417280+0000","last_active":"2023-12-13T22:26:06.995002+0000","last_peered":"2023-12-13T22:26:06.995002+0000","last_clean":"2023-12-13T22:26:06.995002+0000","last_became_active":"2023-12-13T22:26:00.410002+0000","last_became_peered":"2023-12-13T22:26:00.410002+0000","last_unstale":"2023-12-13T22:26:06.995002+0000","last_undegraded":"2023-12-13T22:26:06.995002+0000","last_fullsized":"2023-12-13T22:26:06.995002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994368+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:26:06.994368+0000","last_peered":"2023-12-13T22:26:06.994368+0000","last_clean":"2023-12-13T22:26:06.994368+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:26:06.994368+0000","last_undegraded":"2023-12-13T22:26:06.994368+0000","last_fullsized":"2023-12-13T22:26:06.994368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285823+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:26:07.285823+0000","last_peered":"2023-12-13T22:26:07.285823+0000","last_clean":"2023-12-13T22:26:07.285823+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:26:07.285823+0000","last_undegraded":"2023-12-13T22:26:07.285823+0000","last_fullsized":"2023-12-13T22:26:07.285823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857773+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:26:06.857773+0000","last_peered":"2023-12-13T22:26:06.857773+0000","last_clean":"2023-12-13T22:26:06.857773+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:26:06.857773+0000","last_undegraded":"2023-12-13T22:26:06.857773+0000","last_fullsized":"2023-12-13T22:26:06.857773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282281+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:26:07.282281+0000","last_peered":"2023-12-13T22:26:07.282281+0000","last_clean":"2023-12-13T22:26:07.282281+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:26:07.282281+0000","last_undegraded":"2023-12-13T22:26:07.282281+0000","last_fullsized":"2023-12-13T22:26:07.282281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292704+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:26:07.292704+0000","last_peered":"2023-12-13T22:26:07.292704+0000","last_clean":"2023-12-13T22:26:07.292704+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:26:07.292704+0000","last_undegraded":"2023-12-13T22:26:07.292704+0000","last_fullsized":"2023-12-13T22:26:07.292704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911675+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:26:06.911675+0000","last_peered":"2023-12-13T22:26:06.911675+0000","last_clean":"2023-12-13T22:26:06.911675+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:26:06.911675+0000","last_undegraded":"2023-12-13T22:26:06.911675+0000","last_fullsized":"2023-12-13T22:26:06.911675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912154+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:26:06.912154+0000","last_peered":"2023-12-13T22:26:06.912154+0000","last_clean":"2023-12-13T22:26:06.912154+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:26:06.912154+0000","last_undegraded":"2023-12-13T22:26:06.912154+0000","last_fullsized":"2023-12-13T22:26:06.912154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893269+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:26:06.893269+0000","last_peered":"2023-12-13T22:26:06.893269+0000","last_clean":"2023-12-13T22:26:06.893269+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:26:06.893269+0000","last_undegraded":"2023-12-13T22:26:06.893269+0000","last_fullsized":"2023-12-13T22:26:06.893269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282030+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:26:07.282030+0000","last_peered":"2023-12-13T22:26:07.282030+0000","last_clean":"2023-12-13T22:26:07.282030+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282030+0000","last_undegraded":"2023-12-13T22:26:07.282030+0000","last_fullsized":"2023-12-13T22:26:07.282030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889619+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:26:06.889619+0000","last_peered":"2023-12-13T22:26:06.889619+0000","last_clean":"2023-12-13T22:26:06.889619+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:26:06.889619+0000","last_undegraded":"2023-12-13T22:26:06.889619+0000","last_fullsized":"2023-12-13T22:26:06.889619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994089+0000","last_change":"2023-12-13T22:26:00.401677+0000","last_active":"2023-12-13T22:26:06.994089+0000","last_peered":"2023-12-13T22:26:06.994089+0000","last_clean":"2023-12-13T22:26:06.994089+0000","last_became_active":"2023-12-13T22:26:00.401389+0000","last_became_peered":"2023-12-13T22:26:00.401389+0000","last_unstale":"2023-12-13T22:26:06.994089+0000","last_undegraded":"2023-12-13T22:26:06.994089+0000","last_fullsized":"2023-12-13T22:26:06.994089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889973+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:26:06.889973+0000","last_peered":"2023-12-13T22:26:06.889973+0000","last_clean":"2023-12-13T22:26:06.889973+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:26:06.889973+0000","last_undegraded":"2023-12-13T22:26:06.889973+0000","last_fullsized":"2023-12-13T22:26:06.889973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.993884+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:26:06.993884+0000","last_peered":"2023-12-13T22:26:06.993884+0000","last_clean":"2023-12-13T22:26:06.993884+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:26:06.993884+0000","last_undegraded":"2023-12-13T22:26:06.993884+0000","last_fullsized":"2023-12-13T22:26:06.993884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858013+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:26:06.858013+0000","last_peered":"2023-12-13T22:26:06.858013+0000","last_clean":"2023-12-13T22:26:06.858013+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:26:06.858013+0000","last_undegraded":"2023-12-13T22:26:06.858013+0000","last_fullsized":"2023-12-13T22:26:06.858013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286435+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:26:07.286435+0000","last_peered":"2023-12-13T22:26:07.286435+0000","last_clean":"2023-12-13T22:26:07.286435+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:26:07.286435+0000","last_undegraded":"2023-12-13T22:26:07.286435+0000","last_fullsized":"2023-12-13T22:26:07.286435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893056+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:26:06.893056+0000","last_peered":"2023-12-13T22:26:06.893056+0000","last_clean":"2023-12-13T22:26:06.893056+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:26:06.893056+0000","last_undegraded":"2023-12-13T22:26:06.893056+0000","last_fullsized":"2023-12-13T22:26:06.893056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":9300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476757,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":712460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.01},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.202},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.177}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.754},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.228}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.141}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.075},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93100000000000005}]}]},{"osd":6,"up_from":16,"seq":68719476757,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.161}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.21},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.028}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.1100000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476757,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":121600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.88900000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.137},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0920000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.871},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.008}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.248},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.77100000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.171}]}]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":121636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86799999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.177}]},{"osd":5,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.0229999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.075},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.99099999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.2330000000000001}]}]},{"osd":3,"up_from":16,"seq":68719476757,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0009999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.874},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.25}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.181},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.214},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.3109999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":121670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.30299999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.745}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":121510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86299999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.03},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":0.98199999999999998}]},{"osd":7,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.91600000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":712538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.76400000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1559999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.87},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.032}]},{"osd":6,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.2110000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:26:42.024 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:26:42.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.188+0000 7f6657a46640 1 Processor -- start 2023-12-13T22:26:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.188+0000 7f6657a46640 1 -- start start 2023-12-13T22:26:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6657a46640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f665006d290 0x7f66500c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6657a46640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f66500ce020 0x7f66500ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6657a46640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66500c96b0 con 0x7f6650159fb0 2023-12-13T22:26:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6657a46640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665006d670 con 0x7f665006d290 2023-12-13T22:26:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6657a46640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665015a3d0 con 0x7f66500ce020 2023-12-13T22:26:42.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f66557e2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f665006d290 0x7f66500c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f66557e2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f665006d290 0x7f66500c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57890/0 (socket says 172.21.15.91:57890) 2023-12-13T22:26:42.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f66557e2640 1 -- 172.21.15.91:0/1682016639 learned_addr learned my addr 172.21.15.91:0/1682016639 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:42.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.192+0000 7f6655fe3640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f66500ce020 0x7f66500ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.196+0000 7f66557e2640 1 -- 172.21.15.91:0/1682016639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f66500ce020 msgr2=0x7f66500ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:42.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.196+0000 7f66557e2640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f66500ce020 0x7f66500ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.196+0000 7f66557e2640 1 -- 172.21.15.91:0/1682016639 >> v1:172.21.15.152:6789/0 conn(0x7f6650159fb0 legacy=0x7f66500cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:42.194 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.196+0000 7f66557e2640 1 -- 172.21.15.91:0/1682016639 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500cdb90 con 0x7f665006d290 2023-12-13T22:26:42.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.200+0000 7f66557e2640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66500c8e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6644009870 tx=0x7f664401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6ee8874d1064ca server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:42.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6643fff640 1 -- 172.21.15.91:0/1682016639 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440ab600 con 0x7f665006d290 2023-12-13T22:26:42.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6643fff640 1 -- 172.21.15.91:0/1682016639 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440a7050 con 0x7f665006d290 2023-12-13T22:26:42.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6643fff640 1 -- 172.21.15.91:0/1682016639 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440ab980 con 0x7f665006d290 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 -- 172.21.15.91:0/1682016639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 msgr2=0x7f66500c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66500c8e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6644009870 tx=0x7f664401c500 comp rx=0 tx=0).stop 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 -- 172.21.15.91:0/1682016639 shutdown_connections 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f66500ce020 0x7f66500ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 --2- 172.21.15.91:0/1682016639 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66500c8e00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 -- 172.21.15.91:0/1682016639 >> 172.21.15.91:0/1682016639 conn(0x7f66500ced30 msgr2=0x7f66500cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 -- 172.21.15.91:0/1682016639 shutdown_connections 2023-12-13T22:26:42.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.204+0000 7f6657a46640 1 -- 172.21.15.91:0/1682016639 wait complete. 2023-12-13T22:26:42.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 Processor -- start 2023-12-13T22:26:42.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 -- start start 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66500ce020 0x7f66501ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6650159fb0 0x7f665014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501eb390 con 0x7f665006d290 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501f1c20 con 0x7f66500ce020 2023-12-13T22:26:42.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6657a46640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66501f1ef0 con 0x7f6650159fb0 2023-12-13T22:26:42.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f66557e2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f66557e2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57902/0 (socket says 172.21.15.91:57902) 2023-12-13T22:26:42.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f66557e2640 1 -- 172.21.15.91:0/2490575600 learned_addr learned my addr 172.21.15.91:0/2490575600 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:42.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6654fe1640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66500ce020 0x7f66501ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.207 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.208+0000 7f6655fe3640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6650159fb0 0x7f665014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.212+0000 7f66557e2640 1 -- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6650159fb0 msgr2=0x7f665014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.212+0000 7f66557e2640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6650159fb0 0x7f665014ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.212+0000 7f66557e2640 1 -- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66500ce020 msgr2=0x7f66501ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.212+0000 7f66557e2640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66500ce020 0x7f66501ebd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.212+0000 7f66557e2640 1 -- 172.21.15.91:0/2490575600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66440094d0 con 0x7f665006d290 2023-12-13T22:26:42.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.216+0000 7f66557e2640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66440ae040 tx=0x7f664401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:42.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440b6420 con 0x7f665006d290 2023-12-13T22:26:42.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440b6580 con 0x7f665006d290 2023-12-13T22:26:42.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66501f21d0 con 0x7f665006d290 2023-12-13T22:26:42.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440b6910 con 0x7f665006d290 2023-12-13T22:26:42.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66501f2790 con 0x7f665006d290 2023-12-13T22:26:42.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.220+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500cd280 con 0x7f665006d290 2023-12-13T22:26:42.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.240+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f66440b2040 con 0x7f665006d290 2023-12-13T22:26:42.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.244+0000 7f6641ffb640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 0x7f6634068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.244+0000 7f6654fe1640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 0x7f6634068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.244+0000 7f6654fe1640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 0x7f6634068d00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6650157eb0 tx=0x7f664c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:42.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.248+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66440efc60 con 0x7f665006d290 2023-12-13T22:26:42.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.532+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f66440ebfa0 con 0x7f665006d290 2023-12-13T22:26:42.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.708+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66500cd820 con 0x7f6634066840 2023-12-13T22:26:42.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.736+0000 7f6641ffb640 1 -- 172.21.15.91:0/2490575600 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367759 (secure 0 0 0) 0x7f664c001490 con 0x7f6634066840 2023-12-13T22:26:42.736 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:42.739 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 msgr2=0x7f6634068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 0x7f6634068d00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6650157eb0 tx=0x7f664c009040 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 msgr2=0x7f66501eb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66440ae040 tx=0x7f664401ad40 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 shutdown_connections 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6634066840 0x7f6634068d00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6650159fb0 0x7f665014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66500ce020 0x7f66501ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 --2- 172.21.15.91:0/2490575600 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f665006d290 0x7f66501eb820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 >> 172.21.15.91:0/2490575600 conn(0x7f66500ced30 msgr2=0x7f665006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:42.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 shutdown_connections 2023-12-13T22:26:42.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.740+0000 7f6657a46640 1 -- 172.21.15.91:0/2490575600 wait complete. 2023-12-13T22:26:42.758 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-12-13T22:26:42.576677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595791,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":232,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219736,"kb_used_data":3596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754984,"statfs":{"total":773094113280,"available":772869103616,"internally_reserved":0,"allocated":3682304,"data_stored":2162116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003956"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858970+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:26:06.858970+0000","last_peered":"2023-12-13T22:26:06.858970+0000","last_clean":"2023-12-13T22:26:06.858970+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:26:06.858970+0000","last_undegraded":"2023-12-13T22:26:06.858970+0000","last_fullsized":"2023-12-13T22:26:06.858970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282945+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:26:07.282945+0000","last_peered":"2023-12-13T22:26:07.282945+0000","last_clean":"2023-12-13T22:26:07.282945+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:26:07.282945+0000","last_undegraded":"2023-12-13T22:26:07.282945+0000","last_fullsized":"2023-12-13T22:26:07.282945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283063+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:26:07.283063+0000","last_peered":"2023-12-13T22:26:07.283063+0000","last_clean":"2023-12-13T22:26:07.283063+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:26:07.283063+0000","last_undegraded":"2023-12-13T22:26:07.283063+0000","last_fullsized":"2023-12-13T22:26:07.283063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858067+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:26:06.858067+0000","last_peered":"2023-12-13T22:26:06.858067+0000","last_clean":"2023-12-13T22:26:06.858067+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:26:06.858067+0000","last_undegraded":"2023-12-13T22:26:06.858067+0000","last_fullsized":"2023-12-13T22:26:06.858067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017099+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:26:08.017099+0000","last_peered":"2023-12-13T22:26:08.017099+0000","last_clean":"2023-12-13T22:26:08.017099+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:26:08.017099+0000","last_undegraded":"2023-12-13T22:26:08.017099+0000","last_fullsized":"2023-12-13T22:26:08.017099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891225+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:26:06.891225+0000","last_peered":"2023-12-13T22:26:06.891225+0000","last_clean":"2023-12-13T22:26:06.891225+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:26:06.891225+0000","last_undegraded":"2023-12-13T22:26:06.891225+0000","last_fullsized":"2023-12-13T22:26:06.891225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994069+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:26:06.994069+0000","last_peered":"2023-12-13T22:26:06.994069+0000","last_clean":"2023-12-13T22:26:06.994069+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:26:06.994069+0000","last_undegraded":"2023-12-13T22:26:06.994069+0000","last_fullsized":"2023-12-13T22:26:06.994069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017831+0000","last_change":"2023-12-13T22:26:05.940088+0000","last_active":"2023-12-13T22:26:08.017831+0000","last_peered":"2023-12-13T22:26:08.017831+0000","last_clean":"2023-12-13T22:26:08.017831+0000","last_became_active":"2023-12-13T22:26:05.939662+0000","last_became_peered":"2023-12-13T22:26:05.939662+0000","last_unstale":"2023-12-13T22:26:08.017831+0000","last_undegraded":"2023-12-13T22:26:08.017831+0000","last_fullsized":"2023-12-13T22:26:08.017831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:15.268425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890675+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:26:06.890675+0000","last_peered":"2023-12-13T22:26:06.890675+0000","last_clean":"2023-12-13T22:26:06.890675+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:26:06.890675+0000","last_undegraded":"2023-12-13T22:26:06.890675+0000","last_fullsized":"2023-12-13T22:26:06.890675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994756+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:26:06.994756+0000","last_peered":"2023-12-13T22:26:06.994756+0000","last_clean":"2023-12-13T22:26:06.994756+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:26:06.994756+0000","last_undegraded":"2023-12-13T22:26:06.994756+0000","last_fullsized":"2023-12-13T22:26:06.994756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017505+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:26:08.017505+0000","last_peered":"2023-12-13T22:26:08.017505+0000","last_clean":"2023-12-13T22:26:08.017505+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:26:08.017505+0000","last_undegraded":"2023-12-13T22:26:08.017505+0000","last_fullsized":"2023-12-13T22:26:08.017505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911212+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:26:06.911212+0000","last_peered":"2023-12-13T22:26:06.911212+0000","last_clean":"2023-12-13T22:26:06.911212+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:26:06.911212+0000","last_undegraded":"2023-12-13T22:26:06.911212+0000","last_fullsized":"2023-12-13T22:26:06.911212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890954+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:26:06.890954+0000","last_peered":"2023-12-13T22:26:06.890954+0000","last_clean":"2023-12-13T22:26:06.890954+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:26:06.890954+0000","last_undegraded":"2023-12-13T22:26:06.890954+0000","last_fullsized":"2023-12-13T22:26:06.890954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018802+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:26:08.018802+0000","last_peered":"2023-12-13T22:26:08.018802+0000","last_clean":"2023-12-13T22:26:08.018802+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:26:08.018802+0000","last_undegraded":"2023-12-13T22:26:08.018802+0000","last_fullsized":"2023-12-13T22:26:08.018802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282430+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:26:07.282430+0000","last_peered":"2023-12-13T22:26:07.282430+0000","last_clean":"2023-12-13T22:26:07.282430+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:26:07.282430+0000","last_undegraded":"2023-12-13T22:26:07.282430+0000","last_fullsized":"2023-12-13T22:26:07.282430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286594+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:26:07.286594+0000","last_peered":"2023-12-13T22:26:07.286594+0000","last_clean":"2023-12-13T22:26:07.286594+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:26:07.286594+0000","last_undegraded":"2023-12-13T22:26:07.286594+0000","last_fullsized":"2023-12-13T22:26:07.286594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019042+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:26:08.019042+0000","last_peered":"2023-12-13T22:26:08.019042+0000","last_clean":"2023-12-13T22:26:08.019042+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:26:08.019042+0000","last_undegraded":"2023-12-13T22:26:08.019042+0000","last_fullsized":"2023-12-13T22:26:08.019042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282270+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:26:07.282270+0000","last_peered":"2023-12-13T22:26:07.282270+0000","last_clean":"2023-12-13T22:26:07.282270+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:26:07.282270+0000","last_undegraded":"2023-12-13T22:26:07.282270+0000","last_fullsized":"2023-12-13T22:26:07.282270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285922+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:26:07.285922+0000","last_peered":"2023-12-13T22:26:07.285922+0000","last_clean":"2023-12-13T22:26:07.285922+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:26:07.285922+0000","last_undegraded":"2023-12-13T22:26:07.285922+0000","last_fullsized":"2023-12-13T22:26:07.285922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062830+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:26:09.062830+0000","last_peered":"2023-12-13T22:26:09.062830+0000","last_clean":"2023-12-13T22:26:09.062830+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:26:09.062830+0000","last_undegraded":"2023-12-13T22:26:09.062830+0000","last_fullsized":"2023-12-13T22:26:09.062830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291842+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:26:07.291842+0000","last_peered":"2023-12-13T22:26:07.291842+0000","last_clean":"2023-12-13T22:26:07.291842+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:26:07.291842+0000","last_undegraded":"2023-12-13T22:26:07.291842+0000","last_fullsized":"2023-12-13T22:26:07.291842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889239+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:26:06.889239+0000","last_peered":"2023-12-13T22:26:06.889239+0000","last_clean":"2023-12-13T22:26:06.889239+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:26:06.889239+0000","last_undegraded":"2023-12-13T22:26:06.889239+0000","last_fullsized":"2023-12-13T22:26:06.889239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018910+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:26:08.018910+0000","last_peered":"2023-12-13T22:26:08.018910+0000","last_clean":"2023-12-13T22:26:08.018910+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:26:08.018910+0000","last_undegraded":"2023-12-13T22:26:08.018910+0000","last_fullsized":"2023-12-13T22:26:08.018910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858749+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:26:06.858749+0000","last_peered":"2023-12-13T22:26:06.858749+0000","last_clean":"2023-12-13T22:26:06.858749+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:26:06.858749+0000","last_undegraded":"2023-12-13T22:26:06.858749+0000","last_fullsized":"2023-12-13T22:26:06.858749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912410+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:26:06.912410+0000","last_peered":"2023-12-13T22:26:06.912410+0000","last_clean":"2023-12-13T22:26:06.912410+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:26:06.912410+0000","last_undegraded":"2023-12-13T22:26:06.912410+0000","last_fullsized":"2023-12-13T22:26:06.912410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017812+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:26:08.017812+0000","last_peered":"2023-12-13T22:26:08.017812+0000","last_clean":"2023-12-13T22:26:08.017812+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:26:08.017812+0000","last_undegraded":"2023-12-13T22:26:08.017812+0000","last_fullsized":"2023-12-13T22:26:08.017812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283278+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:26:07.283278+0000","last_peered":"2023-12-13T22:26:07.283278+0000","last_clean":"2023-12-13T22:26:07.283278+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:26:07.283278+0000","last_undegraded":"2023-12-13T22:26:07.283278+0000","last_fullsized":"2023-12-13T22:26:07.283278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:21.331008+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:26:21.331008+0000","last_peered":"2023-12-13T22:26:21.331008+0000","last_clean":"2023-12-13T22:26:21.331008+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:26:21.331008+0000","last_undegraded":"2023-12-13T22:26:21.331008+0000","last_fullsized":"2023-12-13T22:26:21.331008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063386+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:26:09.063386+0000","last_peered":"2023-12-13T22:26:09.063386+0000","last_clean":"2023-12-13T22:26:09.063386+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:26:09.063386+0000","last_undegraded":"2023-12-13T22:26:09.063386+0000","last_fullsized":"2023-12-13T22:26:09.063386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286245+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:26:07.286245+0000","last_peered":"2023-12-13T22:26:07.286245+0000","last_clean":"2023-12-13T22:26:07.286245+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:26:07.286245+0000","last_undegraded":"2023-12-13T22:26:07.286245+0000","last_fullsized":"2023-12-13T22:26:07.286245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891472+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:26:06.891472+0000","last_peered":"2023-12-13T22:26:06.891472+0000","last_clean":"2023-12-13T22:26:06.891472+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:26:06.891472+0000","last_undegraded":"2023-12-13T22:26:06.891472+0000","last_fullsized":"2023-12-13T22:26:06.891472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.983999+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:26:07.983999+0000","last_peered":"2023-12-13T22:26:07.983999+0000","last_clean":"2023-12-13T22:26:07.983999+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:26:07.983999+0000","last_undegraded":"2023-12-13T22:26:07.983999+0000","last_fullsized":"2023-12-13T22:26:07.983999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994774+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:26:06.994774+0000","last_peered":"2023-12-13T22:26:06.994774+0000","last_clean":"2023-12-13T22:26:06.994774+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:26:06.994774+0000","last_undegraded":"2023-12-13T22:26:06.994774+0000","last_fullsized":"2023-12-13T22:26:06.994774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286309+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:26:07.286309+0000","last_peered":"2023-12-13T22:26:07.286309+0000","last_clean":"2023-12-13T22:26:07.286309+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:26:07.286309+0000","last_undegraded":"2023-12-13T22:26:07.286309+0000","last_fullsized":"2023-12-13T22:26:07.286309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061487+0000","last_change":"2023-12-13T22:26:05.944559+0000","last_active":"2023-12-13T22:26:09.061487+0000","last_peered":"2023-12-13T22:26:09.061487+0000","last_clean":"2023-12-13T22:26:09.061487+0000","last_became_active":"2023-12-13T22:26:05.943841+0000","last_became_peered":"2023-12-13T22:26:05.943841+0000","last_unstale":"2023-12-13T22:26:09.061487+0000","last_undegraded":"2023-12-13T22:26:09.061487+0000","last_fullsized":"2023-12-13T22:26:09.061487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291954+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:26:07.291954+0000","last_peered":"2023-12-13T22:26:07.291954+0000","last_clean":"2023-12-13T22:26:07.291954+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:26:07.291954+0000","last_undegraded":"2023-12-13T22:26:07.291954+0000","last_fullsized":"2023-12-13T22:26:07.291954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994286+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:26:06.994286+0000","last_peered":"2023-12-13T22:26:06.994286+0000","last_clean":"2023-12-13T22:26:06.994286+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:26:06.994286+0000","last_undegraded":"2023-12-13T22:26:06.994286+0000","last_fullsized":"2023-12-13T22:26:06.994286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062075+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:26:09.062075+0000","last_peered":"2023-12-13T22:26:09.062075+0000","last_clean":"2023-12-13T22:26:09.062075+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:26:09.062075+0000","last_undegraded":"2023-12-13T22:26:09.062075+0000","last_fullsized":"2023-12-13T22:26:09.062075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285856+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:26:07.285856+0000","last_peered":"2023-12-13T22:26:07.285856+0000","last_clean":"2023-12-13T22:26:07.285856+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:26:07.285856+0000","last_undegraded":"2023-12-13T22:26:07.285856+0000","last_fullsized":"2023-12-13T22:26:07.285856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775593+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:26:41.775593+0000","last_peered":"2023-12-13T22:26:41.775593+0000","last_clean":"2023-12-13T22:26:41.775593+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:26:41.775593+0000","last_undegraded":"2023-12-13T22:26:41.775593+0000","last_fullsized":"2023-12-13T22:26:41.775593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063001+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:26:09.063001+0000","last_peered":"2023-12-13T22:26:09.063001+0000","last_clean":"2023-12-13T22:26:09.063001+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:26:09.063001+0000","last_undegraded":"2023-12-13T22:26:09.063001+0000","last_fullsized":"2023-12-13T22:26:09.063001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857511+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:26:06.857511+0000","last_peered":"2023-12-13T22:26:06.857511+0000","last_clean":"2023-12-13T22:26:06.857511+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:26:06.857511+0000","last_undegraded":"2023-12-13T22:26:06.857511+0000","last_fullsized":"2023-12-13T22:26:06.857511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889254+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:26:06.889254+0000","last_peered":"2023-12-13T22:26:06.889254+0000","last_clean":"2023-12-13T22:26:06.889254+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:26:06.889254+0000","last_undegraded":"2023-12-13T22:26:06.889254+0000","last_fullsized":"2023-12-13T22:26:06.889254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984268+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:26:07.984268+0000","last_peered":"2023-12-13T22:26:07.984268+0000","last_clean":"2023-12-13T22:26:07.984268+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:26:07.984268+0000","last_undegraded":"2023-12-13T22:26:07.984268+0000","last_fullsized":"2023-12-13T22:26:07.984268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282052+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:26:07.282052+0000","last_peered":"2023-12-13T22:26:07.282052+0000","last_clean":"2023-12-13T22:26:07.282052+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:26:07.282052+0000","last_undegraded":"2023-12-13T22:26:07.282052+0000","last_fullsized":"2023-12-13T22:26:07.282052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994125+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:26:06.994125+0000","last_peered":"2023-12-13T22:26:06.994125+0000","last_clean":"2023-12-13T22:26:06.994125+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:26:06.994125+0000","last_undegraded":"2023-12-13T22:26:06.994125+0000","last_fullsized":"2023-12-13T22:26:06.994125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889497+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:26:06.889497+0000","last_peered":"2023-12-13T22:26:06.889497+0000","last_clean":"2023-12-13T22:26:06.889497+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:26:06.889497+0000","last_undegraded":"2023-12-13T22:26:06.889497+0000","last_fullsized":"2023-12-13T22:26:06.889497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924748+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:26:07.924748+0000","last_peered":"2023-12-13T22:26:07.924748+0000","last_clean":"2023-12-13T22:26:07.924748+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:26:07.924748+0000","last_undegraded":"2023-12-13T22:26:07.924748+0000","last_fullsized":"2023-12-13T22:26:07.924748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890978+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:26:06.890978+0000","last_peered":"2023-12-13T22:26:06.890978+0000","last_clean":"2023-12-13T22:26:06.890978+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:26:06.890978+0000","last_undegraded":"2023-12-13T22:26:06.890978+0000","last_fullsized":"2023-12-13T22:26:06.890978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775114+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:26:41.775114+0000","last_peered":"2023-12-13T22:26:41.775114+0000","last_clean":"2023-12-13T22:26:41.775114+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:26:41.775114+0000","last_undegraded":"2023-12-13T22:26:41.775114+0000","last_fullsized":"2023-12-13T22:26:41.775114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924406+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:26:07.924406+0000","last_peered":"2023-12-13T22:26:07.924406+0000","last_clean":"2023-12-13T22:26:07.924406+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:26:07.924406+0000","last_undegraded":"2023-12-13T22:26:07.924406+0000","last_fullsized":"2023-12-13T22:26:07.924406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994199+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:26:06.994199+0000","last_peered":"2023-12-13T22:26:06.994199+0000","last_clean":"2023-12-13T22:26:06.994199+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:26:06.994199+0000","last_undegraded":"2023-12-13T22:26:06.994199+0000","last_fullsized":"2023-12-13T22:26:06.994199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286596+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:26:07.286596+0000","last_peered":"2023-12-13T22:26:07.286596+0000","last_clean":"2023-12-13T22:26:07.286596+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:26:07.286596+0000","last_undegraded":"2023-12-13T22:26:07.286596+0000","last_fullsized":"2023-12-13T22:26:07.286596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984240+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:26:07.984240+0000","last_peered":"2023-12-13T22:26:07.984240+0000","last_clean":"2023-12-13T22:26:07.984240+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:26:07.984240+0000","last_undegraded":"2023-12-13T22:26:07.984240+0000","last_fullsized":"2023-12-13T22:26:07.984240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893338+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:26:06.893338+0000","last_peered":"2023-12-13T22:26:06.893338+0000","last_clean":"2023-12-13T22:26:06.893338+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:26:06.893338+0000","last_undegraded":"2023-12-13T22:26:06.893338+0000","last_fullsized":"2023-12-13T22:26:06.893338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827411+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:26:07.827411+0000","last_peered":"2023-12-13T22:26:07.827411+0000","last_clean":"2023-12-13T22:26:07.827411+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:26:07.827411+0000","last_undegraded":"2023-12-13T22:26:07.827411+0000","last_fullsized":"2023-12-13T22:26:07.827411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.060442+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:26:09.060442+0000","last_peered":"2023-12-13T22:26:09.060442+0000","last_clean":"2023-12-13T22:26:09.060442+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:26:09.060442+0000","last_undegraded":"2023-12-13T22:26:09.060442+0000","last_fullsized":"2023-12-13T22:26:09.060442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891642+0000","last_change":"2023-12-13T22:26:00.418974+0000","last_active":"2023-12-13T22:26:06.891642+0000","last_peered":"2023-12-13T22:26:06.891642+0000","last_clean":"2023-12-13T22:26:06.891642+0000","last_became_active":"2023-12-13T22:26:00.418573+0000","last_became_peered":"2023-12-13T22:26:00.418573+0000","last_unstale":"2023-12-13T22:26:06.891642+0000","last_undegraded":"2023-12-13T22:26:06.891642+0000","last_fullsized":"2023-12-13T22:26:06.891642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292790+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:26:07.292790+0000","last_peered":"2023-12-13T22:26:07.292790+0000","last_clean":"2023-12-13T22:26:07.292790+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:26:07.292790+0000","last_undegraded":"2023-12-13T22:26:07.292790+0000","last_fullsized":"2023-12-13T22:26:07.292790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017051+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:26:08.017051+0000","last_peered":"2023-12-13T22:26:08.017051+0000","last_clean":"2023-12-13T22:26:08.017051+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:26:08.017051+0000","last_undegraded":"2023-12-13T22:26:08.017051+0000","last_fullsized":"2023-12-13T22:26:08.017051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889629+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:26:06.889629+0000","last_peered":"2023-12-13T22:26:06.889629+0000","last_clean":"2023-12-13T22:26:06.889629+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:26:06.889629+0000","last_undegraded":"2023-12-13T22:26:06.889629+0000","last_fullsized":"2023-12-13T22:26:06.889629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775907+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:26:41.775907+0000","last_peered":"2023-12-13T22:26:41.775907+0000","last_clean":"2023-12-13T22:26:41.775907+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:26:41.775907+0000","last_undegraded":"2023-12-13T22:26:41.775907+0000","last_fullsized":"2023-12-13T22:26:41.775907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984199+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:26:07.984199+0000","last_peered":"2023-12-13T22:26:07.984199+0000","last_clean":"2023-12-13T22:26:07.984199+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:26:07.984199+0000","last_undegraded":"2023-12-13T22:26:07.984199+0000","last_fullsized":"2023-12-13T22:26:07.984199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909876+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:26:06.909876+0000","last_peered":"2023-12-13T22:26:06.909876+0000","last_clean":"2023-12-13T22:26:06.909876+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:26:06.909876+0000","last_undegraded":"2023-12-13T22:26:06.909876+0000","last_fullsized":"2023-12-13T22:26:06.909876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910183+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:26:06.910183+0000","last_peered":"2023-12-13T22:26:06.910183+0000","last_clean":"2023-12-13T22:26:06.910183+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:26:06.910183+0000","last_undegraded":"2023-12-13T22:26:06.910183+0000","last_fullsized":"2023-12-13T22:26:06.910183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064384+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:26:09.064384+0000","last_peered":"2023-12-13T22:26:09.064384+0000","last_clean":"2023-12-13T22:26:09.064384+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:26:09.064384+0000","last_undegraded":"2023-12-13T22:26:09.064384+0000","last_fullsized":"2023-12-13T22:26:09.064384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890397+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:26:06.890397+0000","last_peered":"2023-12-13T22:26:06.890397+0000","last_clean":"2023-12-13T22:26:06.890397+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:26:06.890397+0000","last_undegraded":"2023-12-13T22:26:06.890397+0000","last_fullsized":"2023-12-13T22:26:06.890397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994235+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:26:06.994235+0000","last_peered":"2023-12-13T22:26:06.994235+0000","last_clean":"2023-12-13T22:26:06.994235+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:26:06.994235+0000","last_undegraded":"2023-12-13T22:26:06.994235+0000","last_fullsized":"2023-12-13T22:26:06.994235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064123+0000","last_change":"2023-12-13T22:26:06.547843+0000","last_active":"2023-12-13T22:26:09.064123+0000","last_peered":"2023-12-13T22:26:09.064123+0000","last_clean":"2023-12-13T22:26:09.064123+0000","last_became_active":"2023-12-13T22:26:06.546738+0000","last_became_peered":"2023-12-13T22:26:06.546738+0000","last_unstale":"2023-12-13T22:26:09.064123+0000","last_undegraded":"2023-12-13T22:26:09.064123+0000","last_fullsized":"2023-12-13T22:26:09.064123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:02:37.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858138+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:26:06.858138+0000","last_peered":"2023-12-13T22:26:06.858138+0000","last_clean":"2023-12-13T22:26:06.858138+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:26:06.858138+0000","last_undegraded":"2023-12-13T22:26:06.858138+0000","last_fullsized":"2023-12-13T22:26:06.858138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.691734+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:26:38.691734+0000","last_peered":"2023-12-13T22:26:38.691734+0000","last_clean":"2023-12-13T22:26:38.691734+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:26:38.691734+0000","last_undegraded":"2023-12-13T22:26:38.691734+0000","last_fullsized":"2023-12-13T22:26:38.691734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061946+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:26:09.061946+0000","last_peered":"2023-12-13T22:26:09.061946+0000","last_clean":"2023-12-13T22:26:09.061946+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:26:09.061946+0000","last_undegraded":"2023-12-13T22:26:09.061946+0000","last_fullsized":"2023-12-13T22:26:09.061946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890732+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:26:06.890732+0000","last_peered":"2023-12-13T22:26:06.890732+0000","last_clean":"2023-12-13T22:26:06.890732+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:26:06.890732+0000","last_undegraded":"2023-12-13T22:26:06.890732+0000","last_fullsized":"2023-12-13T22:26:06.890732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'11","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:16.680554+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:26:16.680554+0000","last_peered":"2023-12-13T22:26:16.680554+0000","last_clean":"2023-12-13T22:26:16.680554+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:26:16.680554+0000","last_undegraded":"2023-12-13T22:26:16.680554+0000","last_fullsized":"2023-12-13T22:26:16.680554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061708+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:26:09.061708+0000","last_peered":"2023-12-13T22:26:09.061708+0000","last_clean":"2023-12-13T22:26:09.061708+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:26:09.061708+0000","last_undegraded":"2023-12-13T22:26:09.061708+0000","last_fullsized":"2023-12-13T22:26:09.061708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292771+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:26:07.292771+0000","last_peered":"2023-12-13T22:26:07.292771+0000","last_clean":"2023-12-13T22:26:07.292771+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:26:07.292771+0000","last_undegraded":"2023-12-13T22:26:07.292771+0000","last_fullsized":"2023-12-13T22:26:07.292771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286461+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:26:07.286461+0000","last_peered":"2023-12-13T22:26:07.286461+0000","last_clean":"2023-12-13T22:26:07.286461+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:26:07.286461+0000","last_undegraded":"2023-12-13T22:26:07.286461+0000","last_fullsized":"2023-12-13T22:26:07.286461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018583+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:26:08.018583+0000","last_peered":"2023-12-13T22:26:08.018583+0000","last_clean":"2023-12-13T22:26:08.018583+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:26:08.018583+0000","last_undegraded":"2023-12-13T22:26:08.018583+0000","last_fullsized":"2023-12-13T22:26:08.018583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858759+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:26:06.858759+0000","last_peered":"2023-12-13T22:26:06.858759+0000","last_clean":"2023-12-13T22:26:06.858759+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:26:06.858759+0000","last_undegraded":"2023-12-13T22:26:06.858759+0000","last_fullsized":"2023-12-13T22:26:06.858759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994934+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:26:06.994934+0000","last_peered":"2023-12-13T22:26:06.994934+0000","last_clean":"2023-12-13T22:26:06.994934+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:26:06.994934+0000","last_undegraded":"2023-12-13T22:26:06.994934+0000","last_fullsized":"2023-12-13T22:26:06.994934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063423+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:26:09.063423+0000","last_peered":"2023-12-13T22:26:09.063423+0000","last_clean":"2023-12-13T22:26:09.063423+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:26:09.063423+0000","last_undegraded":"2023-12-13T22:26:09.063423+0000","last_fullsized":"2023-12-13T22:26:09.063423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994895+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:26:06.994895+0000","last_peered":"2023-12-13T22:26:06.994895+0000","last_clean":"2023-12-13T22:26:06.994895+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:26:06.994895+0000","last_undegraded":"2023-12-13T22:26:06.994895+0000","last_fullsized":"2023-12-13T22:26:06.994895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912203+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:26:06.912203+0000","last_peered":"2023-12-13T22:26:06.912203+0000","last_clean":"2023-12-13T22:26:06.912203+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:26:06.912203+0000","last_undegraded":"2023-12-13T22:26:06.912203+0000","last_fullsized":"2023-12-13T22:26:06.912203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984083+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:26:07.984083+0000","last_peered":"2023-12-13T22:26:07.984083+0000","last_clean":"2023-12-13T22:26:07.984083+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:26:07.984083+0000","last_undegraded":"2023-12-13T22:26:07.984083+0000","last_fullsized":"2023-12-13T22:26:07.984083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285814+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:26:07.285814+0000","last_peered":"2023-12-13T22:26:07.285814+0000","last_clean":"2023-12-13T22:26:07.285814+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:26:07.285814+0000","last_undegraded":"2023-12-13T22:26:07.285814+0000","last_fullsized":"2023-12-13T22:26:07.285814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994410+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:26:06.994410+0000","last_peered":"2023-12-13T22:26:06.994410+0000","last_clean":"2023-12-13T22:26:06.994410+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:26:06.994410+0000","last_undegraded":"2023-12-13T22:26:06.994410+0000","last_fullsized":"2023-12-13T22:26:06.994410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.925274+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:26:07.925274+0000","last_peered":"2023-12-13T22:26:07.925274+0000","last_clean":"2023-12-13T22:26:07.925274+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:26:07.925274+0000","last_undegraded":"2023-12-13T22:26:07.925274+0000","last_fullsized":"2023-12-13T22:26:07.925274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282151+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:26:07.282151+0000","last_peered":"2023-12-13T22:26:07.282151+0000","last_clean":"2023-12-13T22:26:07.282151+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:26:07.282151+0000","last_undegraded":"2023-12-13T22:26:07.282151+0000","last_fullsized":"2023-12-13T22:26:07.282151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282440+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:26:07.282440+0000","last_peered":"2023-12-13T22:26:07.282440+0000","last_clean":"2023-12-13T22:26:07.282440+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:26:07.282440+0000","last_undegraded":"2023-12-13T22:26:07.282440+0000","last_fullsized":"2023-12-13T22:26:07.282440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911470+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:26:06.911470+0000","last_peered":"2023-12-13T22:26:06.911470+0000","last_clean":"2023-12-13T22:26:06.911470+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:26:06.911470+0000","last_undegraded":"2023-12-13T22:26:06.911470+0000","last_fullsized":"2023-12-13T22:26:06.911470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858860+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:26:06.858860+0000","last_peered":"2023-12-13T22:26:06.858860+0000","last_clean":"2023-12-13T22:26:06.858860+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:26:06.858860+0000","last_undegraded":"2023-12-13T22:26:06.858860+0000","last_fullsized":"2023-12-13T22:26:06.858860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.815590+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:26:08.815590+0000","last_peered":"2023-12-13T22:26:08.815590+0000","last_clean":"2023-12-13T22:26:08.815590+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:26:08.815590+0000","last_undegraded":"2023-12-13T22:26:08.815590+0000","last_fullsized":"2023-12-13T22:26:08.815590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282467+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:26:07.282467+0000","last_peered":"2023-12-13T22:26:07.282467+0000","last_clean":"2023-12-13T22:26:07.282467+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:26:07.282467+0000","last_undegraded":"2023-12-13T22:26:07.282467+0000","last_fullsized":"2023-12-13T22:26:07.282467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291838+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:26:07.291838+0000","last_peered":"2023-12-13T22:26:07.291838+0000","last_clean":"2023-12-13T22:26:07.291838+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:26:07.291838+0000","last_undegraded":"2023-12-13T22:26:07.291838+0000","last_fullsized":"2023-12-13T22:26:07.291838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064331+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:26:09.064331+0000","last_peered":"2023-12-13T22:26:09.064331+0000","last_clean":"2023-12-13T22:26:09.064331+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:26:09.064331+0000","last_undegraded":"2023-12-13T22:26:09.064331+0000","last_fullsized":"2023-12-13T22:26:09.064331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909726+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:26:06.909726+0000","last_peered":"2023-12-13T22:26:06.909726+0000","last_clean":"2023-12-13T22:26:06.909726+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:26:06.909726+0000","last_undegraded":"2023-12-13T22:26:06.909726+0000","last_fullsized":"2023-12-13T22:26:06.909726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.826916+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:26:07.826916+0000","last_peered":"2023-12-13T22:26:07.826916+0000","last_clean":"2023-12-13T22:26:07.826916+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:26:07.826916+0000","last_undegraded":"2023-12-13T22:26:07.826916+0000","last_fullsized":"2023-12-13T22:26:07.826916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994203+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:26:06.994203+0000","last_peered":"2023-12-13T22:26:06.994203+0000","last_clean":"2023-12-13T22:26:06.994203+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:26:06.994203+0000","last_undegraded":"2023-12-13T22:26:06.994203+0000","last_fullsized":"2023-12-13T22:26:06.994203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858620+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:26:06.858620+0000","last_peered":"2023-12-13T22:26:06.858620+0000","last_clean":"2023-12-13T22:26:06.858620+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:26:06.858620+0000","last_undegraded":"2023-12-13T22:26:06.858620+0000","last_fullsized":"2023-12-13T22:26:06.858620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282688+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:26:07.282688+0000","last_peered":"2023-12-13T22:26:07.282688+0000","last_clean":"2023-12-13T22:26:07.282688+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:26:07.282688+0000","last_undegraded":"2023-12-13T22:26:07.282688+0000","last_fullsized":"2023-12-13T22:26:07.282688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286261+0000","last_change":"2023-12-13T22:26:00.413885+0000","last_active":"2023-12-13T22:26:07.286261+0000","last_peered":"2023-12-13T22:26:07.286261+0000","last_clean":"2023-12-13T22:26:07.286261+0000","last_became_active":"2023-12-13T22:26:00.413588+0000","last_became_peered":"2023-12-13T22:26:00.413588+0000","last_unstale":"2023-12-13T22:26:07.286261+0000","last_undegraded":"2023-12-13T22:26:07.286261+0000","last_fullsized":"2023-12-13T22:26:07.286261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912253+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:26:06.912253+0000","last_peered":"2023-12-13T22:26:06.912253+0000","last_clean":"2023-12-13T22:26:06.912253+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:26:06.912253+0000","last_undegraded":"2023-12-13T22:26:06.912253+0000","last_fullsized":"2023-12-13T22:26:06.912253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283197+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:26:07.283197+0000","last_peered":"2023-12-13T22:26:07.283197+0000","last_clean":"2023-12-13T22:26:07.283197+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:26:07.283197+0000","last_undegraded":"2023-12-13T22:26:07.283197+0000","last_fullsized":"2023-12-13T22:26:07.283197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994173+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:26:06.994173+0000","last_peered":"2023-12-13T22:26:06.994173+0000","last_clean":"2023-12-13T22:26:06.994173+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:26:06.994173+0000","last_undegraded":"2023-12-13T22:26:06.994173+0000","last_fullsized":"2023-12-13T22:26:06.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282308+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:26:07.282308+0000","last_peered":"2023-12-13T22:26:07.282308+0000","last_clean":"2023-12-13T22:26:07.282308+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282308+0000","last_undegraded":"2023-12-13T22:26:07.282308+0000","last_fullsized":"2023-12-13T22:26:07.282308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994078+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:26:06.994078+0000","last_peered":"2023-12-13T22:26:06.994078+0000","last_clean":"2023-12-13T22:26:06.994078+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:26:06.994078+0000","last_undegraded":"2023-12-13T22:26:06.994078+0000","last_fullsized":"2023-12-13T22:26:06.994078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858162+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:26:06.858162+0000","last_peered":"2023-12-13T22:26:06.858162+0000","last_clean":"2023-12-13T22:26:06.858162+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:26:06.858162+0000","last_undegraded":"2023-12-13T22:26:06.858162+0000","last_fullsized":"2023-12-13T22:26:06.858162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910747+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:26:06.910747+0000","last_peered":"2023-12-13T22:26:06.910747+0000","last_clean":"2023-12-13T22:26:06.910747+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:26:06.910747+0000","last_undegraded":"2023-12-13T22:26:06.910747+0000","last_fullsized":"2023-12-13T22:26:06.910747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891457+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:26:06.891457+0000","last_peered":"2023-12-13T22:26:06.891457+0000","last_clean":"2023-12-13T22:26:06.891457+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:26:06.891457+0000","last_undegraded":"2023-12-13T22:26:06.891457+0000","last_fullsized":"2023-12-13T22:26:06.891457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827315+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:26:07.827315+0000","last_peered":"2023-12-13T22:26:07.827315+0000","last_clean":"2023-12-13T22:26:07.827315+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:26:07.827315+0000","last_undegraded":"2023-12-13T22:26:07.827315+0000","last_fullsized":"2023-12-13T22:26:07.827315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.995002+0000","last_change":"2023-12-13T22:26:00.417280+0000","last_active":"2023-12-13T22:26:06.995002+0000","last_peered":"2023-12-13T22:26:06.995002+0000","last_clean":"2023-12-13T22:26:06.995002+0000","last_became_active":"2023-12-13T22:26:00.410002+0000","last_became_peered":"2023-12-13T22:26:00.410002+0000","last_unstale":"2023-12-13T22:26:06.995002+0000","last_undegraded":"2023-12-13T22:26:06.995002+0000","last_fullsized":"2023-12-13T22:26:06.995002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994368+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:26:06.994368+0000","last_peered":"2023-12-13T22:26:06.994368+0000","last_clean":"2023-12-13T22:26:06.994368+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:26:06.994368+0000","last_undegraded":"2023-12-13T22:26:06.994368+0000","last_fullsized":"2023-12-13T22:26:06.994368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285823+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:26:07.285823+0000","last_peered":"2023-12-13T22:26:07.285823+0000","last_clean":"2023-12-13T22:26:07.285823+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:26:07.285823+0000","last_undegraded":"2023-12-13T22:26:07.285823+0000","last_fullsized":"2023-12-13T22:26:07.285823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857773+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:26:06.857773+0000","last_peered":"2023-12-13T22:26:06.857773+0000","last_clean":"2023-12-13T22:26:06.857773+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:26:06.857773+0000","last_undegraded":"2023-12-13T22:26:06.857773+0000","last_fullsized":"2023-12-13T22:26:06.857773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282281+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:26:07.282281+0000","last_peered":"2023-12-13T22:26:07.282281+0000","last_clean":"2023-12-13T22:26:07.282281+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:26:07.282281+0000","last_undegraded":"2023-12-13T22:26:07.282281+0000","last_fullsized":"2023-12-13T22:26:07.282281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292704+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:26:07.292704+0000","last_peered":"2023-12-13T22:26:07.292704+0000","last_clean":"2023-12-13T22:26:07.292704+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:26:07.292704+0000","last_undegraded":"2023-12-13T22:26:07.292704+0000","last_fullsized":"2023-12-13T22:26:07.292704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911675+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:26:06.911675+0000","last_peered":"2023-12-13T22:26:06.911675+0000","last_clean":"2023-12-13T22:26:06.911675+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:26:06.911675+0000","last_undegraded":"2023-12-13T22:26:06.911675+0000","last_fullsized":"2023-12-13T22:26:06.911675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912154+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:26:06.912154+0000","last_peered":"2023-12-13T22:26:06.912154+0000","last_clean":"2023-12-13T22:26:06.912154+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:26:06.912154+0000","last_undegraded":"2023-12-13T22:26:06.912154+0000","last_fullsized":"2023-12-13T22:26:06.912154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893269+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:26:06.893269+0000","last_peered":"2023-12-13T22:26:06.893269+0000","last_clean":"2023-12-13T22:26:06.893269+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:26:06.893269+0000","last_undegraded":"2023-12-13T22:26:06.893269+0000","last_fullsized":"2023-12-13T22:26:06.893269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282030+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:26:07.282030+0000","last_peered":"2023-12-13T22:26:07.282030+0000","last_clean":"2023-12-13T22:26:07.282030+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282030+0000","last_undegraded":"2023-12-13T22:26:07.282030+0000","last_fullsized":"2023-12-13T22:26:07.282030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889619+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:26:06.889619+0000","last_peered":"2023-12-13T22:26:06.889619+0000","last_clean":"2023-12-13T22:26:06.889619+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:26:06.889619+0000","last_undegraded":"2023-12-13T22:26:06.889619+0000","last_fullsized":"2023-12-13T22:26:06.889619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994089+0000","last_change":"2023-12-13T22:26:00.401677+0000","last_active":"2023-12-13T22:26:06.994089+0000","last_peered":"2023-12-13T22:26:06.994089+0000","last_clean":"2023-12-13T22:26:06.994089+0000","last_became_active":"2023-12-13T22:26:00.401389+0000","last_became_peered":"2023-12-13T22:26:00.401389+0000","last_unstale":"2023-12-13T22:26:06.994089+0000","last_undegraded":"2023-12-13T22:26:06.994089+0000","last_fullsized":"2023-12-13T22:26:06.994089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889973+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:26:06.889973+0000","last_peered":"2023-12-13T22:26:06.889973+0000","last_clean":"2023-12-13T22:26:06.889973+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:26:06.889973+0000","last_undegraded":"2023-12-13T22:26:06.889973+0000","last_fullsized":"2023-12-13T22:26:06.889973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.993884+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:26:06.993884+0000","last_peered":"2023-12-13T22:26:06.993884+0000","last_clean":"2023-12-13T22:26:06.993884+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:26:06.993884+0000","last_undegraded":"2023-12-13T22:26:06.993884+0000","last_fullsized":"2023-12-13T22:26:06.993884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858013+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:26:06.858013+0000","last_peered":"2023-12-13T22:26:06.858013+0000","last_clean":"2023-12-13T22:26:06.858013+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:26:06.858013+0000","last_undegraded":"2023-12-13T22:26:06.858013+0000","last_fullsized":"2023-12-13T22:26:06.858013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286435+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:26:07.286435+0000","last_peered":"2023-12-13T22:26:07.286435+0000","last_clean":"2023-12-13T22:26:07.286435+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:26:07.286435+0000","last_undegraded":"2023-12-13T22:26:07.286435+0000","last_fullsized":"2023-12-13T22:26:07.286435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893056+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:26:06.893056+0000","last_peered":"2023-12-13T22:26:06.893056+0000","last_clean":"2023-12-13T22:26:06.893056+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:26:06.893056+0000","last_undegraded":"2023-12-13T22:26:06.893056+0000","last_fullsized":"2023-12-13T22:26:06.893056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5423,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":10118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476757,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":712460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.01},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.202},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.177}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.754},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.228}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.141}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.075},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.93100000000000005}]}]},{"osd":6,"up_from":16,"seq":68719476757,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.161}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.21},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.028}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.1100000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476757,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":121600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.88900000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.137},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0920000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.871},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.008}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.248},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.77100000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.171}]}]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":121636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86799999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.73799999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.177}]},{"osd":5,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.0229999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.075},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.99099999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.2330000000000001}]}]},{"osd":3,"up_from":16,"seq":68719476757,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0009999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.874},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.25}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.0629999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.181},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.214},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.3109999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476758,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":121670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.30299999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.745}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":121510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.83499999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":1.012},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.871},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0880000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.216}]},{"osd":7,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.123},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.1619999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":712538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.76400000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1559999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.87},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.032}]},{"osd":6,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":1.2110000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.1080000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:26:42.764 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-13T22:26:42.764 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-13T22:26:42.765 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-13T22:26:42.765 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-13T22:26:42.765 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-13T22:26:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 Processor -- start 2023-12-13T22:26:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 -- start start 2023-12-13T22:26:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 0x7f25040ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25040c21d0 con 0x7f2504157280 2023-12-13T22:26:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2504157750 con 0x7f2504151460 2023-12-13T22:26:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250bfaa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250406ec00 con 0x7f25040ccad0 2023-12-13T22:26:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f2509545640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2504157280 0x7f250406f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42178/0 (socket says 172.21.15.91:42178) 2023-12-13T22:26:42.927 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f2509545640 1 -- 172.21.15.91:0/3573553703 learned_addr learned my addr 172.21.15.91:0/3573553703 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:42.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.928+0000 7f250a547640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 0x7f25040ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.932+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611027998 0 0) 0x7f25040c21d0 con 0x7f2504157280 2023-12-13T22:26:42.930 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.932+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f0003530 con 0x7f2504157280 2023-12-13T22:26:42.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1278116620 0 0) 0x7f24f0003530 con 0x7f2504157280 2023-12-13T22:26:42.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 msgr2=0x7f25040ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:42.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 0x7f25040ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 >> v1:172.21.15.152:6789/0 conn(0x7f2504151460 legacy=0x7f25040c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504157a30 con 0x7f2504157280 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f24f8001a00 con 0x7f2504157280 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 >> v1:172.21.15.91:6789/0 conn(0x7f2504157280 legacy=0x7f250406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0003a20 0x7f24f0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 0x7f24f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0004d10 0x7f24f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250406ec00 con 0x7f24f0003a20 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f000bb70 con 0x7f24f0004d10 2023-12-13T22:26:42.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f000bd30 con 0x7f25040ccad0 2023-12-13T22:26:42.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.936+0000 7f2509d46640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0003a20 0x7f24f0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.940+0000 7f250a547640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0004d10 0x7f24f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.944+0000 7f2509d46640 1 -- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 msgr2=0x7f24f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.944+0000 7f2509d46640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25040ccad0 0x7f24f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.944+0000 7f2509d46640 1 -- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0004d10 msgr2=0x7f24f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:42.941 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.944+0000 7f2509d46640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24f0004d10 0x7f24f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.944+0000 7f2509d46640 1 -- 172.21.15.91:0/3573553703 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0003530 con 0x7f24f0003a20 2023-12-13T22:26:42.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.948+0000 7f2509d46640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0003a20 0x7f24f0003e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2500001780 tx=0x7f250001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf73a871890526 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:42.949 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000052d0 con 0x7f24f0003a20 2023-12-13T22:26:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25000a7050 con 0x7f24f0003a20 2023-12-13T22:26:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f2508d44640 1 -- 172.21.15.91:0/3573553703 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500003840 con 0x7f24f0003a20 2023-12-13T22:26:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- 172.21.15.91:0/3573553703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0003a20 msgr2=0x7f24f0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.950 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 --2- 172.21.15.91:0/3573553703 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f24f0003a20 0x7f24f0003e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2500001780 tx=0x7f250001c3d0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250a547640 1 -- 172.21.15.91:0/3573553703 reap_dead start 2023-12-13T22:26:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- 172.21.15.91:0/3573553703 shutdown_connections 2023-12-13T22:26:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- 172.21.15.91:0/3573553703 >> 172.21.15.91:0/3573553703 conn(0x7f25040708a0 msgr2=0x7f2504070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- 172.21.15.91:0/3573553703 shutdown_connections 2023-12-13T22:26:42.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- 172.21.15.91:0/3573553703 wait complete. 2023-12-13T22:26:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 Processor -- start 2023-12-13T22:26:42.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 -- start start 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f250406b8d0 0x7f250414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.952+0000 7f250bfaa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f250bfaa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f250406bcb0 0x7f25041f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f250bfaa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250414ed80 con 0x7f250414cd40 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f250bfaa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25041f5270 con 0x7f250406b8d0 2023-12-13T22:26:42.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f250bfaa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250414efa0 con 0x7f250406bcb0 2023-12-13T22:26:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f2509545640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f2509545640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57914/0 (socket says 172.21.15.91:57914) 2023-12-13T22:26:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f2509545640 1 -- 172.21.15.91:0/245130511 learned_addr learned my addr 172.21.15.91:0/245130511 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f2509d46640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f250406b8d0 0x7f250414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.956+0000 7f250a547640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f250406bcb0 0x7f25041f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 -- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f250406bcb0 msgr2=0x7f25041f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f250406bcb0 0x7f25041f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 -- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f250406b8d0 msgr2=0x7f250414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f250406b8d0 0x7f250414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:42.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 -- 172.21.15.91:0/245130511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25041f54c0 con 0x7f250414cd40 2023-12-13T22:26:42.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.960+0000 7f2509545640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24f8001f30 tx=0x7f24f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.964+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80070d0 con 0x7f250414cd40 2023-12-13T22:26:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.964+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8007230 con 0x7f250414cd40 2023-12-13T22:26:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.964+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80075e0 con 0x7f250414cd40 2023-12-13T22:26:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.968+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25041f57a0 con 0x7f250414cd40 2023-12-13T22:26:42.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.968+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25041f5d60 con 0x7f250414cd40 2023-12-13T22:26:42.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:42.968+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2504073e70 con 0x7f250414cd40 2023-12-13T22:26:43.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.336+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f24f8007740 con 0x7f250414cd40 2023-12-13T22:26:43.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.336+0000 7f24f67fc640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 0x7f24e8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:43.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.336+0000 7f2509d46640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 0x7f24e8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:43.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.336+0000 7f2509d46640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 0x7f24e8068d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2500001750 tx=0x7f25000011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:43.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.376+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24f80556d0 con 0x7f250414cd40 2023-12-13T22:26:43.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.384+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f24f8051a10 con 0x7f250414cd40 2023-12-13T22:26:43.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.624+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f25040c8450 con 0x7f250414cd40 2023-12-13T22:26:43.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.856+0000 7f24f67fc640 1 -- 172.21.15.91:0/245130511 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164563 (secure 0 0 0) 0x7f24f8018030 con 0x7f250414cd40 2023-12-13T22:26:43.855 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 msgr2=0x7f24e8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 0x7f24e8068d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2500001750 tx=0x7f25000011a0 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 msgr2=0x7f25041f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f24f8001f30 tx=0x7f24f800a430 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 shutdown_connections 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f24e8066840 0x7f24e8068d00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f250406bcb0 0x7f25041f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f250414cd40 0x7f25041f1d00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 --2- 172.21.15.91:0/245130511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f250406b8d0 0x7f250414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:43.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 >> 172.21.15.91:0/245130511 conn(0x7f25040708a0 msgr2=0x7f25040c8670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 shutdown_connections 2023-12-13T22:26:43.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:43.860+0000 7f250bfaa640 1 -- 172.21.15.91:0/245130511 wait complete. 2023-12-13T22:26:43.876 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6800","nonce":3723397605},{"type":"v1","addr":"172.21.15.91:6801","nonce":3723397605}]},"active_addr":"172.21.15.91:6801/3723397605","active_change":"2023-12-13T22:25:00.074271+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":4070688836}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":3346228998}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2485609295}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.91:0","nonce":2908094956}]}]} 2023-12-13T22:26:43.880 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-13T22:26:43.880 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-13T22:26:43.881 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:43.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 Processor -- start 2023-12-13T22:26:43.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 -- start start 2023-12-13T22:26:43.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f323406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:43.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f32340c4cc0 0x7f32340c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:43.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32341595f0 con 0x7f32340c82d0 2023-12-13T22:26:43.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234157060 con 0x7f32340c4cc0 2023-12-13T22:26:43.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f323a2fa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340c2c50 con 0x7f323406b620 2023-12-13T22:26:44.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f3233fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f32340c82d0 0x7f3234159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52534/0 (socket says 172.21.15.91:52534) 2023-12-13T22:26:44.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.000+0000 7f3233fff640 1 -- 172.21.15.91:0/535244533 learned_addr learned my addr 172.21.15.91:0/535244533 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:44.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.004+0000 7f3238897640 1 --2- 172.21.15.91:0/535244533 >> v2:172.21.15.152:3300/0 conn(0x7f32340c4cc0 0x7f32340c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.008+0000 7f32337fe640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f323406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.012+0000 7f3238897640 1 -- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 msgr2=0x7f323406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:44.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.012+0000 7f3238897640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f323406ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.012+0000 7f3238897640 1 -- 172.21.15.91:0/535244533 >> v1:172.21.15.152:6789/0 conn(0x7f32340c82d0 legacy=0x7f3234159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.012+0000 7f3238897640 1 -- 172.21.15.91:0/535244533 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340c2f30 con 0x7f32340c4cc0 2023-12-13T22:26:44.020 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.020+0000 7f3238897640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c4cc0 0x7f32340c5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d90 tx=0x7f322c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bfdbe316facad2c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:44.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.032+0000 7f3232ffd640 1 -- 172.21.15.91:0/535244533 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0a5a10 con 0x7f32340c4cc0 2023-12-13T22:26:44.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.032+0000 7f3232ffd640 1 -- 172.21.15.91:0/535244533 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0a5b70 con 0x7f32340c4cc0 2023-12-13T22:26:44.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.032+0000 7f3232ffd640 1 -- 172.21.15.91:0/535244533 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0ad440 con 0x7f32340c4cc0 2023-12-13T22:26:44.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c4cc0 msgr2=0x7f32340c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c4cc0 0x7f32340c5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f322c009d90 tx=0x7f322c01c950 comp rx=0 tx=0).stop 2023-12-13T22:26:44.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- 172.21.15.91:0/535244533 shutdown_connections 2023-12-13T22:26:44.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f323406ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 --2- 172.21.15.91:0/535244533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c4cc0 0x7f32340c5110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- 172.21.15.91:0/535244533 >> 172.21.15.91:0/535244533 conn(0x7f32340713a0 msgr2=0x7f32340717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:44.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- 172.21.15.91:0/535244533 shutdown_connections 2023-12-13T22:26:44.034 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- 172.21.15.91:0/535244533 wait complete. 2023-12-13T22:26:44.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 Processor -- start 2023-12-13T22:26:44.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.036+0000 7f323a2fa640 1 -- start start 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f3234155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c82d0 0x7f32340cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341552e0 con 0x7f32340c4cc0 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340ca690 con 0x7f32340c82d0 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f323a2fa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234154d20 con 0x7f323406b620 2023-12-13T22:26:44.038 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f32337fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f32337fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57926/0 (socket says 172.21.15.91:57926) 2023-12-13T22:26:44.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f32337fe640 1 -- 172.21.15.91:0/2790406865 learned_addr learned my addr 172.21.15.91:0/2790406865 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:44.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f3238897640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c82d0 0x7f32340cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.040+0000 7f3233fff640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f3234155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.044+0000 7f32337fe640 1 -- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 msgr2=0x7f3234155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.044+0000 7f32337fe640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f3234155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.044+0000 7f32337fe640 1 -- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c82d0 msgr2=0x7f32340cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.044+0000 7f32337fe640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c82d0 0x7f32340cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.044+0000 7f32337fe640 1 -- 172.21.15.91:0/2790406865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009a70 con 0x7f32340c4cc0 2023-12-13T22:26:44.047 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.048+0000 7f32337fe640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f322400e870 tx=0x7f322400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:44.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224009510 con 0x7f32340c4cc0 2023-12-13T22:26:44.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400eec0 con 0x7f32340c4cc0 2023-12-13T22:26:44.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400cb40 con 0x7f32340c4cc0 2023-12-13T22:26:44.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3234155000 con 0x7f32340c4cc0 2023-12-13T22:26:44.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323413ef20 con 0x7f32340c4cc0 2023-12-13T22:26:44.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.052+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340ca180 con 0x7f32340c4cc0 2023-12-13T22:26:44.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.328+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f322400cca0 con 0x7f32340c4cc0 2023-12-13T22:26:44.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.332+0000 7f3230ff9640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 0x7f3220068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.332+0000 7f3233fff640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 0x7f3220068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.332+0000 7f3233fff640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 0x7f3220068d00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3228000f70 tx=0x7f3228007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:44.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.340+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3224055820 con 0x7f32340c4cc0 2023-12-13T22:26:44.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.344+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3224051b60 con 0x7f32340c4cc0 2023-12-13T22:26:44.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.508+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32340ca840 con 0x7f32340c4cc0 2023-12-13T22:26:44.568 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.568+0000 7f3230ff9640 1 -- 172.21.15.91:0/2790406865 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f32340ca840 con 0x7f32340c4cc0 2023-12-13T22:26:44.569 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:44.569 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:44.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 msgr2=0x7f3220068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 0x7f3220068d00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3228000f70 tx=0x7f3228007e90 comp rx=0 tx=0).stop 2023-12-13T22:26:44.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 msgr2=0x7f323413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f322400e870 tx=0x7f322400ec70 comp rx=0 tx=0).stop 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 shutdown_connections 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3220066840 0x7f3220068d00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32340c82d0 0x7f32340cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f32340c4cc0 0x7f323413e9e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 --2- 172.21.15.91:0/2790406865 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f323406b620 0x7f3234155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 >> 172.21.15.91:0/2790406865 conn(0x7f32340713a0 msgr2=0x7f323406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 shutdown_connections 2023-12-13T22:26:44.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.572+0000 7f323a2fa640 1 -- 172.21.15.91:0/2790406865 wait complete. 2023-12-13T22:26:44.592 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-13T22:26:44.592 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.716+0000 7f63698f1640 1 Processor -- start 2023-12-13T22:26:44.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.716+0000 7f63698f1640 1 -- start start 2023-12-13T22:26:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63698f1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f63640cbd50 0x7f63640c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63698f1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 0x7f6364156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63698f1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640c1570 con 0x7f63640c0ee0 2023-12-13T22:26:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63698f1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63640c1350 con 0x7f63640cbd50 2023-12-13T22:26:44.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63698f1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c1810 con 0x7f63640cc130 2023-12-13T22:26:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63637fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f63640c0ee0 0x7f63640c6820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42186/0 (socket says 172.21.15.91:42186) 2023-12-13T22:26:44.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.720+0000 7f63637fe640 1 -- 172.21.15.91:0/2436310528 learned_addr learned my addr 172.21.15.91:0/2436310528 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:44.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.724+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538464304 0 0) 0x7f63640c1570 con 0x7f63640c0ee0 2023-12-13T22:26:44.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.724+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6350005740 con 0x7f63640c0ee0 2023-12-13T22:26:44.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 820730349 0 0) 0x7f6350005740 con 0x7f63640c0ee0 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 msgr2=0x7f6364156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 0x7f6364156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 >> v2:172.21.15.152:3300/0 conn(0x7f63640cbd50 msgr2=0x7f63640c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 --2- 172.21.15.91:0/2436310528 >> v2:172.21.15.152:3300/0 conn(0x7f63640cbd50 0x7f63640c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640c1af0 con 0x7f63640c0ee0 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f635c001a00 con 0x7f63640c0ee0 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 >> v1:172.21.15.91:6789/0 conn(0x7f63640c0ee0 legacy=0x7f63640c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6350005c00 0x7f6350006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63500069e0 0x7f6350006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 0x7f635000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c1350 con 0x7f6350005c00 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c1810 con 0x7f63500069e0 2023-12-13T22:26:44.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.728+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500078b0 con 0x7f63640cc130 2023-12-13T22:26:44.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.732+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6350005c00 0x7f6350006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 -- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 msgr2=0x7f635000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:44.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63640cc130 0x7f635000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 -- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63500069e0 msgr2=0x7f6350006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:44.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63500069e0 0x7f6350006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.733 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 -- 172.21.15.91:0/2436310528 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350005740 con 0x7f6350005c00 2023-12-13T22:26:44.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.736+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6350005c00 0x7f6350006020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6354009890 tx=0x7f635401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d25a38f0fd006e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:44.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540ab600 con 0x7f6350005c00 2023-12-13T22:26:44.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63540a7050 con 0x7f6350005c00 2023-12-13T22:26:44.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63627fc640 1 -- 172.21.15.91:0/2436310528 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540aba00 con 0x7f6350005c00 2023-12-13T22:26:44.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 -- 172.21.15.91:0/2436310528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6350005c00 msgr2=0x7f6350006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 --2- 172.21.15.91:0/2436310528 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6350005c00 0x7f6350006020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6354009890 tx=0x7f635401c3a0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63637fe640 1 -- 172.21.15.91:0/2436310528 reap_dead start 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 -- 172.21.15.91:0/2436310528 shutdown_connections 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 -- 172.21.15.91:0/2436310528 >> 172.21.15.91:0/2436310528 conn(0x7f6364070160 msgr2=0x7f636406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 -- 172.21.15.91:0/2436310528 shutdown_connections 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.740+0000 7f63698f1640 1 -- 172.21.15.91:0/2436310528 wait complete. 2023-12-13T22:26:44.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 Processor -- start 2023-12-13T22:26:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 -- start start 2023-12-13T22:26:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6350005c00 0x7f636414a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f636414aff0 0x7f636414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63641462f0 con 0x7f63641f1970 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63641f14e0 con 0x7f636414aff0 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63698f1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640ca540 con 0x7f6350005c00 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63637fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63637fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57950/0 (socket says 172.21.15.91:57950) 2023-12-13T22:26:44.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.744+0000 7f63637fe640 1 -- 172.21.15.91:0/2453525176 learned_addr learned my addr 172.21.15.91:0/2453525176 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:44.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.748+0000 7f63637fe640 1 -- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6350005c00 msgr2=0x7f636414a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.748+0000 7f63637fe640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6350005c00 0x7f636414a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.748+0000 7f63637fe640 1 -- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f636414aff0 msgr2=0x7f636414dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:44.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.748+0000 7f63637fe640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f636414aff0 0x7f636414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:44.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.748+0000 7f63637fe640 1 -- 172.21.15.91:0/2453525176 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640ca800 con 0x7f63641f1970 2023-12-13T22:26:44.752 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.752+0000 7f63637fe640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f63640c9710 tx=0x7f635c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:44.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.756+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c004d70 con 0x7f63641f1970 2023-12-13T22:26:44.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.756+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00a5b0 con 0x7f63641f1970 2023-12-13T22:26:44.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.756+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00a940 con 0x7f63641f1970 2023-12-13T22:26:44.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.756+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63640caae0 con 0x7f63641f1970 2023-12-13T22:26:44.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.756+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63641f1170 con 0x7f63641f1970 2023-12-13T22:26:44.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.760+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63641f1330 con 0x7f63641f1970 2023-12-13T22:26:44.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.776+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f635c00aaa0 con 0x7f63641f1970 2023-12-13T22:26:44.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.776+0000 7f6360ff9640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 0x7f6344068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:44.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.776+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 0x7f6344068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:44.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:44.780+0000 7f6362ffd640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 0x7f6344068d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63540ad000 tx=0x7f63540047e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.096+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f635c01ce20 con 0x7f63641f1970 2023-12-13T22:26:45.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.096+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f635c050f80 con 0x7f63641f1970 2023-12-13T22:26:45.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.264+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63641f1690 con 0x7f63641f1970 2023-12-13T22:26:45.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.376+0000 7f6360ff9640 1 -- 172.21.15.91:0/2453525176 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f63641f1690 con 0x7f63641f1970 2023-12-13T22:26:45.375 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:45.375 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 msgr2=0x7f6344068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 0x7f6344068d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63540ad000 tx=0x7f63540047e0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 msgr2=0x7f6364152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f63640c9710 tx=0x7f635c00cbe0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 shutdown_connections 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6344066840 0x7f6344068d00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f63641f1970 0x7f6364152c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f636414aff0 0x7f636414dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 --2- 172.21.15.91:0/2453525176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6350005c00 0x7f636414a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 >> 172.21.15.91:0/2453525176 conn(0x7f6364070160 msgr2=0x7f63640b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 shutdown_connections 2023-12-13T22:26:45.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.380+0000 7f63698f1640 1 -- 172.21.15.91:0/2453525176 wait complete. 2023-12-13T22:26:45.402 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-13T22:26:45.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-13T22:26:45.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-13T22:26:45.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-13T22:26:45.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-13T22:26:45.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-13T22:26:45.405 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-13T22:26:45.405 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-13T22:26:45.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.596+0000 7f867da3e640 1 Processor -- start 2023-12-13T22:26:45.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.596+0000 7f867da3e640 1 -- start start 2023-12-13T22:26:45.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f867da3e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f86780c6de0 0x7f867816df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f867da3e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867806ed90 con 0x7f867816e4d0 2023-12-13T22:26:45.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f867da3e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780c6030 con 0x7f867816dbb0 2023-12-13T22:26:45.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f867da3e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780710e0 con 0x7f86780c6de0 2023-12-13T22:26:45.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8676ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f867816dbb0 0x7f86780709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52538/0 (socket says 172.21.15.91:52538) 2023-12-13T22:26:45.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8676ffd640 1 -- 172.21.15.91:0/269046920 learned_addr learned my addr 172.21.15.91:0/269046920 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:45.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f86767fc640 1 --2- 172.21.15.91:0/269046920 >> v2:172.21.15.91:3300/0 conn(0x7f86780c6de0 0x7f867816df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 Processor -- start 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 -- start start 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33280c5b20 0x7f3328072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3328160eb0 0x7f33280c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332815dfd0 con 0x7f3328157bc0 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3328072130 con 0x7f33280c5b20 2023-12-13T22:26:45.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f332e190640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3328072a90 con 0x7f3328160eb0 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 Processor -- start 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 -- start start 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8aac163620 0x7f8aac0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8aac166a30 0x7f8aac0c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac070ee0 con 0x7f8aac0c6720 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0c2060 con 0x7f8aac166a30 2023-12-13T22:26:45.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.600+0000 7f8ab0ec3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0c6bc0 con 0x7f8aac163620 2023-12-13T22:26:45.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.604+0000 7f86767fc640 1 -- 172.21.15.91:0/269046920 >> v1:172.21.15.152:6789/0 conn(0x7f867816dbb0 legacy=0x7f86780709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.604+0000 7f86767fc640 1 -- 172.21.15.91:0/269046920 >> v1:172.21.15.91:6789/0 conn(0x7f867816e4d0 legacy=0x7f8678167500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.604+0000 7f86767fc640 1 -- 172.21.15.91:0/269046920 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867806e460 con 0x7f86780c6de0 2023-12-13T22:26:45.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 Processor -- start 2023-12-13T22:26:45.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 -- start start 2023-12-13T22:26:45.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f8aab7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8aac163620 0x7f8aac0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f8aab7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8aac163620 0x7f8aac0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54272/0 (socket says 172.21.15.91:54272) 2023-12-13T22:26:45.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f8aab7fe640 1 -- 172.21.15.91:0/4140346091 learned_addr learned my addr 172.21.15.91:0/4140346091 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f64280726d0 0x7f6428159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f3326ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33280c5b20 0x7f3328072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6428159590 con 0x7f64280722f0 2023-12-13T22:26:45.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642815a390 con 0x7f6428159f60 2023-12-13T22:26:45.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f642e5cd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6428155fa0 con 0x7f64280726d0 2023-12-13T22:26:45.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f3326ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f33280c5b20 0x7f3328072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57976/0 (socket says 172.21.15.91:57976) 2023-12-13T22:26:45.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.608+0000 7f3326ffd640 1 -- 172.21.15.91:0/3222789828 learned_addr learned my addr 172.21.15.91:0/3222789828 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 Processor -- start 2023-12-13T22:26:45.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 -- start start 2023-12-13T22:26:45.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd1b80d6ef0 0x7fd1b804b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd1b800e1a0 0x7fd1b804c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b8033af0 con 0x7fd1b804c5c0 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80dcc70 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7fd1c6ec2640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b804be50 con 0x7fd1b800e1a0 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7f3326ffd640 1 -- 172.21.15.91:0/3222789828 >> v2:172.21.15.152:3300/0 conn(0x7f3328160eb0 msgr2=0x7f33280c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7f3326ffd640 1 --2- 172.21.15.91:0/3222789828 >> v2:172.21.15.152:3300/0 conn(0x7f3328160eb0 0x7f33280c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7f3326ffd640 1 -- 172.21.15.91:0/3222789828 >> v1:172.21.15.91:6789/0 conn(0x7f3328157bc0 legacy=0x7f332815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7f3326ffd640 1 -- 172.21.15.91:0/3222789828 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332815e250 con 0x7f33280c5b20 2023-12-13T22:26:45.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.612+0000 7f8aabfff640 1 --2- 172.21.15.91:0/4140346091 >> v2:172.21.15.91:3300/0 conn(0x7f8aac166a30 0x7f8aac0c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.616+0000 7f86767fc640 1 --2- 172.21.15.91:0/269046920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f867816df90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f86680097c0 tx=0x7f866801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff3bdcfb69a26ce server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.620+0000 7f6427fff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f64280722f0 0x7f64280c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42224/0 (socket says 172.21.15.91:42224) 2023-12-13T22:26:45.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.620+0000 7f6427fff640 1 -- 172.21.15.91:0/719280896 learned_addr learned my addr 172.21.15.91:0/719280896 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:45.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.624+0000 7f64277fe640 1 --2- 172.21.15.91:0/719280896 >> v2:172.21.15.91:3300/0 conn(0x7f64280726d0 0x7f6428159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.624+0000 7fd1c4c5e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd1b80d6ef0 0x7fd1b804b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.624+0000 7fd1c4c5e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd1b80d6ef0 0x7fd1b804b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58000/0 (socket says 172.21.15.91:58000) 2023-12-13T22:26:45.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.624+0000 7fd1c4c5e640 1 -- 172.21.15.91:0/1347509034 learned_addr learned my addr 172.21.15.91:0/1347509034 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f64277fe640 1 -- 172.21.15.91:0/719280896 >> v1:172.21.15.152:6789/0 conn(0x7f6428159f60 legacy=0x7f6428160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f64277fe640 1 -- 172.21.15.91:0/719280896 >> v1:172.21.15.91:6789/0 conn(0x7f64280722f0 legacy=0x7f64280c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f64277fe640 1 -- 172.21.15.91:0/719280896 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428156190 con 0x7f64280726d0 2023-12-13T22:26:45.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f8aab7fe640 1 -- 172.21.15.91:0/4140346091 >> v2:172.21.15.91:3300/0 conn(0x7f8aac166a30 msgr2=0x7f8aac0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f8aab7fe640 1 --2- 172.21.15.91:0/4140346091 >> v2:172.21.15.91:3300/0 conn(0x7f8aac166a30 0x7f8aac0c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f8aab7fe640 1 -- 172.21.15.91:0/4140346091 >> v1:172.21.15.91:6789/0 conn(0x7f8aac0c6720 legacy=0x7f8aac166320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7f8aab7fe640 1 -- 172.21.15.91:0/4140346091 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac163a00 con 0x7f8aac163620 2023-12-13T22:26:45.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.628+0000 7fd1bffff640 1 --2- 172.21.15.91:0/1347509034 >> v2:172.21.15.152:3300/0 conn(0x7fd1b800e1a0 0x7fd1b804c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.632+0000 7fd1c4c5e640 1 -- 172.21.15.91:0/1347509034 >> v2:172.21.15.152:3300/0 conn(0x7fd1b800e1a0 msgr2=0x7fd1b804c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.632+0000 7fd1c4c5e640 1 --2- 172.21.15.91:0/1347509034 >> v2:172.21.15.152:3300/0 conn(0x7fd1b800e1a0 0x7fd1b804c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.632+0000 7fd1c4c5e640 1 -- 172.21.15.91:0/1347509034 >> v1:172.21.15.91:6789/0 conn(0x7fd1b804c5c0 legacy=0x7fd1b80dd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.632+0000 7fd1c4c5e640 1 -- 172.21.15.91:0/1347509034 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80e03b0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.640+0000 7f64277fe640 1 --2- 172.21.15.91:0/719280896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280726d0 0x7f6428159a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64180097c0 tx=0x7f641801e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176e1ac71d87ec35 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.640+0000 7f8aab7fe640 1 --2- 172.21.15.91:0/4140346091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac163620 0x7f8aac0c72e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0c80e0 tx=0x7f8aa001e7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7130563a76556f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.640+0000 7f3326ffd640 1 --2- 172.21.15.91:0/3222789828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33280c5b20 0x7f3328072550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f332806f630 tx=0x7f331c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04c993b28903e15 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 Processor -- start 2023-12-13T22:26:45.645 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 -- start start 2023-12-13T22:26:45.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 Processor -- start 2023-12-13T22:26:45.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 -- start start 2023-12-13T22:26:45.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f572815a050 0x7f57280cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57280cb7d0 0x7f5728163f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572806b4c0 con 0x7f572814ff30 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280cbbb0 con 0x7f572815a050 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7f572d734640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572815cd60 con 0x7f57280cb7d0 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff7b80722f0 0x7ff7b80726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff7b80c66d0 0x7ff7b80c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b8159590 con 0x7ff7b8159a20 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b8155fa0 con 0x7ff7b80c66d0 2023-12-13T22:26:45.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.648+0000 7ff7bf476640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b8072c10 con 0x7ff7b80722f0 2023-12-13T22:26:45.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f6426ffd640 1 -- 172.21.15.91:0/719280896 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64180a8040 con 0x7f64280726d0 2023-12-13T22:26:45.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f6426ffd640 1 -- 172.21.15.91:0/719280896 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64180ac600 con 0x7f64280726d0 2023-12-13T22:26:45.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f6426ffd640 1 -- 172.21.15.91:0/719280896 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64180ac990 con 0x7f64280726d0 2023-12-13T22:26:45.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 Processor -- start 2023-12-13T22:26:45.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 -- start start 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- 172.21.15.91:0/719280896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280726d0 msgr2=0x7f6428159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 --2- 172.21.15.91:0/719280896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280726d0 0x7f6428159a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64180097c0 tx=0x7f641801e590 comp rx=0 tx=0).stop 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- 172.21.15.91:0/719280896 shutdown_connections 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 --2- 172.21.15.91:0/719280896 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280726d0 0x7f6428159a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- 172.21.15.91:0/719280896 >> 172.21.15.91:0/719280896 conn(0x7f642806b670 msgr2=0x7f642806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- 172.21.15.91:0/719280896 shutdown_connections 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- 172.21.15.91:0/719280896 wait complete. 2023-12-13T22:26:45.651 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f915413d010 0x7f9154157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91540c6920 con 0x7f91540c4f80 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91541580e0 con 0x7f915413d010 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f915ac03640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540c5d30 con 0x7f915406eed0 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7fd1c4c5e640 1 --2- 172.21.15.91:0/1347509034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b804b910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8047330 tx=0x7fd1b401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188c931087e44f1a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 Processor -- start 2023-12-13T22:26:45.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f642e5cd640 1 -- start start 2023-12-13T22:26:45.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f8675ffb640 1 -- 172.21.15.91:0/269046920 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680ab600 con 0x7f86780c6de0 2023-12-13T22:26:45.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f8675ffb640 1 -- 172.21.15.91:0/269046920 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86680a7050 con 0x7f86780c6de0 2023-12-13T22:26:45.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.652+0000 7f8675ffb640 1 -- 172.21.15.91:0/269046920 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680ab980 con 0x7f86780c6de0 2023-12-13T22:26:45.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f9153fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280722f0 0x7f642814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 0x7f6428143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6428159f60 0x7f64281411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642814ad10 con 0x7f64280722f0 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64281f5140 con 0x7f6428159f60 2023-12-13T22:26:45.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f642e5cd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64281f53c0 con 0x7f64280726d0 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- 172.21.15.91:0/269046920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 msgr2=0x7f867816df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 --2- 172.21.15.91:0/269046920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f867816df90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f86680097c0 tx=0x7f866801c440 comp rx=0 tx=0).stop 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- 172.21.15.91:0/269046920 shutdown_connections 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 --2- 172.21.15.91:0/269046920 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f867816df90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- 172.21.15.91:0/269046920 >> 172.21.15.91:0/269046920 conn(0x7f86780c73c0 msgr2=0x7f86780c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- 172.21.15.91:0/269046920 shutdown_connections 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- 172.21.15.91:0/269046920 wait complete. 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 Processor -- start 2023-12-13T22:26:45.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- start start 2023-12-13T22:26:45.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f9153fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45476/0 (socket says 172.21.15.91:45476) 2023-12-13T22:26:45.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f9153fff640 1 -- 172.21.15.91:0/3078407907 learned_addr learned my addr 172.21.15.91:0/3078407907 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f64277fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 0x7f6428143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f8aaa7fc640 1 -- 172.21.15.91:0/4140346091 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a7890 con 0x7f8aac163620 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f8aaa7fc640 1 -- 172.21.15.91:0/4140346091 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00ab070 con 0x7f8aac163620 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f8aaa7fc640 1 -- 172.21.15.91:0/4140346091 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00a7c10 con 0x7f8aac163620 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/4140346091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac163620 msgr2=0x7f8aac0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/4140346091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac163620 0x7f8aac0c72e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0c80e0 tx=0x7f8aa001e7c0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f86780c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867816dbb0 0x7f86780c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f867816e4d0 0x7f8678206680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867815a400 con 0x7f86780c6de0 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8678159d70 con 0x7f867816dbb0 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.656+0000 7f867da3e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780ca670 con 0x7f867816e4d0 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/4140346091 shutdown_connections 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/4140346091 >> v2:172.21.15.91:3300/0 conn(0x7f8aac166a30 0x7f8aac0c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/4140346091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac163620 0x7f8aac0c72e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/4140346091 >> 172.21.15.91:0/4140346091 conn(0x7f8aac06a560 msgr2=0x7f8aac06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/4140346091 shutdown_connections 2023-12-13T22:26:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/4140346091 wait complete. 2023-12-13T22:26:45.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 Processor -- start 2023-12-13T22:26:45.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.660+0000 7f8ab0ec3640 1 -- start start 2023-12-13T22:26:45.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8aac0c6720 0x7f8aac15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f9153fff640 1 -- 172.21.15.91:0/3078407907 >> v2:172.21.15.152:3300/0 conn(0x7f915413d010 msgr2=0x7f9154157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f9153fff640 1 --2- 172.21.15.91:0/3078407907 >> v2:172.21.15.152:3300/0 conn(0x7f915413d010 0x7f9154157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f9153fff640 1 -- 172.21.15.91:0/3078407907 >> v1:172.21.15.152:6789/0 conn(0x7f91540c4f80 legacy=0x7f91540c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f9153fff640 1 -- 172.21.15.91:0/3078407907 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915406f710 con 0x7f915406eed0 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8aac163620 0x7f8aac15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac166a30 0x7f8aac15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15ba80 con 0x7f8aac163620 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac169110 con 0x7f8aac166a30 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f8ab0ec3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac167c00 con 0x7f8aac0c6720 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f64277fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 0x7f6428143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45488/0 (socket says 172.21.15.91:45488) 2023-12-13T22:26:45.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f64277fe640 1 -- 172.21.15.91:0/1416483531 learned_addr learned my addr 172.21.15.91:0/1416483531 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f33267fc640 1 -- 172.21.15.91:0/3222789828 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0ac600 con 0x7f33280c5b20 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f33267fc640 1 -- 172.21.15.91:0/3222789828 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c0a8050 con 0x7f33280c5b20 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f33267fc640 1 -- 172.21.15.91:0/3222789828 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0ac980 con 0x7f33280c5b20 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f57267fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f572815a050 0x7f57280cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f57267fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f572815a050 0x7f57280cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58008/0 (socket says 172.21.15.91:58008) 2023-12-13T22:26:45.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f57267fc640 1 -- 172.21.15.91:0/2875431698 learned_addr learned my addr 172.21.15.91:0/2875431698 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 -- 172.21.15.91:0/3222789828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33280c5b20 msgr2=0x7f3328072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 --2- 172.21.15.91:0/3222789828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33280c5b20 0x7f3328072550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f332806f630 tx=0x7f331c01c4b0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7ff7bda13640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff7b8159a20 0x7ff7b8159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52552/0 (socket says 172.21.15.91:52552) 2023-12-13T22:26:45.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7ff7bda13640 1 -- 172.21.15.91:0/3969911196 learned_addr learned my addr 172.21.15.91:0/3969911196 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 -- 172.21.15.91:0/3222789828 shutdown_connections 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 --2- 172.21.15.91:0/3222789828 >> v2:172.21.15.152:3300/0 conn(0x7f3328160eb0 0x7f33280c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 --2- 172.21.15.91:0/3222789828 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f33280c5b20 0x7f3328072550 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 -- 172.21.15.91:0/3222789828 >> 172.21.15.91:0/3222789828 conn(0x7f332806c6a0 msgr2=0x7f332806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 -- 172.21.15.91:0/3222789828 shutdown_connections 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7f332e190640 1 -- 172.21.15.91:0/3222789828 wait complete. 2023-12-13T22:26:45.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.664+0000 7ff7bca11640 1 --2- 172.21.15.91:0/3969911196 >> v2:172.21.15.91:3300/0 conn(0x7ff7b80c66d0 0x7ff7b80c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 Processor -- start 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 -- start start 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33280c5b20 0x7f33282026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3328157bc0 0x7f3328148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3328160eb0 0x7f3328148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814ab10 con 0x7f3328160eb0 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814c840 con 0x7f33280c5b20 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f332e190640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3328147420 con 0x7f3328157bc0 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f57267fc640 1 -- 172.21.15.91:0/2875431698 >> v2:172.21.15.152:3300/0 conn(0x7f57280cb7d0 msgr2=0x7f5728163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f57267fc640 1 --2- 172.21.15.91:0/2875431698 >> v2:172.21.15.152:3300/0 conn(0x7f57280cb7d0 0x7f5728163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f57267fc640 1 -- 172.21.15.91:0/2875431698 >> v1:172.21.15.152:6789/0 conn(0x7f572814ff30 legacy=0x7f572815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f57267fc640 1 -- 172.21.15.91:0/2875431698 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572815a4c0 con 0x7f572815a050 2023-12-13T22:26:45.668 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.668+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f86780c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.672+0000 7f6427fff640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280722f0 0x7f642814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.672+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f86780c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58038/0 (socket says 172.21.15.91:58038) 2023-12-13T22:26:45.669 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.672+0000 7f8676ffd640 1 -- 172.21.15.91:0/2921700447 learned_addr learned my addr 172.21.15.91:0/2921700447 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f8676ffd640 1 -- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f867816e4d0 msgr2=0x7f8678206680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f8676ffd640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f867816e4d0 0x7f8678206680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f8676ffd640 1 -- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867816dbb0 msgr2=0x7f86780c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f8676ffd640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867816dbb0 0x7f86780c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f8676ffd640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668009420 con 0x7f86780c6de0 2023-12-13T22:26:45.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f64277fe640 1 -- 172.21.15.91:0/1416483531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6428159f60 msgr2=0x7f64281411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f64277fe640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6428159f60 0x7f64281411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f64277fe640 1 -- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280722f0 msgr2=0x7f642814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f64277fe640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64280722f0 0x7f642814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.676+0000 7f64277fe640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009420 con 0x7f64280726d0 2023-12-13T22:26:45.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.684+0000 7f8676ffd640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f86780c5060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f867000cba0 tx=0x7f867000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.684+0000 7f64277fe640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 0x7f6428143770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f64180097c0 tx=0x7f641801cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7f3326ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3328157bc0 0x7f3328148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8aac0c6720 0x7f8aac15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7f8aaaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8aac163620 0x7f8aac15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7fd1bf7fe640 1 -- 172.21.15.91:0/1347509034 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40ab600 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7fd1bf7fe640 1 -- 172.21.15.91:0/1347509034 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b40a7050 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7fd1bf7fe640 1 -- 172.21.15.91:0/1347509034 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40ab980 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.688+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac166a30 0x7f8aac15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/1347509034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 msgr2=0x7fd1b804b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/1347509034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b804b910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8047330 tx=0x7fd1b401c4e0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/1347509034 shutdown_connections 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/1347509034 >> v2:172.21.15.152:3300/0 conn(0x7fd1b800e1a0 0x7fd1b804c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/1347509034 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b804b910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/1347509034 >> 172.21.15.91:0/1347509034 conn(0x7fd1b8050160 msgr2=0x7fd1b8050570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/1347509034 shutdown_connections 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/1347509034 wait complete. 2023-12-13T22:26:45.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7ff7bca11640 1 -- 172.21.15.91:0/3969911196 >> v2:172.21.15.152:3300/0 conn(0x7ff7b80722f0 msgr2=0x7ff7b80726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7ff7bca11640 1 --2- 172.21.15.91:0/3969911196 >> v2:172.21.15.152:3300/0 conn(0x7ff7b80722f0 0x7ff7b80726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7ff7bca11640 1 -- 172.21.15.91:0/3969911196 >> v1:172.21.15.152:6789/0 conn(0x7ff7b8159a20 legacy=0x7ff7b8159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7ff7bca11640 1 -- 172.21.15.91:0/3969911196 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8156190 con 0x7ff7b80c66d0 2023-12-13T22:26:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7f8aabfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac166a30 0x7f8aac15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54348/0 (socket says 172.21.15.91:54348) 2023-12-13T22:26:45.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7f8aabfff640 1 -- 172.21.15.91:0/1621181652 learned_addr learned my addr 172.21.15.91:0/1621181652 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 Processor -- start 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- start start 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1b800e1a0 0x7fd1b80d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1b804c5c0 0x7fd1b80ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b80d4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b804d2c0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81715b0 con 0x7fd1b800e1a0 2023-12-13T22:26:45.693 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.692+0000 7fd1c6ec2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8178a30 con 0x7fd1b804c5c0 2023-12-13T22:26:45.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.696+0000 7f8aaaffd640 1 -- 172.21.15.91:0/1621181652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8aac0c6720 msgr2=0x7f8aac15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.696+0000 7f8aaaffd640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8aac0c6720 0x7f8aac15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.696+0000 7f8aaaffd640 1 -- 172.21.15.91:0/1621181652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac166a30 msgr2=0x7f8aac15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.696+0000 7f8aaaffd640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8aac166a30 0x7f8aac15c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.696+0000 7f8aaaffd640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00086d0 con 0x7f8aac163620 2023-12-13T22:26:45.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.700+0000 7ff7bca11640 1 --2- 172.21.15.91:0/3969911196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 0x7ff7b80c6b40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80c9420 tx=0x7ff7a801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fa55e4c254cc84 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.704+0000 7f57267fc640 1 --2- 172.21.15.91:0/2875431698 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572815a050 0x7f57280cb290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57280c8d70 tx=0x7f571c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592f0cebdb37e24c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.704+0000 7f3326ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3328157bc0 0x7f3328148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45518/0 (socket says 172.21.15.91:45518) 2023-12-13T22:26:45.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.704+0000 7f3326ffd640 1 -- 172.21.15.91:0/2808850941 learned_addr learned my addr 172.21.15.91:0/2808850941 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.704+0000 7fd1c545f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b80d4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.704+0000 7f3327fff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3328160eb0 0x7f3328148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.708+0000 7f8aaaffd640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8aac163620 0x7f8aac15bf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c680 tx=0x7f8a9c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.712+0000 7fd1c545f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b80d4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58066/0 (socket says 172.21.15.91:58066) 2023-12-13T22:26:45.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.712+0000 7fd1c545f640 1 -- 172.21.15.91:0/4286033957 learned_addr learned my addr 172.21.15.91:0/4286033957 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.716+0000 7f3327fff640 1 -- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3328157bc0 msgr2=0x7f3328148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.716+0000 7f3327fff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3328157bc0 0x7f3328148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.716+0000 7f3327fff640 1 -- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33280c5b20 msgr2=0x7f33282026d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.716+0000 7f3327fff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33280c5b20 0x7f33282026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.716+0000 7f3327fff640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0094d0 con 0x7f3328160eb0 2023-12-13T22:26:45.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000ad40 con 0x7f86780c6de0 2023-12-13T22:26:45.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670012400 con 0x7f86780c6de0 2023-12-13T22:26:45.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86780c8d80 con 0x7f86780c6de0 2023-12-13T22:26:45.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000aea0 con 0x7f86780c6de0 2023-12-13T22:26:45.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780ca390 con 0x7f86780c6de0 2023-12-13T22:26:45.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f5725ffb640 1 -- 172.21.15.91:0/2875431698 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0ab600 con 0x7f572815a050 2023-12-13T22:26:45.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f5725ffb640 1 -- 172.21.15.91:0/2875431698 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c0a7050 con 0x7f572815a050 2023-12-13T22:26:45.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f5725ffb640 1 -- 172.21.15.91:0/2875431698 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0ab980 con 0x7f572815a050 2023-12-13T22:26:45.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86780c5cd0 con 0x7f86780c6de0 2023-12-13T22:26:45.720 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 -- 172.21.15.91:0/2875431698 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572815a050 msgr2=0x7f57280cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 --2- 172.21.15.91:0/2875431698 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572815a050 0x7f57280cb290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57280c8d70 tx=0x7f571c01c4e0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 -- 172.21.15.91:0/2875431698 shutdown_connections 2023-12-13T22:26:45.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 --2- 172.21.15.91:0/2875431698 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572815a050 0x7f57280cb290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 --2- 172.21.15.91:0/2875431698 >> v2:172.21.15.152:3300/0 conn(0x7f57280cb7d0 0x7f5728163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 -- 172.21.15.91:0/2875431698 >> 172.21.15.91:0/2875431698 conn(0x7f572806d220 msgr2=0x7f572806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 -- 172.21.15.91:0/2875431698 shutdown_connections 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 -- 172.21.15.91:0/2875431698 wait complete. 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7ff7affff640 1 -- 172.21.15.91:0/3969911196 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80ac600 con 0x7ff7b80c66d0 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7ff7affff640 1 -- 172.21.15.91:0/3969911196 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a80a8050 con 0x7ff7b80c66d0 2023-12-13T22:26:45.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7ff7affff640 1 -- 172.21.15.91:0/3969911196 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80ac980 con 0x7ff7b80c66d0 2023-12-13T22:26:45.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.720+0000 7f572d734640 1 Processor -- start 2023-12-13T22:26:45.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 -- start start 2023-12-13T22:26:45.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- 172.21.15.91:0/3969911196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 msgr2=0x7ff7b80c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- 172.21.15.91:0/3969911196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 0x7ff7b80c6b40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80c9420 tx=0x7ff7a801c3a0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- 172.21.15.91:0/3969911196 shutdown_connections 2023-12-13T22:26:45.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- 172.21.15.91:0/3969911196 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 0x7ff7b80c6b40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57280cb7d0 0x7f57281438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572814ff30 0x7f57281477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- 172.21.15.91:0/3969911196 >> v2:172.21.15.152:3300/0 conn(0x7ff7b80722f0 0x7ff7b80726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- 172.21.15.91:0/3969911196 >> 172.21.15.91:0/3969911196 conn(0x7ff7b806b670 msgr2=0x7ff7b806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 0x7f5728145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728145060 con 0x7f572814ff30 2023-12-13T22:26:45.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728143e10 con 0x7f572815a050 2023-12-13T22:26:45.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f572d734640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57281f1e10 con 0x7f57280cb7d0 2023-12-13T22:26:45.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- 172.21.15.91:0/3969911196 shutdown_connections 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- 172.21.15.91:0/3969911196 wait complete. 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 Processor -- start 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- start start 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7f9153fff640 1 --2- 172.21.15.91:0/3078407907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f914001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb89843e149a181 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7fd1c545f640 1 -- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1b804c5c0 msgr2=0x7fd1b80ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7fd1c545f640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1b804c5c0 0x7fd1b80ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7b80722f0 0x7ff7b81f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7fd1c545f640 1 -- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1b800e1a0 msgr2=0x7fd1b80d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7fd1c545f640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1b800e1a0 0x7fd1b80d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7fd1c545f640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40094d0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 0x7ff7b80c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 0x7ff7b8160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8143510 con 0x7ff7b80c66d0 2023-12-13T22:26:45.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b81437f0 con 0x7ff7b8159a20 2023-12-13T22:26:45.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.724+0000 7ff7bf476640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8143ad0 con 0x7ff7b80722f0 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003b80 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c003ce0 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac167ec0 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c005310 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac168480 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.728+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8aac16a0c0 con 0x7f8aac163620 2023-12-13T22:26:45.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.732+0000 7fd1c545f640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b80d4f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1c004fb60 tx=0x7fd1c00680c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.732+0000 7f57277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 0x7f5728145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.732+0000 7f57277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 0x7f5728145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54372/0 (socket says 172.21.15.91:54372) 2023-12-13T22:26:45.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.732+0000 7f57277fe640 1 -- 172.21.15.91:0/704083074 learned_addr learned my addr 172.21.15.91:0/704083074 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f91537fe640 1 -- 172.21.15.91:0/3078407907 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400aa610 con 0x7f915406eed0 2023-12-13T22:26:45.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f91537fe640 1 -- 172.21.15.91:0/3078407907 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400a6040 con 0x7f915406eed0 2023-12-13T22:26:45.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f91537fe640 1 -- 172.21.15.91:0/3078407907 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400aa990 con 0x7f915406eed0 2023-12-13T22:26:45.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- 172.21.15.91:0/3078407907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 msgr2=0x7f91540c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- 172.21.15.91:0/3078407907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f914001c4d0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- 172.21.15.91:0/3078407907 shutdown_connections 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- 172.21.15.91:0/3078407907 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915406eed0 0x7f91540c4a40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- 172.21.15.91:0/3078407907 >> v2:172.21.15.152:3300/0 conn(0x7f915413d010 0x7f9154157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- 172.21.15.91:0/3078407907 >> 172.21.15.91:0/3078407907 conn(0x7f91540713a0 msgr2=0x7f91540717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- 172.21.15.91:0/3078407907 shutdown_connections 2023-12-13T22:26:45.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- 172.21.15.91:0/3078407907 wait complete. 2023-12-13T22:26:45.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 Processor -- start 2023-12-13T22:26:45.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- start start 2023-12-13T22:26:45.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 0x7f91541f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91540c4f80 0x7f91541f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915413d010 0x7f915413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915413fa40 con 0x7f915406eed0 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540cc1b0 con 0x7f91540c4f80 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.740+0000 7f915ac03640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91541f36b0 con 0x7f915413d010 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7f57277fe640 1 -- 172.21.15.91:0/704083074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57280cb7d0 msgr2=0x7f57281438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7f57277fe640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57280cb7d0 0x7f57281438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7f57277fe640 1 -- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572814ff30 msgr2=0x7f57281477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7f57277fe640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f572814ff30 0x7f57281477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7f57277fe640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0094d0 con 0x7f572815a050 2023-12-13T22:26:45.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.744+0000 7ff7bda13640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 0x7ff7b8160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.748+0000 7ff7bda13640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 0x7ff7b8160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54384/0 (socket says 172.21.15.91:54384) 2023-12-13T22:26:45.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.748+0000 7ff7bda13640 1 -- 172.21.15.91:0/59251579 learned_addr learned my addr 172.21.15.91:0/59251579 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.752+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8a9c005470 con 0x7f8aac163620 2023-12-13T22:26:45.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.752+0000 7f8a93fff640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8a98066870 0x7f8a98068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.752+0000 7f8aab7fe640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8a98066870 0x7f8a98068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.752+0000 7f8aab7fe640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8a98066870 0x7f8a98068d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00b2000 tx=0x7f8aa00a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64180b7650 con 0x7f64280726d0 2023-12-13T22:26:45.753 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64180b77d0 con 0x7f64280726d0 2023-12-13T22:26:45.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64180b7b80 con 0x7f64280726d0 2023-12-13T22:26:45.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642806b010 con 0x7f64280726d0 2023-12-13T22:26:45.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642806b2b0 con 0x7f64280726d0 2023-12-13T22:26:45.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6428072b40 con 0x7f64280726d0 2023-12-13T22:26:45.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.756+0000 7f3327fff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3328160eb0 0x7f3328148dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f331800b410 tx=0x7f3318009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a9c0556c0 con 0x7f8aac163620 2023-12-13T22:26:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8a93fff640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f8a9806fdb0 0x7f8a980721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a980728c0 con 0x7f8a9806fdb0 2023-12-13T22:26:45.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c0017a0 con 0x7f8aac163620 2023-12-13T22:26:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8aabfff640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f8a9806fdb0 0x7f8a980721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8aabfff640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f8a9806fdb0 0x7f8a980721f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== osd.2 v2:172.21.15.91:6826/4024773626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8a980728c0 con 0x7f8a9806fdb0 2023-12-13T22:26:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7ff7bda13640 1 -- 172.21.15.91:0/59251579 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7b80722f0 msgr2=0x7ff7b81f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7ff7bda13640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7b80722f0 0x7ff7b81f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7ff7bda13640 1 -- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 msgr2=0x7ff7b80c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7ff7bda13640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff7b80c66d0 0x7ff7b80c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.760+0000 7ff7bda13640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009420 con 0x7ff7b8159a20 2023-12-13T22:26:45.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.764+0000 7f57277fe640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 0x7f5728145480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f572000b970 tx=0x7f572000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011830 con 0x7f3328160eb0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318011990 con 0x7f3328160eb0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011d20 con 0x7f3328160eb0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332814a830 con 0x7f3328160eb0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332814c560 con 0x7f3328160eb0 2023-12-13T22:26:45.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f915899f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 0x7f91541f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3328071740 con 0x7f3328160eb0 2023-12-13T22:26:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f915899f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 0x7f91541f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58082/0 (socket says 172.21.15.91:58082) 2023-12-13T22:26:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.772+0000 7f915899f640 1 -- 172.21.15.91:0/3117818576 learned_addr learned my addr 172.21.15.91:0/3117818576 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f91591a0640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915413d010 0x7f915413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00935f0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0093750 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b8171850 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0093b00 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b8171e10 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 --> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8aac169de0 con 0x7f8a9806fdb0 2023-12-13T22:26:45.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1b80074d0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.775 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8a93fff640 1 -- 172.21.15.91:0/1621181652 <== osd.2 v2:172.21.15.91:6826/4024773626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8aa4007670 con 0x7f8a9806fdb0 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f8a9806fdb0 msgr2=0x7f8a980721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f8a9806fdb0 0x7f8a980721f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8a98066870 msgr2=0x7f8a98068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8a98066870 0x7f8a98068d30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00b2000 tx=0x7f8aa00a9070 comp rx=0 tx=0).stop 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8aac163620 msgr2=0x7f8aac15bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 --2- 172.21.15.91:0/1621181652 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8aac163620 0x7f8aac15bf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c680 tx=0x7f8a9c00cb40 comp rx=0 tx=0).stop 2023-12-13T22:26:45.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8aabfff640 1 -- 172.21.15.91:0/1621181652 reap_dead start 2023-12-13T22:26:45.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 shutdown_connections 2023-12-13T22:26:45.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 >> 172.21.15.91:0/1621181652 conn(0x7f8aac06a560 msgr2=0x7f8aac0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 shutdown_connections 2023-12-13T22:26:45.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f8ab0ec3640 1 -- 172.21.15.91:0/1621181652 wait complete. 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572000cae0 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572000cc60 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.776+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720014440 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728144450 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57281f2000 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5728073e70 con 0x7f572815a050 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f915899f640 1 -- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915413d010 msgr2=0x7f915413f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f915899f640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f915413d010 0x7f915413f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f915899f640 1 -- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91540c4f80 msgr2=0x7f91541f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f915899f640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91540c4f80 0x7f91541f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7f915899f640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400094d0 con 0x7f915406eed0 2023-12-13T22:26:45.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.780+0000 7ff7bda13640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 0x7ff7b8160050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000cbc0 tx=0x7ff7b000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.791 INFO:teuthology.orchestra.run.smithi091.stdout:64424509462 2023-12-13T22:26:45.792 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-13T22:26:45.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.804+0000 7f915899f640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 0x7f91541f0140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f914800b580 tx=0x7f914800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.804+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd1c009d3a0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.804+0000 7fd1bd7fa640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd1a40667f0 0x7fd1a4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.804+0000 7fd1c4c5e640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd1a40667f0 0x7fd1a4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.803 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.804+0000 7fd1c4c5e640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd1a40667f0 0x7fd1a4068cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40ad000 tx=0x7fd1b4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.808+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1c00cfed0 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.808+0000 7fd1bd7fa640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7fd1a406fcb0 0x7fd1a40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.808+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1a40727c0 con 0x7fd1a406fcb0 2023-12-13T22:26:45.808 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.808+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1c00cbb10 con 0x7fd1b80d6ef0 2023-12-13T22:26:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.808+0000 7fd1bffff640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7fd1a406fcb0 0x7fd1a40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.812+0000 7fd1bffff640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7fd1a406fcb0 0x7fd1a40720f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.812+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== osd.6 v2:172.21.15.152:6800/3653290810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd1a40727c0 con 0x7fd1a406fcb0 2023-12-13T22:26:45.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.824+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8670007070 con 0x7f86780c6de0 2023-12-13T22:26:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.824+0000 7f865ffff640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8664066870 0x7f8664068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.824+0000 7f86767fc640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8664066870 0x7f8664068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.824+0000 7f86767fc640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8664066870 0x7f8664068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f86680ad000 tx=0x7f8668008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 --> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1b8049ea0 con 0x7fd1a406fcb0 2023-12-13T22:26:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1bd7fa640 1 -- 172.21.15.91:0/4286033957 <== osd.6 v2:172.21.15.152:6800/3653290810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1b8049ea0 con 0x7fd1a406fcb0 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7fd1a406fcb0 msgr2=0x7fd1a40720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7fd1a406fcb0 0x7fd1a40720f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd1a40667f0 msgr2=0x7fd1a4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd1a40667f0 0x7fd1a4068cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40ad000 tx=0x7fd1b4004740 comp rx=0 tx=0).stop 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 msgr2=0x7fd1b80d4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 --2- 172.21.15.91:0/4286033957 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd1b80d6ef0 0x7fd1b80d4f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1c004fb60 tx=0x7fd1c00680c0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c545f640 1 -- 172.21.15.91:0/4286033957 reap_dead start 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 shutdown_connections 2023-12-13T22:26:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 >> 172.21.15.91:0/4286033957 conn(0x7fd1b8050160 msgr2=0x7fd1b80db940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 shutdown_connections 2023-12-13T22:26:45.829 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.828+0000 7fd1c6ec2640 1 -- 172.21.15.91:0/4286033957 wait complete. 2023-12-13T22:26:45.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f64180b7ce0 con 0x7f64280726d0 2023-12-13T22:26:45.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f6424ff9640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64140667f0 0x7f6414068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f6427fff640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64140667f0 0x7f6414068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f6427fff640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64140667f0 0x7f6414068cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f641c005890 tx=0x7f641c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8670055840 con 0x7f86780c6de0 2023-12-13T22:26:45.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f865ffff640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f866406fdb0 0x7f86640721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86640728c0 con 0x7f866406fdb0 2023-12-13T22:26:45.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.840+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8670051b80 con 0x7f86780c6de0 2023-12-13T22:26:45.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.844+0000 7f86777fe640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f866406fdb0 0x7f86640721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.844+0000 7f86777fe640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f866406fdb0 0x7f86640721f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.844+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== osd.4 v2:172.21.15.152:6808/501453671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f86640728c0 con 0x7f866406fdb0 2023-12-13T22:26:45.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.844+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64180f0bc0 con 0x7f64280726d0 2023-12-13T22:26:45.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f6424ff9640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f641406fcb0 0x7f64140720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64140727c0 con 0x7f641406fcb0 2023-12-13T22:26:45.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f642cb6a640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f641406fcb0 0x7f64140720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f642cb6a640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f641406fcb0 0x7f64140720f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== osd.3 v2:172.21.15.91:6802/470541736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f64140727c0 con 0x7f641406fcb0 2023-12-13T22:26:45.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.848+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f572001d3b0 con 0x7f572815a050 2023-12-13T22:26:45.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f570f7fe640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5714066840 0x7f5714068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f5726ffd640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5714066840 0x7f5714068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.849 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f5726ffd640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5714066840 0x7f5714068d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5718007fd0 tx=0x7f57180079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.850 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148010870 con 0x7f915406eed0 2023-12-13T22:26:45.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91480109f0 con 0x7f915406eed0 2023-12-13T22:26:45.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915413fc60 con 0x7f915406eed0 2023-12-13T22:26:45.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148010da0 con 0x7f915406eed0 2023-12-13T22:26:45.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9154140220 con 0x7f915406eed0 2023-12-13T22:26:45.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.852+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f915406a760 con 0x7f915406eed0 2023-12-13T22:26:45.852 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:45.853 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-13T22:26:45.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.856+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5720055e10 con 0x7f572815a050 2023-12-13T22:26:45.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.856+0000 7f570f7fe640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7f571406fd80 0x7f57140721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.856+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5714072890 con 0x7f571406fd80 2023-12-13T22:26:45.856 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.856+0000 7f57267fc640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7f571406fd80 0x7f57140721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.860+0000 7f57267fc640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7f571406fd80 0x7f57140721c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.860+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== osd.1 v2:172.21.15.91:6810/4169058440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5714072890 con 0x7f571406fd80 2023-12-13T22:26:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.868+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000ad40 con 0x7ff7b8159a20 2023-12-13T22:26:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.868+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0012400 con 0x7ff7b8159a20 2023-12-13T22:26:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.868+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b8143db0 con 0x7ff7b8159a20 2023-12-13T22:26:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.868+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000aea0 con 0x7ff7b8159a20 2023-12-13T22:26:45.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.868+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b81f1d70 con 0x7ff7b8159a20 2023-12-13T22:26:45.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.872+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7b81505b0 con 0x7ff7b8159a20 2023-12-13T22:26:45.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.872+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 --> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86780c26b0 con 0x7f866406fdb0 2023-12-13T22:26:45.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f865ffff640 1 -- 172.21.15.91:0/2921700447 <== osd.4 v2:172.21.15.152:6808/501453671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f866c0011a0 con 0x7f866406fdb0 2023-12-13T22:26:45.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 --> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6428156d10 con 0x7f641406fcb0 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f866406fdb0 msgr2=0x7f86640721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f866406fdb0 0x7f86640721f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8664066870 msgr2=0x7f8664068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8664066870 0x7f8664068d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f86680ad000 tx=0x7f8668008040 comp rx=0 tx=0).stop 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 msgr2=0x7f86780c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 --2- 172.21.15.91:0/2921700447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f86780c6de0 0x7f86780c5060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f867000cba0 tx=0x7f867000a430 comp rx=0 tx=0).stop 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f86777fe640 1 -- 172.21.15.91:0/2921700447 reap_dead start 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 shutdown_connections 2023-12-13T22:26:45.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 >> 172.21.15.91:0/2921700447 conn(0x7f86780c73c0 msgr2=0x7f86781664b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f6424ff9640 1 -- 172.21.15.91:0/1416483531 <== osd.3 v2:172.21.15.91:6802/470541736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6420006b20 con 0x7f641406fcb0 2023-12-13T22:26:45.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 shutdown_connections 2023-12-13T22:26:45.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f867da3e640 1 -- 172.21.15.91:0/2921700447 wait complete. 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f641406fcb0 msgr2=0x7f64140720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f641406fcb0 0x7f64140720f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64140667f0 msgr2=0x7f6414068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64140667f0 0x7f6414068cb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f641c005890 tx=0x7f641c009040 comp rx=0 tx=0).stop 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 msgr2=0x7f6428143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 --2- 172.21.15.91:0/1416483531 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64280726d0 0x7f6428143770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f64180097c0 tx=0x7f641801cdd0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642cb6a640 1 -- 172.21.15.91:0/1416483531 reap_dead start 2023-12-13T22:26:45.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 shutdown_connections 2023-12-13T22:26:45.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 >> 172.21.15.91:0/1416483531 conn(0x7f642806b670 msgr2=0x7f6428142150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 shutdown_connections 2023-12-13T22:26:45.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.876+0000 7f642e5cd640 1 -- 172.21.15.91:0/1416483531 wait complete. 2023-12-13T22:26:45.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.888+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 --> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57280c5800 con 0x7f571406fd80 2023-12-13T22:26:45.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f570f7fe640 1 -- 172.21.15.91:0/704083074 <== osd.1 v2:172.21.15.91:6810/4169058440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57280c5800 con 0x7f571406fd80 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7f571406fd80 msgr2=0x7f57140721c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7f571406fd80 0x7f57140721c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5714066840 msgr2=0x7f5714068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5714066840 0x7f5714068d00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5718007fd0 tx=0x7f57180079a0 comp rx=0 tx=0).stop 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 msgr2=0x7f5728145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 --2- 172.21.15.91:0/704083074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f572815a050 0x7f5728145480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f572000b970 tx=0x7f572000be30 comp rx=0 tx=0).stop 2023-12-13T22:26:45.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f57277fe640 1 -- 172.21.15.91:0/704083074 reap_dead start 2023-12-13T22:26:45.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 shutdown_connections 2023-12-13T22:26:45.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 >> 172.21.15.91:0/704083074 conn(0x7f572806d220 msgr2=0x7f572815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:45.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 shutdown_connections 2023-12-13T22:26:45.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.892+0000 7f572d734640 1 -- 172.21.15.91:0/704083074 wait complete. 2023-12-13T22:26:45.894 INFO:teuthology.orchestra.run.smithi091.stdout:68719476760 2023-12-13T22:26:45.894 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-13T22:26:45.895 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:45.895 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-13T22:26:45.913 INFO:teuthology.orchestra.run.smithi091.stdout:68719476760 2023-12-13T22:26:45.914 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-13T22:26:45.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.932+0000 7f9f37a8d640 1 Processor -- start 2023-12-13T22:26:45.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.936+0000 7f9f37a8d640 1 -- start start 2023-12-13T22:26:45.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.936+0000 7f9f37a8d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.936+0000 7f9f37a8d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3015a7f0 con 0x7f9f30151600 2023-12-13T22:26:45.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.936+0000 7f9f37a8d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3006ac90 con 0x7f9f3015b520 2023-12-13T22:26:45.935 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.936+0000 7f9f37a8d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3006af70 con 0x7f9f300c6fb0 2023-12-13T22:26:45.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.960+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f331801a400 con 0x7f3328160eb0 2023-12-13T22:26:45.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.960+0000 7f330ffff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3314066840 0x7f3314068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.960+0000 7f33277fe640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3314066840 0x7f3314068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.960+0000 7f33277fe640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3314066840 0x7f3314068d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3320001c90 tx=0x7f3320007d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3318055de0 con 0x7f3328160eb0 2023-12-13T22:26:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f330ffff640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f331406fd80 0x7f33140721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3314072890 con 0x7f331406fd80 2023-12-13T22:26:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3318011e80 con 0x7f3328160eb0 2023-12-13T22:26:45.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f3326ffd640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f331406fd80 0x7f33140721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f3326ffd640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f331406fd80 0x7f33140721c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.972+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== osd.7 v2:172.21.15.152:6816/1599476558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3314072890 con 0x7f331406fd80 2023-12-13T22:26:45.983 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.984+0000 7f9f3602a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 Processor -- start 2023-12-13T22:26:45.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 -- start start 2023-12-13T22:26:45.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcc080c65f0 0x7fcc08159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc080c2440 con 0x7fcc080cc0c0 2023-12-13T22:26:45.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc080c2720 con 0x7fcc080cbce0 2023-12-13T22:26:45.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7fcc10525640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc080c2a00 con 0x7fcc080c65f0 2023-12-13T22:26:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7f9f3602a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45558/0 (socket says 172.21.15.91:45558) 2023-12-13T22:26:45.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.988+0000 7f9f3602a640 1 -- 172.21.15.91:0/1022834570 learned_addr learned my addr 172.21.15.91:0/1022834570 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:45.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.992+0000 7f9f3602a640 1 -- 172.21.15.91:0/1022834570 >> v1:172.21.15.152:6789/0 conn(0x7f9f3015b520 legacy=0x7f9f300c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.992+0000 7f9f3602a640 1 -- 172.21.15.91:0/1022834570 >> v1:172.21.15.91:6789/0 conn(0x7f9f30151600 legacy=0x7f9f30157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:45.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.992+0000 7f9f3602a640 1 -- 172.21.15.91:0/1022834570 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3015aa40 con 0x7f9f300c6fb0 2023-12-13T22:26:45.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.996+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f914800f3c0 con 0x7f915406eed0 2023-12-13T22:26:45.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.996+0000 7f91517fa640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f91380667f0 0x7f9138068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.996+0000 7f9153fff640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f91380667f0 0x7f9138068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:45.996+0000 7f9153fff640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f91380667f0 0x7f9138068cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91400ae000 tx=0x7f9140008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9148055cd0 con 0x7f915406eed0 2023-12-13T22:26:45.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91517fa640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f913806fcb0 0x7f91380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91380727c0 con 0x7f913806fcb0 2023-12-13T22:26:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9148051910 con 0x7f915406eed0 2023-12-13T22:26:45.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91591a0640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f913806fcb0 0x7f91380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:45.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f9f3602a640 1 --2- 172.21.15.91:0/1022834570 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009e80 tx=0x7f9f2801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41a7479d14015453 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:45.999 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91591a0640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f913806fcb0 0x7f91380720f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== osd.5 v2:172.21.15.152:6824/489484286 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f91380727c0 con 0x7f913806fcb0 2023-12-13T22:26:46.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.000+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 --> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3328071d50 con 0x7f331406fd80 2023-12-13T22:26:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f330ffff640 1 -- 172.21.15.91:0/2808850941 <== osd.7 v2:172.21.15.152:6816/1599476558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f331c0ac440 con 0x7f331406fd80 2023-12-13T22:26:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f34827640 1 -- 172.21.15.91:0/1022834570 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280a5630 con 0x7f9f300c6fb0 2023-12-13T22:26:46.003 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f34827640 1 -- 172.21.15.91:0/1022834570 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280a5790 con 0x7f9f300c6fb0 2023-12-13T22:26:46.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f331406fd80 msgr2=0x7f33140721c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.004 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f332e190640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f331406fd80 0x7f33140721c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f34827640 1 -- 172.21.15.91:0/1022834570 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280a5b20 con 0x7f9f300c6fb0 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f37a8d640 1 -- 172.21.15.91:0/1022834570 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 msgr2=0x7f9f300c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/1022834570 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009e80 tx=0x7f9f2801c9b0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f37a8d640 1 -- 172.21.15.91:0/1022834570 shutdown_connections 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/1022834570 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f300c6fb0 0x7f9f300c5290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.004+0000 7f9f37a8d640 1 -- 172.21.15.91:0/1022834570 >> 172.21.15.91:0/1022834570 conn(0x7f9f30070160 msgr2=0x7f9f3006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- 172.21.15.91:0/1022834570 shutdown_connections 2023-12-13T22:26:46.005 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- 172.21.15.91:0/1022834570 wait complete. 2023-12-13T22:26:46.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3314066840 msgr2=0x7f3314068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3314066840 0x7f3314068d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3320001c90 tx=0x7f3320007d20 comp rx=0 tx=0).stop 2023-12-13T22:26:46.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 Processor -- start 2023-12-13T22:26:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3328160eb0 msgr2=0x7f3328148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 --2- 172.21.15.91:0/2808850941 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f3328160eb0 0x7f3328148dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f331800b410 tx=0x7f3318009f90 comp rx=0 tx=0).stop 2023-12-13T22:26:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f3327fff640 1 -- 172.21.15.91:0/2808850941 reap_dead start 2023-12-13T22:26:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7fcc0eac2640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fcc080cc0c0 0x7fcc08153210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42246/0 (socket says 172.21.15.91:42246) 2023-12-13T22:26:46.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7fcc0eac2640 1 -- 172.21.15.91:0/2338476509 learned_addr learned my addr 172.21.15.91:0/2338476509 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- start start 2023-12-13T22:26:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f300c6fb0 0x7f9f3014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f30151600 0x7f9f301f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c4960 con 0x7f9f300c6fb0 2023-12-13T22:26:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300b1b30 con 0x7f9f30151600 2023-12-13T22:26:46.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f9f37a8d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cc880 con 0x7f9f3015b520 2023-12-13T22:26:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 shutdown_connections 2023-12-13T22:26:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 >> 172.21.15.91:0/2808850941 conn(0x7f332806c6a0 msgr2=0x7f33280c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.008+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 shutdown_connections 2023-12-13T22:26:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.012+0000 7f332e190640 1 -- 172.21.15.91:0/2808850941 wait complete. 2023-12-13T22:26:46.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.012+0000 7fcc0dac0640 1 --2- 172.21.15.91:0/2338476509 >> v2:172.21.15.152:3300/0 conn(0x7fcc080c65f0 0x7fcc08159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.012+0000 7f9f3602a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.012+0000 7f9f3602a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45574/0 (socket says 172.21.15.91:45574) 2023-12-13T22:26:46.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.012+0000 7f9f3602a640 1 -- 172.21.15.91:0/512376204 learned_addr learned my addr 172.21.15.91:0/512376204 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.016+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184051223 0 0) 0x7fcc080c2440 con 0x7fcc080cc0c0 2023-12-13T22:26:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.016+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf4003530 con 0x7fcc080cc0c0 2023-12-13T22:26:46.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.016+0000 7f9f35829640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f300c6fb0 0x7f9f3014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.017 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 --> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f915406f310 con 0x7f913806fcb0 2023-12-13T22:26:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f9f3602a640 1 -- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f30151600 msgr2=0x7f9f301f9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f9f3602a640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f30151600 0x7f9f301f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f9f3602a640 1 -- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f300c6fb0 msgr2=0x7f9f3014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f9f3602a640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f300c6fb0 0x7f9f3014c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.018 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f9f3602a640 1 -- 172.21.15.91:0/512376204 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009b30 con 0x7f9f3015b520 2023-12-13T22:26:46.019 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f91517fa640 1 -- 172.21.15.91:0/3117818576 <== osd.5 v2:172.21.15.152:6824/489484286 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f914c009ab0 con 0x7f913806fcb0 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f913806fcb0 msgr2=0x7f91380720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f913806fcb0 0x7f91380720f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f91380667f0 msgr2=0x7f9138068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f91380667f0 0x7f9138068cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91400ae000 tx=0x7f9140008040 comp rx=0 tx=0).stop 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.020+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 msgr2=0x7f91541f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f915ac03640 1 --2- 172.21.15.91:0/3117818576 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f915406eed0 0x7f91541f0140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f914800b580 tx=0x7f914800ba40 comp rx=0 tx=0).stop 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f91591a0640 1 -- 172.21.15.91:0/3117818576 reap_dead start 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 shutdown_connections 2023-12-13T22:26:46.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 >> 172.21.15.91:0/3117818576 conn(0x7f91540713a0 msgr2=0x7f9154157700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 shutdown_connections 2023-12-13T22:26:46.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f9f3602a640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f2801b060 tx=0x7f9f28019750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.024+0000 7f915ac03640 1 -- 172.21.15.91:0/3117818576 wait complete. 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218601394 0 0) 0x7fcbf4003530 con 0x7fcc080cc0c0 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 >> v2:172.21.15.152:3300/0 conn(0x7fcc080c65f0 msgr2=0x7fcc08159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 --2- 172.21.15.91:0/2338476509 >> v2:172.21.15.152:3300/0 conn(0x7fcc080c65f0 0x7fcc08159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 >> v1:172.21.15.152:6789/0 conn(0x7fcc080cbce0 legacy=0x7fcc08072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08159570 con 0x7fcc080cc0c0 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fcc00001a00 con 0x7fcc080cc0c0 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 >> v1:172.21.15.91:6789/0 conn(0x7fcc080cc0c0 legacy=0x7fcc08153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf4003a40 0x7fcbf4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.027 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf40047d0 0x7fcbf4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 0x7fcbf400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080c2a00 con 0x7fcbf40052b0 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf400c170 con 0x7fcbf40047d0 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf400c330 con 0x7fcbf4003a40 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280b8670 con 0x7f9f3015b520 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280b87d0 con 0x7f9f3015b520 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280b8b80 con 0x7f9f3015b520 2023-12-13T22:26:46.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300cc5a0 con 0x7f9f3015b520 2023-12-13T22:26:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.028+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300b1050 con 0x7f9f3015b520 2023-12-13T22:26:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.032+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f30073e70 con 0x7f9f3015b520 2023-12-13T22:26:46.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.032+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 0x7fcbf400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.036+0000 7fcc0eac2640 1 -- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf4003a40 msgr2=0x7fcbf4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.036+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf4003a40 0x7fcbf4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.036+0000 7fcc0eac2640 1 -- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf40047d0 msgr2=0x7fcbf4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.036+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcbf40047d0 0x7fcbf4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.036+0000 7fcc0eac2640 1 -- 172.21.15.91:0/2338476509 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4003530 con 0x7fcbf40052b0 2023-12-13T22:26:46.037 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:46.038 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-13T22:26:46.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.040+0000 7fcc0eac2640 1 -- 172.21.15.91:0/2338476509 reap_dead start 2023-12-13T22:26:46.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.044+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 0x7fcbf400b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000a740 tx=0x7fcc0001d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a823ae435c7f6206 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac620 con 0x7fcbf40052b0 2023-12-13T22:26:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000a8070 con 0x7fcbf40052b0 2023-12-13T22:26:46.045 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc0d2bf640 1 -- 172.21.15.91:0/2338476509 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000ac9c0 con 0x7fcbf40052b0 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 msgr2=0x7fcbf400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 0x7fcbf400b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000a740 tx=0x7fcc0001d240 comp rx=0 tx=0).stop 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- 172.21.15.91:0/2338476509 shutdown_connections 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 --2- 172.21.15.91:0/2338476509 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcbf40052b0 0x7fcbf400b990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- 172.21.15.91:0/2338476509 >> 172.21.15.91:0/2338476509 conn(0x7fcc08070160 msgr2=0x7fcc0806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- 172.21.15.91:0/2338476509 shutdown_connections 2023-12-13T22:26:46.046 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- 172.21.15.91:0/2338476509 wait complete. 2023-12-13T22:26:46.048 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:46.049 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-13T22:26:46.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 Processor -- start 2023-12-13T22:26:46.049 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.048+0000 7fcc10525640 1 -- start start 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf40052b0 0x7fcc080c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc080abd30 0x7fcc081f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080a8c20 con 0x7fcc080b1950 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080ac430 con 0x7fcc080abd30 2023-12-13T22:26:46.050 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc10525640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080b1ed0 con 0x7fcbf40052b0 2023-12-13T22:26:46.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff7b0007070 con 0x7ff7b8159a20 2023-12-13T22:26:46.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7ff7adffb640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff79c066840 0x7ff79c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7ff7bd212640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff79c066840 0x7ff79c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc0eac2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc0eac2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58110/0 (socket says 172.21.15.91:58110) 2023-12-13T22:26:46.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.052+0000 7fcc0eac2640 1 -- 172.21.15.91:0/1635621381 learned_addr learned my addr 172.21.15.91:0/1635621381 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7ff7bd212640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff79c066840 0x7ff79c068d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009690 tx=0x7ff7b4006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7fcc0eac2640 1 -- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf40052b0 msgr2=0x7fcc080c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf40052b0 0x7fcc080c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7fcc0eac2640 1 -- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc080abd30 msgr2=0x7fcc081f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc080abd30 0x7fcc081f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.056+0000 7fcc0eac2640 1 -- 172.21.15.91:0/1635621381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080a9870 con 0x7fcc080b1950 2023-12-13T22:26:46.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.060+0000 7fcc0eac2640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000a030 tx=0x7fcbf4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7b0055820 con 0x7ff7b8159a20 2023-12-13T22:26:46.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7adffb640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7ff79c06fd80 0x7ff79c0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff79c072890 con 0x7ff79c06fd80 2023-12-13T22:26:46.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7bca11640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7ff79c06fd80 0x7ff79c0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7bca11640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7ff79c06fd80 0x7ff79c0721c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7b0051b60 con 0x7ff7b8159a20 2023-12-13T22:26:46.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00004b70 con 0x7fcc080b1950 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== osd.0 v2:172.21.15.91:6818/2717992016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff79c072890 con 0x7ff79c06fd80 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00004cd0 con 0x7fcc080b1950 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000b86c0 con 0x7fcc080b1950 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc080a92b0 con 0x7fcc080b1950 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc080a8560 con 0x7fcc080b1950 2023-12-13T22:26:46.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.064+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc08073e70 con 0x7fcc080b1950 2023-12-13T22:26:46.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 Processor -- start 2023-12-13T22:26:46.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 -- start start 2023-12-13T22:26:46.071 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc4ec0c8360 0x7fc4ec169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec161840 con 0x7fc4ec157680 2023-12-13T22:26:46.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec161cd0 con 0x7fc4ec157a60 2023-12-13T22:26:46.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7fc4f41c2640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec06bdd0 con 0x7fc4ec0c8360 2023-12-13T22:26:46.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7f520dae8640 1 Processor -- start 2023-12-13T22:26:46.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.072+0000 7f520dae8640 1 -- start start 2023-12-13T22:26:46.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.076+0000 7f520dae8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f52080c1ed0 0x7f52080c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.076+0000 7f520dae8640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080c6580 con 0x7f5208152bf0 2023-12-13T22:26:46.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.076+0000 7f520dae8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5208152fd0 con 0x7f52080c6cd0 2023-12-13T22:26:46.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.076+0000 7f520dae8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5208072a00 con 0x7f52080c1ed0 2023-12-13T22:26:46.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.080+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9f280b8ce0 con 0x7f9f3015b520 2023-12-13T22:26:46.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.080+0000 7f9f267fc640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 0x7f9f14068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.080+0000 7f9f35829640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 0x7f9f14068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.080+0000 7f9f35829640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 0x7f9f14068cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c007fd0 tx=0x7f9f2c007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.086 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 --> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7b8156d10 con 0x7ff79c06fd80 2023-12-13T22:26:46.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7adffb640 1 -- 172.21.15.91:0/59251579 <== osd.0 v2:172.21.15.91:6818/2717992016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7a80ac5e0 con 0x7ff79c06fd80 2023-12-13T22:26:46.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fcc000aa070 con 0x7fcc080b1950 2023-12-13T22:26:46.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7fcbfeffd640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 0x7fcbec068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7ff79c06fd80 msgr2=0x7ff79c0721c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7ff79c06fd80 0x7ff79c0721c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7fcc0e2c1640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 0x7fcbec068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff79c066840 msgr2=0x7ff79c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff79c066840 0x7ff79c068d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009690 tx=0x7ff7b4006c00 comp rx=0 tx=0).stop 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 msgr2=0x7ff7b8160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 --2- 172.21.15.91:0/59251579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7b8159a20 0x7ff7b8160050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000cbc0 tx=0x7ff7b000a430 comp rx=0 tx=0).stop 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bda13640 1 -- 172.21.15.91:0/59251579 reap_dead start 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7fcc0e2c1640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 0x7fcbec068d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007fd0 tx=0x7fcc040079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 shutdown_connections 2023-12-13T22:26:46.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 >> 172.21.15.91:0/59251579 conn(0x7ff7b806b670 msgr2=0x7ff7b8141490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 shutdown_connections 2023-12-13T22:26:46.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.088+0000 7ff7bf476640 1 -- 172.21.15.91:0/59251579 wait complete. 2023-12-13T22:26:46.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.092+0000 7fc4f275f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc4ec0c8360 0x7fc4ec169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.096+0000 7fc4f275f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc4ec0c8360 0x7fc4ec169110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54418/0 (socket says 172.21.15.91:54418) 2023-12-13T22:26:46.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.096+0000 7fc4f275f640 1 -- 172.21.15.91:0/665128162 learned_addr learned my addr 172.21.15.91:0/665128162 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.100+0000 7f5207fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f52080c6cd0 0x7f520815fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52618/0 (socket says 172.21.15.91:52618) 2023-12-13T22:26:46.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.100+0000 7f5207fff640 1 -- 172.21.15.91:0/4294606927 learned_addr learned my addr 172.21.15.91:0/4294606927 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:46.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.104+0000 7fc4f275f640 1 -- 172.21.15.91:0/665128162 >> v1:172.21.15.152:6789/0 conn(0x7fc4ec157a60 legacy=0x7fc4ec0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.104+0000 7fc4f275f640 1 -- 172.21.15.91:0/665128162 >> v1:172.21.15.91:6789/0 conn(0x7fc4ec157680 legacy=0x7fc4ec0c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.104+0000 7fc4f275f640 1 -- 172.21.15.91:0/665128162 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec15e540 con 0x7fc4ec0c8360 2023-12-13T22:26:46.105 INFO:teuthology.orchestra.run.smithi091.stdout:60129542166 2023-12-13T22:26:46.106 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-13T22:26:46.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7fc4f275f640 1 --2- 172.21.15.91:0/665128162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec169110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009e50 tx=0x7fc4e401f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e37a422f526d6a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 Processor -- start 2023-12-13T22:26:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 -- start start 2023-12-13T22:26:46.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2bf40722f0 0x7f2bf40726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf4159590 con 0x7f2bf40c66d0 2023-12-13T22:26:46.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf4156190 con 0x7f2bf415a130 2023-12-13T22:26:46.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.112+0000 7f2bf9c7a640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf4155fa0 con 0x7f2bf40722f0 2023-12-13T22:26:46.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.116+0000 7f5206ffd640 1 --2- 172.21.15.91:0/4294606927 >> v2:172.21.15.152:3300/0 conn(0x7f52080c1ed0 0x7f52080c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.132+0000 7f5206ffd640 1 -- 172.21.15.91:0/4294606927 >> v1:172.21.15.152:6789/0 conn(0x7f52080c6cd0 legacy=0x7f520815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.132+0000 7f5206ffd640 1 -- 172.21.15.91:0/4294606927 >> v1:172.21.15.91:6789/0 conn(0x7f5208152bf0 legacy=0x7f5208155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.132+0000 7f5206ffd640 1 -- 172.21.15.91:0/4294606927 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080c5fc0 con 0x7f52080c1ed0 2023-12-13T22:26:46.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.136+0000 7f2bf37fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2bf40722f0 0x7f2bf40726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.136+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc00004e40 con 0x7fcc080b1950 2023-12-13T22:26:46.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.140+0000 7f5206ffd640 1 --2- 172.21.15.91:0/4294606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52080c1ed0 0x7f52080c7a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009fd0 tx=0x7f51f001d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232ebb391550f0dd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.148+0000 7f2bf3fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2bf415a130 0x7f2bf4160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52634/0 (socket says 172.21.15.91:52634) 2023-12-13T22:26:46.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.148+0000 7f2bf3fff640 1 -- 172.21.15.91:0/1084260988 learned_addr learned my addr 172.21.15.91:0/1084260988 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:46.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f0f5c640 1 -- 172.21.15.91:0/665128162 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40af400 con 0x7fc4ec0c8360 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f0f5c640 1 -- 172.21.15.91:0/665128162 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e40ab050 con 0x7fc4ec0c8360 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f0f5c640 1 -- 172.21.15.91:0/665128162 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40af780 con 0x7fc4ec0c8360 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 -- 172.21.15.91:0/665128162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 msgr2=0x7fc4ec169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/665128162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec169110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009e50 tx=0x7fc4e401f180 comp rx=0 tx=0).stop 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 -- 172.21.15.91:0/665128162 shutdown_connections 2023-12-13T22:26:46.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/665128162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec169110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 -- 172.21.15.91:0/665128162 >> 172.21.15.91:0/665128162 conn(0x7fc4ec0713a0 msgr2=0x7fc4ec0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 -- 172.21.15.91:0/665128162 shutdown_connections 2023-12-13T22:26:46.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 -- 172.21.15.91:0/665128162 wait complete. 2023-12-13T22:26:46.152 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.152+0000 7fc4f41c2640 1 Processor -- start 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 -- start start 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc4ec157680 0x7fc4ec159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4ec157a60 0x7fc4ec159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f41b0 con 0x7fc4ec157a60 2023-12-13T22:26:46.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec158870 con 0x7fc4ec0c8360 2023-12-13T22:26:46.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.156+0000 7fc4f41c2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f43c0 con 0x7fc4ec157680 2023-12-13T22:26:46.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.168+0000 7f2bf37fe640 1 -- 172.21.15.91:0/1084260988 >> v1:172.21.15.152:6789/0 conn(0x7f2bf415a130 legacy=0x7f2bf4160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.168+0000 7f2bf37fe640 1 -- 172.21.15.91:0/1084260988 >> v1:172.21.15.91:6789/0 conn(0x7f2bf40c66d0 legacy=0x7f2bf4159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.168+0000 7f2bf37fe640 1 -- 172.21.15.91:0/1084260988 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4156470 con 0x7f2bf40722f0 2023-12-13T22:26:46.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f52067fc640 1 -- 172.21.15.91:0/4294606927 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00ab670 con 0x7f52080c1ed0 2023-12-13T22:26:46.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f52067fc640 1 -- 172.21.15.91:0/4294606927 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f00ab7d0 con 0x7f52080c1ed0 2023-12-13T22:26:46.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f52067fc640 1 -- 172.21.15.91:0/4294606927 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00abb60 con 0x7f52080c1ed0 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 -- 172.21.15.91:0/4294606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52080c1ed0 msgr2=0x7f52080c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 --2- 172.21.15.91:0/4294606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52080c1ed0 0x7f52080c7a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009fd0 tx=0x7f51f001d520 comp rx=0 tx=0).stop 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 -- 172.21.15.91:0/4294606927 shutdown_connections 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 --2- 172.21.15.91:0/4294606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52080c1ed0 0x7f52080c7a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 -- 172.21.15.91:0/4294606927 >> 172.21.15.91:0/4294606927 conn(0x7f520806c6a0 msgr2=0x7f520806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 -- 172.21.15.91:0/4294606927 shutdown_connections 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.172+0000 7f520dae8640 1 -- 172.21.15.91:0/4294606927 wait complete. 2023-12-13T22:26:46.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 Processor -- start 2023-12-13T22:26:46.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 -- start start 2023-12-13T22:26:46.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52080c1ed0 0x7f5208154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52080c6cd0 0x7f520814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208148820 con 0x7f52080c6cd0 2023-12-13T22:26:46.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208153ce0 con 0x7f5208152bf0 2023-12-13T22:26:46.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.176+0000 7f520dae8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520814ae70 con 0x7f52080c1ed0 2023-12-13T22:26:46.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.180+0000 7f2bf37fe640 1 --2- 172.21.15.91:0/1084260988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf40722f0 0x7f2bf40726d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097c0 tx=0x7f2be401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa257dae5e32556 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 Processor -- start 2023-12-13T22:26:46.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 -- start start 2023-12-13T22:26:46.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2fc40722f0 0x7f2fc40726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2fc40c66d0 0x7f2fc40c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc4159590 con 0x7f2fc4159a20 2023-12-13T22:26:46.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4155fa0 con 0x7f2fc40722f0 2023-12-13T22:26:46.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.184+0000 7f2fcae85640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4072c10 con 0x7f2fc40c66d0 2023-12-13T22:26:46.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.188+0000 7fc4f1f5e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7fc4f1f5e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54450/0 (socket says 172.21.15.91:54450) 2023-12-13T22:26:46.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7fc4f1f5e640 1 -- 172.21.15.91:0/3517126418 learned_addr learned my addr 172.21.15.91:0/3517126418 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.189 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7f5207fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.191 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7f2fc9422640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2fc4159a20 0x7f2fc4159e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52642/0 (socket says 172.21.15.91:52642) 2023-12-13T22:26:46.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7f2fc9422640 1 -- 172.21.15.91:0/3557844285 learned_addr learned my addr 172.21.15.91:0/3557844285 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:46.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7f5207fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54456/0 (socket says 172.21.15.91:54456) 2023-12-13T22:26:46.192 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.192+0000 7f5207fff640 1 -- 172.21.15.91:0/3719471677 learned_addr learned my addr 172.21.15.91:0/3719471677 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf27fc640 1 -- 172.21.15.91:0/1084260988 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40ab600 con 0x7f2bf40722f0 2023-12-13T22:26:46.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf27fc640 1 -- 172.21.15.91:0/1084260988 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be40a7050 con 0x7f2bf40722f0 2023-12-13T22:26:46.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf27fc640 1 -- 172.21.15.91:0/1084260988 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40ab980 con 0x7f2bf40722f0 2023-12-13T22:26:46.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1084260988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf40722f0 msgr2=0x7f2bf40726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1084260988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf40722f0 0x7f2bf40726d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097c0 tx=0x7f2be401c3b0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1084260988 shutdown_connections 2023-12-13T22:26:46.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1084260988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf40722f0 0x7f2bf40726d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1084260988 >> 172.21.15.91:0/1084260988 conn(0x7f2bf406b670 msgr2=0x7f2bf406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1084260988 shutdown_connections 2023-12-13T22:26:46.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1084260988 wait complete. 2023-12-13T22:26:46.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 Processor -- start 2023-12-13T22:26:46.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.200+0000 7f2bf9c7a640 1 -- start start 2023-12-13T22:26:46.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bf40722f0 0x7f2bf40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2bf40c66d0 0x7f2bf4152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.201 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf406b030 con 0x7f2bf40722f0 2023-12-13T22:26:46.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40cbfb0 con 0x7f2bf415a130 2023-12-13T22:26:46.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f2bf9c7a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40cbcd0 con 0x7f2bf40c66d0 2023-12-13T22:26:46.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 Processor -- start 2023-12-13T22:26:46.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 -- start start 2023-12-13T22:26:46.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 0x7f429c157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f429c0c8e10 0x7f429c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c151950 con 0x7f429c151570 2023-12-13T22:26:46.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0c7d40 con 0x7f429c0c8e10 2023-12-13T22:26:46.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.204+0000 7f42a268b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0c8610 con 0x7f429c06a560 2023-12-13T22:26:46.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.208+0000 7f5207fff640 1 -- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52080c1ed0 msgr2=0x7f5208154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.208+0000 7f5207fff640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52080c1ed0 0x7f5208154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.208+0000 7f5207fff640 1 -- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52080c6cd0 msgr2=0x7f520814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.208+0000 7f5207fff640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52080c6cd0 0x7f520814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.206 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.208+0000 7f5207fff640 1 -- 172.21.15.91:0/3719471677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009cb0 con 0x7f5208152bf0 2023-12-13T22:26:46.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.216+0000 7f5207fff640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51f800cad0 tx=0x7f51f800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.216+0000 7fbad2175640 1 Processor -- start 2023-12-13T22:26:46.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.216+0000 7fbad2175640 1 -- start start 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc06adc0 0x7fbacc072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fbacc06b1a0 0x7fbacc159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbacc0c65f0 0x7fbacc1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0c2440 con 0x7fbacc06b1a0 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0c2720 con 0x7fbacc0c65f0 2023-12-13T22:26:46.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.220+0000 7fbad2175640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc0c2a00 con 0x7fbacc06adc0 2023-12-13T22:26:46.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.224+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/3557844285 >> v2:172.21.15.152:3300/0 conn(0x7f2fc40c66d0 0x7f2fc40c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800ac30 con 0x7f5208152bf0 2023-12-13T22:26:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f800ad90 con 0x7f5208152bf0 2023-12-13T22:26:46.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5208154b70 con 0x7f5208152bf0 2023-12-13T22:26:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8012620 con 0x7f5208152bf0 2023-12-13T22:26:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208153690 con 0x7f5208152bf0 2023-12-13T22:26:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.228+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.232+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208160c70 con 0x7f5208152bf0 2023-12-13T22:26:46.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.236+0000 7fc4f1f5e640 1 -- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc4ec157680 msgr2=0x7fc4ec159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.236+0000 7fc4f1f5e640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc4ec157680 0x7fc4ec159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.236+0000 7fc4f1f5e640 1 -- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4ec157a60 msgr2=0x7fc4ec159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.236+0000 7fc4f1f5e640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4ec157a60 0x7fc4ec159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.236+0000 7fc4f1f5e640 1 -- 172.21.15.91:0/3517126418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009b30 con 0x7fc4ec0c8360 2023-12-13T22:26:46.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.244+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54472/0 (socket says 172.21.15.91:54472) 2023-12-13T22:26:46.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.244+0000 7f2bf3fff640 1 -- 172.21.15.91:0/1963721526 learned_addr learned my addr 172.21.15.91:0/1963721526 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.248+0000 7f2fc3fff640 1 -- 172.21.15.91:0/3557844285 >> v2:172.21.15.91:3300/0 conn(0x7f2fc40722f0 msgr2=0x7f2fc40726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.248+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/3557844285 >> v2:172.21.15.91:3300/0 conn(0x7f2fc40722f0 0x7f2fc40726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.248+0000 7f2fc3fff640 1 -- 172.21.15.91:0/3557844285 >> v1:172.21.15.152:6789/0 conn(0x7f2fc4159a20 legacy=0x7f2fc4159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.248+0000 7f2fc3fff640 1 -- 172.21.15.91:0/3557844285 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4156190 con 0x7f2fc40c66d0 2023-12-13T22:26:46.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.252+0000 7fc4f1f5e640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800c490 tx=0x7fc4e8001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.260+0000 7fbacbfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbacc0c65f0 0x7fbacc1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.268+0000 7fbacbfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbacc0c65f0 0x7fbacc1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54474/0 (socket says 172.21.15.91:54474) 2023-12-13T22:26:46.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.268+0000 7fbacbfff640 1 -- 172.21.15.91:0/3527973745 learned_addr learned my addr 172.21.15.91:0/3527973745 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.268+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/3557844285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40c66d0 0x7f2fc40c6b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406f140 tx=0x7f2fb001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210b3e46ce1eb912 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.272+0000 7fbacbfff640 1 -- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc06adc0 msgr2=0x7fbacc072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.272+0000 7fbacbfff640 1 --2- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc06adc0 0x7fbacc072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.272+0000 7fbacbfff640 1 -- 172.21.15.91:0/3527973745 >> v2:172.21.15.91:3300/0 conn(0x7fbacc06b1a0 msgr2=0x7fbacc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.272+0000 7fbacbfff640 1 --2- 172.21.15.91:0/3527973745 >> v2:172.21.15.91:3300/0 conn(0x7fbacc06b1a0 0x7fbacc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.272+0000 7fbacbfff640 1 -- 172.21.15.91:0/3527973745 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0c2ce0 con 0x7fbacc0c65f0 2023-12-13T22:26:46.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.280+0000 7f2bf3fff640 1 -- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2bf40c66d0 msgr2=0x7f2bf4152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.280+0000 7f2bf3fff640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2bf40c66d0 0x7f2bf4152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.280+0000 7f2bf3fff640 1 -- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bf40722f0 msgr2=0x7f2bf40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.280+0000 7f2bf3fff640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bf40722f0 0x7f2bf40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.280+0000 7f2bf3fff640 1 -- 172.21.15.91:0/1963721526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009420 con 0x7f2bf415a130 2023-12-13T22:26:46.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.292+0000 7f2bf3fff640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00cbc0 tx=0x7f2bec00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.296+0000 7fbacbfff640 1 --2- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc0c65f0 0x7fbacc1532a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbacc06d2e0 tx=0x7fbac401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d909532084f2b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fc37fe640 1 -- 172.21.15.91:0/3557844285 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00ac600 con 0x7f2fc40c66d0 2023-12-13T22:26:46.310 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fc37fe640 1 -- 172.21.15.91:0/3557844285 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb00a8050 con 0x7f2fc40c66d0 2023-12-13T22:26:46.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fc37fe640 1 -- 172.21.15.91:0/3557844285 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00ac980 con 0x7f2fc40c66d0 2023-12-13T22:26:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 -- 172.21.15.91:0/3557844285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40c66d0 msgr2=0x7f2fc40c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 --2- 172.21.15.91:0/3557844285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40c66d0 0x7f2fc40c6b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406f140 tx=0x7f2fb001c3a0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 -- 172.21.15.91:0/3557844285 shutdown_connections 2023-12-13T22:26:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 --2- 172.21.15.91:0/3557844285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40c66d0 0x7f2fc40c6b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.312 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 --2- 172.21.15.91:0/3557844285 >> v2:172.21.15.91:3300/0 conn(0x7f2fc40722f0 0x7f2fc40726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 -- 172.21.15.91:0/3557844285 >> 172.21.15.91:0/3557844285 conn(0x7f2fc406b670 msgr2=0x7f2fc406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 -- 172.21.15.91:0/3557844285 shutdown_connections 2023-12-13T22:26:46.313 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.312+0000 7f2fcae85640 1 -- 172.21.15.91:0/3557844285 wait complete. 2023-12-13T22:26:46.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.316+0000 7f2fcae85640 1 Processor -- start 2023-12-13T22:26:46.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.316+0000 7f2fcae85640 1 -- start start 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40722f0 0x7f2fc413f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc4159a20 0x7f2fc4158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41548f0 con 0x7f2fc40c66d0 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc413d3b0 con 0x7f2fc40722f0 2023-12-13T22:26:46.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.320+0000 7f2fcae85640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4155710 con 0x7f2fc4159a20 2023-12-13T22:26:46.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.364+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fcc000eb780 con 0x7fcc080b1950 2023-12-13T22:26:46.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.372+0000 7f429bfff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f429c151570 0x7f429c0c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42278/0 (socket says 172.21.15.91:42278) 2023-12-13T22:26:46.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.372+0000 7f429bfff640 1 -- 172.21.15.91:0/2298618180 learned_addr learned my addr 172.21.15.91:0/2298618180 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:46.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.376+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282545902 0 0) 0x7f429c151950 con 0x7f429c151570 2023-12-13T22:26:46.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.376+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4284003530 con 0x7f429c151570 2023-12-13T22:26:46.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.380+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f280f17e0 con 0x7f9f3015b520 2023-12-13T22:26:46.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.384+0000 7f42a0c28640 1 --2- 172.21.15.91:0/2298618180 >> v2:172.21.15.91:3300/0 conn(0x7f429c0c8e10 0x7f429c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3913605268 0 0) 0x7f4284003530 con 0x7f429c151570 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 msgr2=0x7f429c157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 0x7f429c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 >> v2:172.21.15.91:3300/0 conn(0x7f429c0c8e10 msgr2=0x7f429c15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 --2- 172.21.15.91:0/2298618180 >> v2:172.21.15.91:3300/0 conn(0x7f429c0c8e10 0x7f429c15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c06ab80 con 0x7f429c151570 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f428c001680 con 0x7f429c151570 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 >> v1:172.21.15.91:6789/0 conn(0x7f429c151570 legacy=0x7f429c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 0x7f42840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4284004150 0x7f42840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4284004e30 0x7f428400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0c7d40 con 0x7f4284004150 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c0c8610 con 0x7f4284004e30 2023-12-13T22:26:46.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.388+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428400bed0 con 0x7f429c06a560 2023-12-13T22:26:46.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.392+0000 7f2fc3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.392+0000 7f2fc3fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58154/0 (socket says 172.21.15.91:58154) 2023-12-13T22:26:46.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.392+0000 7f2fc3fff640 1 -- 172.21.15.91:0/1710663953 learned_addr learned my addr 172.21.15.91:0/1710663953 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.396+0000 7f429b7fe640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4284004150 0x7f42840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.404+0000 7f2fc3fff640 1 -- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc4159a20 msgr2=0x7f2fc4158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.404+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc4159a20 0x7f2fc4158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.404+0000 7f2fc3fff640 1 -- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40722f0 msgr2=0x7f2fc413f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.404+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40722f0 0x7f2fc413f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.404+0000 7f2fc3fff640 1 -- 172.21.15.91:0/1710663953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009420 con 0x7f2fc40c66d0 2023-12-13T22:26:46.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f2fc3fff640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018fb0 tx=0x7f2fb0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f429b7fe640 1 -- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 msgr2=0x7f42840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f429b7fe640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f429c06a560 0x7f42840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f429b7fe640 1 -- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4284004e30 msgr2=0x7f428400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:46.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f429b7fe640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4284004e30 0x7f428400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.408+0000 7f429b7fe640 1 -- 172.21.15.91:0/2298618180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284003530 con 0x7f4284004150 2023-12-13T22:26:46.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.412+0000 7f429b7fe640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4284004150 0x7f42840047d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4290009890 tx=0x7f429001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c91fede57a6814 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900ab600 con 0x7f4284004150 2023-12-13T22:26:46.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42900a7050 con 0x7f4284004150 2023-12-13T22:26:46.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f429affd640 1 -- 172.21.15.91:0/2298618180 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900aba00 con 0x7f4284004150 2023-12-13T22:26:46.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- 172.21.15.91:0/2298618180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4284004150 msgr2=0x7f42840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 --2- 172.21.15.91:0/2298618180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4284004150 0x7f42840047d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4290009890 tx=0x7f429001c370 comp rx=0 tx=0).stop 2023-12-13T22:26:46.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a0c28640 1 -- 172.21.15.91:0/2298618180 reap_dead start 2023-12-13T22:26:46.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- 172.21.15.91:0/2298618180 shutdown_connections 2023-12-13T22:26:46.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- 172.21.15.91:0/2298618180 >> 172.21.15.91:0/2298618180 conn(0x7f429c070160 msgr2=0x7f429c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- 172.21.15.91:0/2298618180 shutdown_connections 2023-12-13T22:26:46.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- 172.21.15.91:0/2298618180 wait complete. 2023-12-13T22:26:46.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9f280ed420 con 0x7f9f3015b520 2023-12-13T22:26:46.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00bc640 con 0x7f2fc40c66d0 2023-12-13T22:26:46.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb00bc7a0 con 0x7f2fc40c66d0 2023-12-13T22:26:46.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00bcb30 con 0x7f2fc40c66d0 2023-12-13T22:26:46.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc414a900 con 0x7f2fc40c66d0 2023-12-13T22:26:46.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc413efc0 con 0x7f2fc40c66d0 2023-12-13T22:26:46.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 Processor -- start 2023-12-13T22:26:46.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.420+0000 7f42a268b640 1 -- start start 2023-12-13T22:26:46.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4073e70 con 0x7f2fc40c66d0 2023-12-13T22:26:46.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f429c14a9c0 0x7f429c144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f429c145050 0x7f429c140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c159450 con 0x7f429c145050 2023-12-13T22:26:46.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c159a10 con 0x7f429c14a9c0 2023-12-13T22:26:46.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.424+0000 7f42a268b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c14a200 con 0x7f4284004150 2023-12-13T22:26:46.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.440+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2fb00b3420 con 0x7f2fc40c66d0 2023-12-13T22:26:46.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.444+0000 7f2fc17fa640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 0x7f2fa8068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.444+0000 7f2fc8c21640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 0x7f2fa8068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.444+0000 7f2fc8c21640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 0x7f2fa8068ce0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009690 tx=0x7f2fb8006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.444+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fb00f1ac0 con 0x7f2fc40c66d0 2023-12-13T22:26:46.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.456+0000 7f429bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.468+0000 7f429bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45676/0 (socket says 172.21.15.91:45676) 2023-12-13T22:26:46.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.468+0000 7f429bfff640 1 -- 172.21.15.91:0/4179449135 learned_addr learned my addr 172.21.15.91:0/4179449135 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.476+0000 7f429bfff640 1 -- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f429c14a9c0 msgr2=0x7f429c144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.476+0000 7f429bfff640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f429c14a9c0 0x7f429c144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.476+0000 7f429bfff640 1 -- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f429c145050 msgr2=0x7f429c140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.476+0000 7f429bfff640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f429c145050 0x7f429c140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.476+0000 7f429bfff640 1 -- 172.21.15.91:0/4179449135 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c1456c0 con 0x7f4284004150 2023-12-13T22:26:46.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.484+0000 7f429bfff640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c760 tx=0x7f428c00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.488+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0074e0 con 0x7f4284004150 2023-12-13T22:26:46.488 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.488+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c007660 con 0x7f4284004150 2023-12-13T22:26:46.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.488+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c158470 con 0x7f4284004150 2023-12-13T22:26:46.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.488+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c004a30 con 0x7f4284004150 2023-12-13T22:26:46.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.488+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c14a4a0 con 0x7f4284004150 2023-12-13T22:26:46.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.492+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c073e70 con 0x7f4284004150 2023-12-13T22:26:46.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.516+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003600 con 0x7fc4ec0c8360 2023-12-13T22:26:46.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.516+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8003780 con 0x7fc4ec0c8360 2023-12-13T22:26:46.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.516+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec158b10 con 0x7fc4ec0c8360 2023-12-13T22:26:46.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.516+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec1590d0 con 0x7fc4ec0c8360 2023-12-13T22:26:46.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.516+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec159310 con 0x7fc4ec0c8360 2023-12-13T22:26:46.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.524+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f428c00a640 con 0x7f4284004150 2023-12-13T22:26:46.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.524+0000 7f4298ff9640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 0x7f4288068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.524+0000 7f429b7fe640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 0x7f4288068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.524+0000 7f429b7fe640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 0x7f4288068d30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42900ad000 tx=0x7f42900047e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.531 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.532+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcc08073e70 con 0x7fcc080b1950 2023-12-13T22:26:46.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.572+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f30073e70 con 0x7f9f3015b520 2023-12-13T22:26:46.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003b30 con 0x7fc4ec0c8360 2023-12-13T22:26:46.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbaca7fc640 1 -- 172.21.15.91:0/3527973745 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40a5730 con 0x7fbacc0c65f0 2023-12-13T22:26:46.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbaca7fc640 1 -- 172.21.15.91:0/3527973745 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac40a5890 con 0x7fbacc0c65f0 2023-12-13T22:26:46.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbaca7fc640 1 -- 172.21.15.91:0/3527973745 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40a5c20 con 0x7fbacc0c65f0 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 -- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc0c65f0 msgr2=0x7fbacc1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 --2- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc0c65f0 0x7fbacc1532a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbacc06d2e0 tx=0x7fbac401c9a0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 -- 172.21.15.91:0/3527973745 shutdown_connections 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 --2- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc0c65f0 0x7fbacc1532a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 --2- 172.21.15.91:0/3527973745 >> v2:172.21.15.91:3300/0 conn(0x7fbacc06b1a0 0x7fbacc159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 --2- 172.21.15.91:0/3527973745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc06adc0 0x7fbacc072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 -- 172.21.15.91:0/3527973745 >> 172.21.15.91:0/3527973745 conn(0x7fbacc070160 msgr2=0x7fbacc06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 -- 172.21.15.91:0/3527973745 shutdown_connections 2023-12-13T22:26:46.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.584+0000 7fbad2175640 1 -- 172.21.15.91:0/3527973745 wait complete. 2023-12-13T22:26:46.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 Processor -- start 2023-12-13T22:26:46.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 -- start start 2023-12-13T22:26:46.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc06adc0 0x7fbacc1f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc0c65f0 0x7fbacc151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1f3210 con 0x7fbacc06b1a0 2023-12-13T22:26:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc1512c0 con 0x7fbacc06adc0 2023-12-13T22:26:46.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7fbad2175640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc156e30 con 0x7fbacc0c65f0 2023-12-13T22:26:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00ad40 con 0x7f2bf415a130 2023-12-13T22:26:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec012400 con 0x7f2bf415a130 2023-12-13T22:26:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00aea0 con 0x7f2bf415a130 2023-12-13T22:26:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf406a690 con 0x7f2bf415a130 2023-12-13T22:26:46.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.588+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf406ac50 con 0x7f2bf415a130 2023-12-13T22:26:46.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.592+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf40c64b0 con 0x7f2bf415a130 2023-12-13T22:26:46.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.624+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f51f8007070 con 0x7f5208152bf0 2023-12-13T22:26:46.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.624+0000 7f51fffff640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 0x7f51e8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.624+0000 7f52077fe640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 0x7f51e8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.624+0000 7f52077fe640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 0x7f51e8068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5200009650 tx=0x7f5200006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.628+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51f8055b50 con 0x7f5208152bf0 2023-12-13T22:26:46.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.636+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f51f8051790 con 0x7f5208152bf0 2023-12-13T22:26:46.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.704+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2fb00ed700 con 0x7f2fc40c66d0 2023-12-13T22:26:46.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.712+0000 7fbacaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.712+0000 7fbacaffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58178/0 (socket says 172.21.15.91:58178) 2023-12-13T22:26:46.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.712+0000 7fbacaffd640 1 -- 172.21.15.91:0/2044969582 learned_addr learned my addr 172.21.15.91:0/2044969582 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:46.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.736+0000 7fbacaffd640 1 -- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc0c65f0 msgr2=0x7fbacc151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.736+0000 7fbacaffd640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc0c65f0 0x7fbacc151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.736+0000 7fbacaffd640 1 -- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc06adc0 msgr2=0x7fbacc1f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.736+0000 7fbacaffd640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc06adc0 0x7fbacc1f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.736+0000 7fbacaffd640 1 -- 172.21.15.91:0/2044969582 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac4009b30 con 0x7fbacc06b1a0 2023-12-13T22:26:46.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.740+0000 7fbacaffd640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00b580 tx=0x7fbabc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:46.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcbfeffd640 1 -- 172.21.15.91:0/1635621381 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc000eeda0 con 0x7fcc080b1950 2023-12-13T22:26:46.741 INFO:teuthology.orchestra.run.smithi091.stdout:68719476758 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 msgr2=0x7fcbec068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 0x7fcbec068d30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007fd0 tx=0x7fcc040079a0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 msgr2=0x7fcc081f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000a030 tx=0x7fcbf4005800 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 shutdown_connections 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fcbec066870 0x7fcbec068d30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fcc080b1950 0x7fcc081f6600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc080abd30 0x7fcc081f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 --2- 172.21.15.91:0/1635621381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcbf40052b0 0x7fcc080c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 >> 172.21.15.91:0/1635621381 conn(0x7fcc08070160 msgr2=0x7fcc080c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 shutdown_connections 2023-12-13T22:26:46.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.744+0000 7fcc10525640 1 -- 172.21.15.91:0/1635621381 wait complete. 2023-12-13T22:26:46.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc011890 con 0x7fbacc06b1a0 2023-12-13T22:26:46.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc011a10 con 0x7fbacc06b1a0 2023-12-13T22:26:46.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc011dc0 con 0x7fbacc06b1a0 2023-12-13T22:26:46.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc156870 con 0x7fbacc06b1a0 2023-12-13T22:26:46.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc150c70 con 0x7fbacc06b1a0 2023-12-13T22:26:46.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.748+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac005260 con 0x7fbacc06b1a0 2023-12-13T22:26:46.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476758 for osd.6 2023-12-13T22:26:46.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.792+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f428c055470 con 0x7f4284004150 2023-12-13T22:26:46.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.800+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5208067520 con 0x7f5208152bf0 2023-12-13T22:26:46.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.804+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f428c0510b0 con 0x7f4284004150 2023-12-13T22:26:46.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.816+0000 7f9f267fc640 1 -- 172.21.15.91:0/512376204 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f28009510 con 0x7f9f3015b520 2023-12-13T22:26:46.815 INFO:teuthology.orchestra.run.smithi091.stdout:64424509461 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 msgr2=0x7f9f14068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 0x7f9f14068cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c007fd0 tx=0x7f9f2c007e40 comp rx=0 tx=0).stop 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 msgr2=0x7f9f3014b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f2801b060 tx=0x7f9f28019750 comp rx=0 tx=0).stop 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 shutdown_connections 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9f140667f0 0x7f9f14068cb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f3015b520 0x7f9f3014b6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f30151600 0x7f9f301f9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 --2- 172.21.15.91:0/512376204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9f300c6fb0 0x7f9f3014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 >> 172.21.15.91:0/512376204 conn(0x7f9f30070160 msgr2=0x7f9f30153840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 shutdown_connections 2023-12-13T22:26:46.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.820+0000 7f9f37a8d640 1 -- 172.21.15.91:0/512376204 wait complete. 2023-12-13T22:26:46.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.2 2023-12-13T22:26:46.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.868+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2fc4160700 con 0x7f2fc40c66d0 2023-12-13T22:26:46.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.960+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f429c154c30 con 0x7f4284004150 2023-12-13T22:26:46.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.964+0000 7f4298ff9640 1 -- 172.21.15.91:0/4179449135 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f428c018070 con 0x7f4284004150 2023-12-13T22:26:46.964 INFO:teuthology.orchestra.run.smithi091.stdout:68719476758 2023-12-13T22:26:46.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 msgr2=0x7f4288068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 0x7f4288068d30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42900ad000 tx=0x7f42900047e0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 msgr2=0x7f429c14b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c760 tx=0x7f428c00cc20 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 shutdown_connections 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4288066870 0x7f4288068d30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f429c145050 0x7f429c140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f429c14a9c0 0x7f429c144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 --2- 172.21.15.91:0/4179449135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4284004150 0x7f429c14b700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:46.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 >> 172.21.15.91:0/4179449135 conn(0x7f429c070160 msgr2=0x7f429c0c6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:46.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 shutdown_connections 2023-12-13T22:26:46.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.968+0000 7f42a268b640 1 -- 172.21.15.91:0/4179449135 wait complete. 2023-12-13T22:26:46.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476758 for osd.7 2023-12-13T22:26:46.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.996+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbabc01a400 con 0x7fbacc06b1a0 2023-12-13T22:26:46.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:46.996+0000 7fbab3fff640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 0x7fbab8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:46.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.000+0000 7fbacb7fe640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 0x7fbab8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:46.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.000+0000 7fbacb7fe640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 0x7fbab8068d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009730 tx=0x7fbac0006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.024+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbabc056110 con 0x7fbacc06b1a0 2023-12-13T22:26:47.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.024+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbabc051d50 con 0x7fbacc06b1a0 2023-12-13T22:26:47.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fc17fa640 1 -- 172.21.15.91:0/1710663953 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fb00c1090 con 0x7f2fc40c66d0 2023-12-13T22:26:47.029 INFO:teuthology.orchestra.run.smithi091.stdout:68719476758 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 msgr2=0x7f2fa8068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 0x7f2fa8068ce0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009690 tx=0x7f2fb8006c00 comp rx=0 tx=0).stop 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 msgr2=0x7f2fc414a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018fb0 tx=0x7f2fb0019140 comp rx=0 tx=0).stop 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 shutdown_connections 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2fa8066820 0x7f2fa8068ce0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.032 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc4159a20 0x7f2fc4158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2fc40c66d0 0x7f2fc414a3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 --2- 172.21.15.91:0/1710663953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40722f0 0x7f2fc413f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 >> 172.21.15.91:0/1710663953 conn(0x7f2fc406b670 msgr2=0x7f2fc4159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 shutdown_connections 2023-12-13T22:26:47.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.032+0000 7f2fcae85640 1 -- 172.21.15.91:0/1710663953 wait complete. 2023-12-13T22:26:47.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476758 for osd.5 2023-12-13T22:26:47.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.168+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2bec007070 con 0x7f2bf415a130 2023-12-13T22:26:47.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.172+0000 7f2bdbfff640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 0x7f2be0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.172+0000 7f2bf37fe640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 0x7f2be0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.172+0000 7f2bf37fe640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 0x7f2be0068cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2be40ad000 tx=0x7f2be4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.184+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bec055490 con 0x7f2bf415a130 2023-12-13T22:26:47.188 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.188+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbaac0057e0 con 0x7fbacc06b1a0 2023-12-13T22:26:47.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.196+0000 7fbab3fff640 1 -- 172.21.15.91:0/2044969582 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbabc015020 con 0x7fbacc06b1a0 2023-12-13T22:26:47.195 INFO:teuthology.orchestra.run.smithi091.stdout:60129542164 2023-12-13T22:26:47.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 msgr2=0x7fbab8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 0x7fbab8068d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009730 tx=0x7fbac0006ca0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 msgr2=0x7fbacc154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00b580 tx=0x7fbabc00ba40 comp rx=0 tx=0).stop 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 shutdown_connections 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbab8066840 0x7fbab8068d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbacc0c65f0 0x7fbacc151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbacc06b1a0 0x7fbacc154a00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 --2- 172.21.15.91:0/2044969582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbacc06adc0 0x7fbacc1f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 >> 172.21.15.91:0/2044969582 conn(0x7fbacc070160 msgr2=0x7fbacc157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 shutdown_connections 2023-12-13T22:26:47.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.200+0000 7fbad2175640 1 -- 172.21.15.91:0/2044969582 wait complete. 2023-12-13T22:26:47.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542164 for osd.0 2023-12-13T22:26:47.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.236+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2bec0517d0 con 0x7f2bf415a130 2023-12-13T22:26:47.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.236+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc4e8003c90 con 0x7fc4ec0c8360 2023-12-13T22:26:47.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.236+0000 7fc4e27fc640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.236+0000 7fc4f175d640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.236+0000 7fc4f175d640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 0x7fc4d0068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec15b5a0 tx=0x7fc4dc006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.240+0000 7f51fffff640 1 -- 172.21.15.91:0/3719471677 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51f8017090 con 0x7f5208152bf0 2023-12-13T22:26:47.238 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 msgr2=0x7f51e8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 0x7f51e8068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5200009650 tx=0x7f5200006bb0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 msgr2=0x7f5208145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51f800cad0 tx=0x7f51f800cf90 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 shutdown_connections 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f51e8066840 0x7f51e8068d00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5208152bf0 0x7f5208145a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f52080c6cd0 0x7f520814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 --2- 172.21.15.91:0/3719471677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52080c1ed0 0x7f5208154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 >> 172.21.15.91:0/3719471677 conn(0x7f520806c6a0 msgr2=0x7f520814f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 shutdown_connections 2023-12-13T22:26:47.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.244+0000 7f520dae8640 1 -- 172.21.15.91:0/3719471677 wait complete. 2023-12-13T22:26:47.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.248+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4e8054b20 con 0x7fc4ec0c8360 2023-12-13T22:26:47.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476760 got 68719476759 for osd.4 2023-12-13T22:26:47.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.276+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc4e8050e60 con 0x7fc4ec0c8360 2023-12-13T22:26:47.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.440+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4ec073e70 con 0x7fc4ec0c8360 2023-12-13T22:26:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.448+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2bf406b170 con 0x7f2bf415a130 2023-12-13T22:26:47.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.580+0000 7fc4e27fc640 1 -- 172.21.15.91:0/3517126418 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4e8017020 con 0x7fc4ec0c8360 2023-12-13T22:26:47.581 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:47.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bdbfff640 1 -- 172.21.15.91:0/1963721526 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bec021090 con 0x7f2bf415a130 2023-12-13T22:26:47.582 INFO:teuthology.orchestra.run.smithi091.stdout:68719476760 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 msgr2=0x7fc4d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 0x7fc4d0068d00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec15b5a0 tx=0x7fc4dc006bd0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 msgr2=0x7fc4ec0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800c490 tx=0x7fc4e8001e80 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 shutdown_connections 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc4d0066840 0x7fc4d0068d00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc4ec157a60 0x7fc4ec159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc4ec157680 0x7fc4ec159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 --2- 172.21.15.91:0/3517126418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4ec0c8360 0x7fc4ec0c4720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 >> 172.21.15.91:0/3517126418 conn(0x7fc4ec0713a0 msgr2=0x7fc4ec0c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 shutdown_connections 2023-12-13T22:26:47.584 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7fc4f41c2640 1 -- 172.21.15.91:0/3517126418 wait complete. 2023-12-13T22:26:47.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 msgr2=0x7f2be0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 0x7f2be0068cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2be40ad000 tx=0x7f2be4004740 comp rx=0 tx=0).stop 2023-12-13T22:26:47.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 msgr2=0x7f2bf4141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00cbc0 tx=0x7f2bec00a430 comp rx=0 tx=0).stop 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 shutdown_connections 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2be00667f0 0x7f2be0068cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2bf415a130 0x7f2bf4141260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2bf40c66d0 0x7f2bf4152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 --2- 172.21.15.91:0/1963721526 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2bf40722f0 0x7f2bf40cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 >> 172.21.15.91:0/1963721526 conn(0x7f2bf406b670 msgr2=0x7f2bf4147fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 shutdown_connections 2023-12-13T22:26:47.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.584+0000 7f2bf9c7a640 1 -- 172.21.15.91:0/1963721526 wait complete. 2023-12-13T22:26:47.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476760 got 68719476760 for osd.1 2023-12-13T22:26:47.602 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:47.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.3 2023-12-13T22:26:47.610 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:47.761 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-13T22:26:47.840 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-13T22:26:47.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 Processor -- start 2023-12-13T22:26:47.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 -- start start 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a0159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f62a006b210 0x7f62a0159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a015ca10 con 0x7f62a0153390 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a0159f90 con 0x7f62a006b210 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.888+0000 7f62a6b35640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a015a250 con 0x7f62a015d740 2023-12-13T22:26:47.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.892+0000 7f62a48d1640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f62a0153390 0x7f62a00c61f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42280/0 (socket says 172.21.15.91:42280) 2023-12-13T22:26:47.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.892+0000 7f62a48d1640 1 -- 172.21.15.91:0/820993010 learned_addr learned my addr 172.21.15.91:0/820993010 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:47.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.892+0000 7f62a50d2640 1 --2- 172.21.15.91:0/820993010 >> v2:172.21.15.152:3300/0 conn(0x7f62a006b210 0x7f62a0159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.892+0000 7f629ffff640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f629f7fe640 1 -- 172.21.15.91:0/820993010 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440073649 0 0) 0x7f62a015ca10 con 0x7f62a0153390 2023-12-13T22:26:47.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f629f7fe640 1 -- 172.21.15.91:0/820993010 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6288003530 con 0x7f62a0153390 2023-12-13T22:26:47.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f62a50d2640 1 -- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 msgr2=0x7f62a0159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:47.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f62a50d2640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a0159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f62a50d2640 1 -- 172.21.15.91:0/820993010 >> v1:172.21.15.91:6789/0 conn(0x7f62a0153390 legacy=0x7f62a00c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.897 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.896+0000 7f62a50d2640 1 -- 172.21.15.91:0/820993010 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a015cc60 con 0x7f62a006b210 2023-12-13T22:26:47.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.904+0000 7f62a50d2640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a0159960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62900097c0 tx=0x7f629001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6331c2c5233b272 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f629f7fe640 1 -- 172.21.15.91:0/820993010 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900ab600 con 0x7f62a006b210 2023-12-13T22:26:47.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f629f7fe640 1 -- 172.21.15.91:0/820993010 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900a7050 con 0x7f62a006b210 2023-12-13T22:26:47.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f629f7fe640 1 -- 172.21.15.91:0/820993010 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900ab980 con 0x7f62a006b210 2023-12-13T22:26:47.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 -- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 msgr2=0x7f62a0159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a0159960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62900097c0 tx=0x7f629001c3f0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 -- 172.21.15.91:0/820993010 shutdown_connections 2023-12-13T22:26:47.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a0159960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 --2- 172.21.15.91:0/820993010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 -- 172.21.15.91:0/820993010 >> 172.21.15.91:0/820993010 conn(0x7f62a00713a0 msgr2=0x7f62a00717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 -- 172.21.15.91:0/820993010 shutdown_connections 2023-12-13T22:26:47.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.912+0000 7f62a6b35640 1 -- 172.21.15.91:0/820993010 wait complete. 2023-12-13T22:26:47.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 Processor -- start 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 -- start start 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a01f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a00cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c9130 con 0x7f62a0153390 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a014db50 con 0x7f62a006b210 2023-12-13T22:26:47.914 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a6b35640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a014de30 con 0x7f62a015d740 2023-12-13T22:26:47.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f629ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f629ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58180/0 (socket says 172.21.15.91:58180) 2023-12-13T22:26:47.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f629ffff640 1 -- 172.21.15.91:0/1591099535 learned_addr learned my addr 172.21.15.91:0/1591099535 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:47.915 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.916+0000 7f62a50d2640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a00cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f62a48d1640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a01f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f629ffff640 1 -- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 msgr2=0x7f62a00cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f629ffff640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a00cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f629ffff640 1 -- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 msgr2=0x7f62a01f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f629ffff640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a01f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.920+0000 7f629ffff640 1 -- 172.21.15.91:0/1591099535 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009420 con 0x7f62a0153390 2023-12-13T22:26:47.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f629ffff640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f629400e870 tx=0x7f629400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294009510 con 0x7f62a0153390 2023-12-13T22:26:47.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400eec0 con 0x7f62a0153390 2023-12-13T22:26:47.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a014e110 con 0x7f62a0153390 2023-12-13T22:26:47.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400cb40 con 0x7f62a0153390 2023-12-13T22:26:47.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.924+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a014c6b0 con 0x7f62a0153390 2023-12-13T22:26:47.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.928+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a0073e70 con 0x7f62a0153390 2023-12-13T22:26:47.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.944+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f629400cca0 con 0x7f62a0153390 2023-12-13T22:26:47.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.944+0000 7f629d7fa640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 0x7f628c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.948+0000 7f62a48d1640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 0x7f628c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.948+0000 7f62a48d1640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 0x7f628c068d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62980012f0 tx=0x7f6298009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.948+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62940559b0 con 0x7f62a0153390 2023-12-13T22:26:47.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 Processor -- start 2023-12-13T22:26:47.951 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 -- start start 2023-12-13T22:26:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 0x7fb6f006ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb6f00c6370 0x7fb6f0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f0157590 con 0x7fb6f00cb8a0 2023-12-13T22:26:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f006b260 con 0x7fb6f00c6370 2023-12-13T22:26:47.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.952+0000 7fb6f58b3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f00c7090 con 0x7fb6f01512c0 2023-12-13T22:26:47.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.956+0000 7fb6ee7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb6f00c6370 0x7fb6f0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.956+0000 7fb6eeffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 0x7fb6f006ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.956+0000 7fb6ef7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb6f00cb8a0 0x7fb6f00c5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:52646/0 (socket says 172.21.15.91:52646) 2023-12-13T22:26:47.954 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.956+0000 7fb6ef7fe640 1 -- 172.21.15.91:0/74768456 learned_addr learned my addr 172.21.15.91:0/74768456 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:47.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.960+0000 7fb6eeffd640 1 -- 172.21.15.91:0/74768456 >> v2:172.21.15.152:3300/0 conn(0x7fb6f00c6370 msgr2=0x7fb6f0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:47.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.960+0000 7fb6eeffd640 1 --2- 172.21.15.91:0/74768456 >> v2:172.21.15.152:3300/0 conn(0x7fb6f00c6370 0x7fb6f0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.960+0000 7fb6eeffd640 1 -- 172.21.15.91:0/74768456 >> v1:172.21.15.152:6789/0 conn(0x7fb6f00cb8a0 legacy=0x7fb6f00c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.960+0000 7fb6eeffd640 1 -- 172.21.15.91:0/74768456 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00c67f0 con 0x7fb6f01512c0 2023-12-13T22:26:47.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.968+0000 7fb6eeffd640 1 --2- 172.21.15.91:0/74768456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 0x7fb6f006ad20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3b351f154ffc69 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:47.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.976+0000 7fb6edffb640 1 -- 172.21.15.91:0/74768456 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40a8970 con 0x7fb6f01512c0 2023-12-13T22:26:47.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.976+0000 7fb6edffb640 1 -- 172.21.15.91:0/74768456 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e40a8ad0 con 0x7fb6f01512c0 2023-12-13T22:26:47.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.976+0000 7fb6edffb640 1 -- 172.21.15.91:0/74768456 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40a8e60 con 0x7fb6f01512c0 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.976+0000 7fb6f58b3640 1 -- 172.21.15.91:0/74768456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 msgr2=0x7fb6f006ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.976+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/74768456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 0x7fb6f006ad20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e401ec70 comp rx=0 tx=0).stop 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- 172.21.15.91:0/74768456 shutdown_connections 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/74768456 >> v2:172.21.15.152:3300/0 conn(0x7fb6f00c6370 0x7fb6f0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/74768456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f01512c0 0x7fb6f006ad20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- 172.21.15.91:0/74768456 >> 172.21.15.91:0/74768456 conn(0x7fb6f006b670 msgr2=0x7fb6f006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- 172.21.15.91:0/74768456 shutdown_connections 2023-12-13T22:26:47.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- 172.21.15.91:0/74768456 wait complete. 2023-12-13T22:26:47.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 Processor -- start 2023-12-13T22:26:47.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- start start 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f00c6370 0x7fb6f01efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6f00cb8a0 0x7fb6f01eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01ef6b0 con 0x7fb6f00cb8a0 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01f0f20 con 0x7fb6f01512c0 2023-12-13T22:26:47.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6f58b3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01eeb00 con 0x7fb6f00c6370 2023-12-13T22:26:47.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.980+0000 7fb6ef7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.984+0000 7fb6ef7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54554/0 (socket says 172.21.15.91:54554) 2023-12-13T22:26:47.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.984+0000 7fb6ef7fe640 1 -- 172.21.15.91:0/1615494466 learned_addr learned my addr 172.21.15.91:0/1615494466 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:47.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.984+0000 7fb6eeffd640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f00c6370 0x7fb6f01efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:47.982 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-13T22:26:47.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.992+0000 7fb6ef7fe640 1 -- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f00c6370 msgr2=0x7fb6f01efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.992+0000 7fb6ef7fe640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f00c6370 0x7fb6f01efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.992+0000 7fb6ef7fe640 1 -- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6f00cb8a0 msgr2=0x7fb6f01eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:47.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.992+0000 7fb6ef7fe640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6f00cb8a0 0x7fb6f01eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:47.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:47.992+0000 7fb6ef7fe640 1 -- 172.21.15.91:0/1615494466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009420 con 0x7fb6f01512c0 2023-12-13T22:26:47.998 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.000+0000 7fb6ef7fe640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800cbf0 tx=0x7fb6e800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800ad40 con 0x7fb6f01512c0 2023-12-13T22:26:48.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e8012400 con 0x7fb6f01512c0 2023-12-13T22:26:48.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800aea0 con 0x7fb6f01512c0 2023-12-13T22:26:48.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f01eed80 con 0x7fb6f01512c0 2023-12-13T22:26:48.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f01ef340 con 0x7fb6f01512c0 2023-12-13T22:26:48.010 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.012+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f01ef860 con 0x7fb6f01512c0 2023-12-13T22:26:48.048 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-13T22:26:48.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.088+0000 7f129b8d2640 1 Processor -- start 2023-12-13T22:26:48.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.088+0000 7f129b8d2640 1 -- start start 2023-12-13T22:26:48.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f129b8d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f129b8d2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f12940725c0 0x7f12941532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f129b8d2640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940c2420 con 0x7f129406adc0 2023-12-13T22:26:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f129b8d2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12941599e0 con 0x7f12940725c0 2023-12-13T22:26:48.090 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f129b8d2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c6c90 con 0x7f129406b1a0 2023-12-13T22:26:48.091 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f1298e6d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f1298e6d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45724/0 (socket says 172.21.15.91:45724) 2023-12-13T22:26:48.092 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.092+0000 7f1298e6d640 1 -- 172.21.15.91:0/1198691316 learned_addr learned my addr 172.21.15.91:0/1198691316 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.100+0000 7f1298e6d640 1 -- 172.21.15.91:0/1198691316 >> v2:172.21.15.91:3300/0 conn(0x7f12940725c0 msgr2=0x7f12941532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.100+0000 7f1298e6d640 1 --2- 172.21.15.91:0/1198691316 >> v2:172.21.15.91:3300/0 conn(0x7f12940725c0 0x7f12941532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.100+0000 7f1298e6d640 1 -- 172.21.15.91:0/1198691316 >> v1:172.21.15.91:6789/0 conn(0x7f129406adc0 legacy=0x7f12940c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.100+0000 7f1298e6d640 1 -- 172.21.15.91:0/1198691316 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940c2700 con 0x7f129406b1a0 2023-12-13T22:26:48.103 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.104+0000 7f1298e6d640 1 --2- 172.21.15.91:0/1198691316 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1284009870 tx=0x7f128401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42f75bb5ef9c0b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f128bfff640 1 -- 172.21.15.91:0/1198691316 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840ac600 con 0x7f129406b1a0 2023-12-13T22:26:48.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f128bfff640 1 -- 172.21.15.91:0/1198691316 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12840a8050 con 0x7f129406b1a0 2023-12-13T22:26:48.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f128bfff640 1 -- 172.21.15.91:0/1198691316 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840ac980 con 0x7f129406b1a0 2023-12-13T22:26:48.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 -- 172.21.15.91:0/1198691316 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 msgr2=0x7f1294159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.112 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 --2- 172.21.15.91:0/1198691316 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1284009870 tx=0x7f128401c4d0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 -- 172.21.15.91:0/1198691316 shutdown_connections 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 --2- 172.21.15.91:0/1198691316 >> v2:172.21.15.91:3300/0 conn(0x7f12940725c0 0x7f12941532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 --2- 172.21.15.91:0/1198691316 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406b1a0 0x7f1294159e00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 -- 172.21.15.91:0/1198691316 >> 172.21.15.91:0/1198691316 conn(0x7f1294070160 msgr2=0x7f129406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 -- 172.21.15.91:0/1198691316 shutdown_connections 2023-12-13T22:26:48.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.112+0000 7f129b8d2640 1 -- 172.21.15.91:0/1198691316 wait complete. 2023-12-13T22:26:48.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 Processor -- start 2023-12-13T22:26:48.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 -- start start 2023-12-13T22:26:48.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f129406b1a0 0x7f1294158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12940725c0 0x7f1294149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294158790 con 0x7f129406b1a0 2023-12-13T22:26:48.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294149ff0 con 0x7f12940725c0 2023-12-13T22:26:48.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.116+0000 7f129b8d2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294151eb0 con 0x7f129406adc0 2023-12-13T22:26:48.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.120+0000 7f129966e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.120+0000 7f129966e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45736/0 (socket says 172.21.15.91:45736) 2023-12-13T22:26:48.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.120+0000 7f129966e640 1 -- 172.21.15.91:0/559509206 learned_addr learned my addr 172.21.15.91:0/559509206 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.128+0000 7f129966e640 1 -- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12940725c0 msgr2=0x7f1294149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.128+0000 7f129966e640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12940725c0 0x7f1294149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.128+0000 7f129966e640 1 -- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f129406b1a0 msgr2=0x7f1294158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.128+0000 7f129966e640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f129406b1a0 0x7f1294158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.128+0000 7f129966e640 1 -- 172.21.15.91:0/559509206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840094d0 con 0x7f129406adc0 2023-12-13T22:26:48.133 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.136+0000 7f129966e640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f129000c4c0 tx=0x7f1290001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290005480 con 0x7f129406adc0 2023-12-13T22:26:48.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290003600 con 0x7f129406adc0 2023-12-13T22:26:48.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290003990 con 0x7f129406adc0 2023-12-13T22:26:48.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1294152190 con 0x7f129406adc0 2023-12-13T22:26:48.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294152750 con 0x7f129406adc0 2023-12-13T22:26:48.142 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.144+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294073e70 con 0x7f129406adc0 2023-12-13T22:26:48.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 Processor -- start 2023-12-13T22:26:48.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 -- start start 2023-12-13T22:26:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4460157e60 0x7f446006fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600c9dd0 con 0x7f44601513c0 2023-12-13T22:26:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600ca0b0 con 0x7f44600c94b0 2023-12-13T22:26:48.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.168+0000 7f4467c83640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44600ca390 con 0x7f4460157e60 2023-12-13T22:26:48.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.200+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6294051cf0 con 0x7f62a0153390 2023-12-13T22:26:48.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.204+0000 7f446521e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4460157e60 0x7f446006fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.208+0000 7f4465a1f640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f44601513c0 0x7f446015a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:42304/0 (socket says 172.21.15.91:42304) 2023-12-13T22:26:48.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.208+0000 7f4465a1f640 1 -- 172.21.15.91:0/1482997964 learned_addr learned my addr 172.21.15.91:0/1482997964 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:48.214 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-13T22:26:48.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.220+0000 7f446521e640 1 -- 172.21.15.91:0/1482997964 >> v1:172.21.15.152:6789/0 conn(0x7f44600c94b0 legacy=0x7f44600cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.220+0000 7f446521e640 1 -- 172.21.15.91:0/1482997964 >> v1:172.21.15.91:6789/0 conn(0x7f44601513c0 legacy=0x7f446015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.220+0000 7f446521e640 1 -- 172.21.15.91:0/1482997964 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4460157380 con 0x7f4460157e60 2023-12-13T22:26:48.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.228+0000 7f446521e640 1 --2- 172.21.15.91:0/1482997964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4460157e60 0x7f446006fbc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f445001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6404a9cf4cb3dd server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.232+0000 7f4464a1d640 1 -- 172.21.15.91:0/1482997964 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500a8930 con 0x7f4460157e60 2023-12-13T22:26:48.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.232+0000 7f4464a1d640 1 -- 172.21.15.91:0/1482997964 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500a8a90 con 0x7f4460157e60 2023-12-13T22:26:48.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.232+0000 7f4464a1d640 1 -- 172.21.15.91:0/1482997964 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44500a8e20 con 0x7f4460157e60 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.232+0000 7f4467c83640 1 -- 172.21.15.91:0/1482997964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4460157e60 msgr2=0x7f446006fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.232+0000 7f4467c83640 1 --2- 172.21.15.91:0/1482997964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4460157e60 0x7f446006fbc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44500097c0 tx=0x7f445001ec30 comp rx=0 tx=0).stop 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- 172.21.15.91:0/1482997964 shutdown_connections 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 --2- 172.21.15.91:0/1482997964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4460157e60 0x7f446006fbc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- 172.21.15.91:0/1482997964 >> 172.21.15.91:0/1482997964 conn(0x7f44600613d0 msgr2=0x7f44600617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- 172.21.15.91:0/1482997964 shutdown_connections 2023-12-13T22:26:48.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- 172.21.15.91:0/1482997964 wait complete. 2023-12-13T22:26:48.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 Processor -- start 2023-12-13T22:26:48.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- start start 2023-12-13T22:26:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44601513c0 0x7f446015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.235 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4460157e60 0x7f446015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600c52f0 con 0x7f44600c94b0 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4460158710 con 0x7f4460157e60 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4467c83640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44601583e0 con 0x7f44601513c0 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4465a1f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4465a1f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:58224/0 (socket says 172.21.15.91:58224) 2023-12-13T22:26:48.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.236+0000 7f4465a1f640 1 -- 172.21.15.91:0/86928453 learned_addr learned my addr 172.21.15.91:0/86928453 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.240+0000 7f4465a1f640 1 -- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44601513c0 msgr2=0x7f446015ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.240+0000 7f4465a1f640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44601513c0 0x7f446015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.240+0000 7f4465a1f640 1 -- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4460157e60 msgr2=0x7f446015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.240+0000 7f4465a1f640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4460157e60 0x7f446015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.240+0000 7f4465a1f640 1 -- 172.21.15.91:0/86928453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009420 con 0x7f44600c94b0 2023-12-13T22:26:48.243 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.244+0000 7f4465a1f640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c420 tx=0x7f445c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.248+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005cf0 con 0x7f44600c94b0 2023-12-13T22:26:48.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.248+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005e50 con 0x7f44600c94b0 2023-12-13T22:26:48.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.248+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44601ed8f0 con 0x7f44600c94b0 2023-12-13T22:26:48.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.248+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0072f0 con 0x7f44600c94b0 2023-12-13T22:26:48.249 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.252+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44600c44c0 con 0x7f44600c94b0 2023-12-13T22:26:48.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.252+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44600cc8c0 con 0x7f44600c94b0 2023-12-13T22:26:48.263 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-13T22:26:48.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.280+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f445c007450 con 0x7f44600c94b0 2023-12-13T22:26:48.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.280+0000 7f44567fc640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 0x7f4444068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.280+0000 7f446521e640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 0x7f4444068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.280+0000 7f446521e640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 0x7f4444068ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44500b2000 tx=0x7f4450004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 Processor -- start 2023-12-13T22:26:48.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 -- start start 2023-12-13T22:26:48.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f91700cbce0 0x7f9170072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700c2440 con 0x7f91700cc0c0 2023-12-13T22:26:48.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700c2720 con 0x7f91700c65f0 2023-12-13T22:26:48.326 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.328+0000 7f917714a640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917015a480 con 0x7f91700cbce0 2023-12-13T22:26:48.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.372+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f62a006aff0 con 0x7f62a0153390 2023-12-13T22:26:48.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.392+0000 7f9174ee6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f91700cbce0 0x7f9170072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.392+0000 7f9174ee6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f91700cbce0 0x7f9170072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54584/0 (socket says 172.21.15.91:54584) 2023-12-13T22:26:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.392+0000 7f9174ee6640 1 -- 172.21.15.91:0/1661019249 learned_addr learned my addr 172.21.15.91:0/1661019249 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.396+0000 7f7d1a589640 1 Processor -- start 2023-12-13T22:26:48.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.396+0000 7f7d1a589640 1 -- start start 2023-12-13T22:26:48.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f9174ee6640 1 -- 172.21.15.91:0/1661019249 >> v1:172.21.15.152:6789/0 conn(0x7f91700c65f0 legacy=0x7f9170159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f9174ee6640 1 -- 172.21.15.91:0/1661019249 >> v1:172.21.15.91:6789/0 conn(0x7f91700cc0c0 legacy=0x7f9170153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f9174ee6640 1 -- 172.21.15.91:0/1661019249 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700c2a00 con 0x7f91700cbce0 2023-12-13T22:26:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f7d1a589640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d14157e60 0x7f7d1406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f7d1a589640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d140c94b0 0x7f7d140cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f7d1a589640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140c9dd0 con 0x7f7d141513c0 2023-12-13T22:26:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f7d1a589640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d140ca390 con 0x7f7d140c94b0 2023-12-13T22:26:48.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.400+0000 7f7d1a589640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140cc8c0 con 0x7f7d14157e60 2023-12-13T22:26:48.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.424+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb6e8007070 con 0x7fb6f01512c0 2023-12-13T22:26:48.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.424+0000 7fb6d7fff640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 0x7fb6dc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.424+0000 7fb6eeffd640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 0x7fb6dc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.424+0000 7fb6eeffd640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 0x7fb6dc068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b2000 tx=0x7fb6e40aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.424+0000 7f9174ee6640 1 --2- 172.21.15.91:0/1661019249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700cbce0 0x7f9170072550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9164009870 tx=0x7f916401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc27a293ebe10de server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.432+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6e80552d0 con 0x7fb6f01512c0 2023-12-13T22:26:48.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.444+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb6e8051610 con 0x7fb6f01512c0 2023-12-13T22:26:48.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f916f7fe640 1 -- 172.21.15.91:0/1661019249 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a89b0 con 0x7f91700cbce0 2023-12-13T22:26:48.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f916f7fe640 1 -- 172.21.15.91:0/1661019249 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640a8b10 con 0x7f91700cbce0 2023-12-13T22:26:48.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f916f7fe640 1 -- 172.21.15.91:0/1661019249 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a8ea0 con 0x7f91700cbce0 2023-12-13T22:26:48.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f917714a640 1 -- 172.21.15.91:0/1661019249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700cbce0 msgr2=0x7f9170072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f917714a640 1 --2- 172.21.15.91:0/1661019249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700cbce0 0x7f9170072550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9164009870 tx=0x7f916401ecb0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f917714a640 1 -- 172.21.15.91:0/1661019249 shutdown_connections 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f917714a640 1 --2- 172.21.15.91:0/1661019249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700cbce0 0x7f9170072550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.448+0000 7f917714a640 1 -- 172.21.15.91:0/1661019249 >> 172.21.15.91:0/1661019249 conn(0x7f9170070160 msgr2=0x7f917006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- 172.21.15.91:0/1661019249 shutdown_connections 2023-12-13T22:26:48.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- 172.21.15.91:0/1661019249 wait complete. 2023-12-13T22:26:48.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 Processor -- start 2023-12-13T22:26:48.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- start start 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91700cbce0 0x7f9170155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f91700cc0c0 0x7f91701eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170156950 con 0x7f91700cbce0 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91701e4260 con 0x7f91700c65f0 2023-12-13T22:26:48.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.452+0000 7f917714a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9170156b50 con 0x7f91700cc0c0 2023-12-13T22:26:48.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f7d18b26640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d140c94b0 0x7f7d140cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f9174ee6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f7d18b26640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d140c94b0 0x7f7d140cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54590/0 (socket says 172.21.15.91:54590) 2023-12-13T22:26:48.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f7d18b26640 1 -- 172.21.15.91:0/2108987205 learned_addr learned my addr 172.21.15.91:0/2108987205 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f9174ee6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:54596/0 (socket says 172.21.15.91:54596) 2023-12-13T22:26:48.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.456+0000 7f9174ee6640 1 -- 172.21.15.91:0/3223670563 learned_addr learned my addr 172.21.15.91:0/3223670563 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.460+0000 7f9174ee6640 1 -- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f91700cc0c0 msgr2=0x7f91701eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.460+0000 7f9174ee6640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f91700cc0c0 0x7f91701eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.460+0000 7f9174ee6640 1 -- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91700cbce0 msgr2=0x7f9170155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.460+0000 7f9174ee6640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91700cbce0 0x7f9170155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.460+0000 7f9174ee6640 1 -- 172.21.15.91:0/3223670563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640094d0 con 0x7f91700c65f0 2023-12-13T22:26:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.468+0000 7f7d18b26640 1 -- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d14157e60 msgr2=0x7f7d1406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.468+0000 7f7d18b26640 1 --2- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d14157e60 0x7f7d1406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.468+0000 7f7d18b26640 1 -- 172.21.15.91:0/2108987205 >> v1:172.21.15.91:6789/0 conn(0x7f7d141513c0 legacy=0x7f7d1415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:48.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.468+0000 7f7d18b26640 1 -- 172.21.15.91:0/2108987205 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140ca0b0 con 0x7f7d140c94b0 2023-12-13T22:26:48.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.468+0000 7f9174ee6640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f916401b8c0 tx=0x7f916401ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.472+0000 7f7d18b26640 1 --2- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d140c94b0 0x7f7d140cba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e50 tx=0x7f7d0c01f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b9dd3d31f2ed19 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640b0e60 con 0x7f91700c65f0 2023-12-13T22:26:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640ba440 con 0x7f91700c65f0 2023-12-13T22:26:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91701e3930 con 0x7f91700c65f0 2023-12-13T22:26:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640ba7f0 con 0x7f91700c65f0 2023-12-13T22:26:48.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91701e3ef0 con 0x7f91700c65f0 2023-12-13T22:26:48.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.480+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9170073e70 con 0x7f91700c65f0 2023-12-13T22:26:48.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.512+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f129001b3b0 con 0x7f129406adc0 2023-12-13T22:26:48.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.516+0000 7f1289ffb640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 0x7f1278068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.516+0000 7f1298e6d640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 0x7f1278068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.516+0000 7f1298e6d640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 0x7f1278068d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f12840ae000 tx=0x7f1284008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.528+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1290055060 con 0x7f129406adc0 2023-12-13T22:26:48.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.548+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1290050ca0 con 0x7f129406adc0 2023-12-13T22:26:48.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.564+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f445c055220 con 0x7f44600c94b0 2023-12-13T22:26:48.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.564+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f445c050e60 con 0x7f44600c94b0 2023-12-13T22:26:48.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.572+0000 7f629d7fa640 1 -- 172.21.15.91:0/1591099535 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6294021090 con 0x7f62a0153390 2023-12-13T22:26:48.571 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 msgr2=0x7f628c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 0x7f628c068d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f62980012f0 tx=0x7f6298009040 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 msgr2=0x7f62a00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f629400e870 tx=0x7f629400ec70 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 shutdown_connections 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f628c066840 0x7f628c068d00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62a015d740 0x7f62a00cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f62a0153390 0x7f62a00cad90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 --2- 172.21.15.91:0/1591099535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a006b210 0x7f62a01f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 >> 172.21.15.91:0/1591099535 conn(0x7f62a00713a0 msgr2=0x7f62a00c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 shutdown_connections 2023-12-13T22:26:48.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.576+0000 7f62a6b35640 1 -- 172.21.15.91:0/1591099535 wait complete. 2023-12-13T22:26:48.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.6 2023-12-13T22:26:48.598 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:48.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.600+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6f01ef860 con 0x7fb6f01512c0 2023-12-13T22:26:48.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.720+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f12940cbb40 con 0x7f129406adc0 2023-12-13T22:26:48.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.728+0000 7f1289ffb640 1 -- 172.21.15.91:0/559509206 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1290017090 con 0x7f129406adc0 2023-12-13T22:26:48.728 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:48.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 msgr2=0x7f1278068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 0x7f1278068d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f12840ae000 tx=0x7f1284008040 comp rx=0 tx=0).stop 2023-12-13T22:26:48.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 msgr2=0x7f12940c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f129000c4c0 tx=0x7f1290001e80 comp rx=0 tx=0).stop 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 shutdown_connections 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1278066840 0x7f1278068d00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12940725c0 0x7f1294149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f129406b1a0 0x7f1294158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 --2- 172.21.15.91:0/559509206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f129406adc0 0x7f12940c5800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 >> 172.21.15.91:0/559509206 conn(0x7f1294070160 msgr2=0x7f129414f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 shutdown_connections 2023-12-13T22:26:48.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.732+0000 7f129b8d2640 1 -- 172.21.15.91:0/559509206 wait complete. 2023-12-13T22:26:48.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.740+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4460073e70 con 0x7f44600c94b0 2023-12-13T22:26:48.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.7 2023-12-13T22:26:48.747 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:48.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.748+0000 7f44567fc640 1 -- 172.21.15.91:0/86928453 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f445c017030 con 0x7f44600c94b0 2023-12-13T22:26:48.748 INFO:teuthology.orchestra.run.smithi091.stdout:68719476759 2023-12-13T22:26:48.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 msgr2=0x7f4444068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 0x7f4444068ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44500b2000 tx=0x7f4450004740 comp rx=0 tx=0).stop 2023-12-13T22:26:48.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 msgr2=0x7f4460158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c420 tx=0x7f445c00c8e0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 shutdown_connections 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4444066820 0x7f4444068ce0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4460157e60 0x7f446015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44601513c0 0x7f446015ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 --2- 172.21.15.91:0/86928453 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f44600c94b0 0x7f4460158ba0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 >> 172.21.15.91:0/86928453 conn(0x7f44600613d0 msgr2=0x7f44600b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 shutdown_connections 2023-12-13T22:26:48.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.752+0000 7f4467c83640 1 -- 172.21.15.91:0/86928453 wait complete. 2023-12-13T22:26:48.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.5 2023-12-13T22:26:48.766 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:48.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f91640ba950 con 0x7f91700c65f0 2023-12-13T22:26:48.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f916d7fa640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 0x7f9154068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.815 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f916ffff640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 0x7f9154068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f7d12ffd640 1 -- 172.21.15.91:0/2108987205 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0af400 con 0x7f7d140c94b0 2023-12-13T22:26:48.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f7d12ffd640 1 -- 172.21.15.91:0/2108987205 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0ab050 con 0x7f7d140c94b0 2023-12-13T22:26:48.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f7d12ffd640 1 -- 172.21.15.91:0/2108987205 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0af780 con 0x7f7d140c94b0 2023-12-13T22:26:48.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.816+0000 7f916ffff640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 0x7f9154068d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f91700c1d50 tx=0x7f915c006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d140c94b0 msgr2=0x7f7d140cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d140c94b0 0x7f7d140cba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e50 tx=0x7f7d0c01f1c0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- 172.21.15.91:0/2108987205 shutdown_connections 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d140c94b0 0x7f7d140cba30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- 172.21.15.91:0/2108987205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d14157e60 0x7f7d1406fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- 172.21.15.91:0/2108987205 >> 172.21.15.91:0/2108987205 conn(0x7f7d140613d0 msgr2=0x7f7d140617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- 172.21.15.91:0/2108987205 shutdown_connections 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- 172.21.15.91:0/2108987205 wait complete. 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 Processor -- start 2023-12-13T22:26:48.819 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- start start 2023-12-13T22:26:48.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d140c94b0 0x7f7d1406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d141513c0 0x7f7d14149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:48.820 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141560d0 con 0x7f7d14157e60 2023-12-13T22:26:48.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14156970 con 0x7f7d141513c0 2023-12-13T22:26:48.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.820+0000 7f7d1a589640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14156e00 con 0x7f7d140c94b0 2023-12-13T22:26:48.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.824+0000 7f7d18b26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.824+0000 7f7d18b26640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50618/0 (socket says 172.21.15.91:50618) 2023-12-13T22:26:48.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.824+0000 7f7d18b26640 1 -- 172.21.15.91:0/4210685178 learned_addr learned my addr 172.21.15.91:0/4210685178 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:48.822 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.824+0000 7f7d13fff640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d140c94b0 0x7f7d1406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91640aee20 con 0x7f91700c65f0 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 -- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d140c94b0 msgr2=0x7f7d1406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d140c94b0 0x7f7d1406cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 -- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d141513c0 msgr2=0x7f7d14149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d141513c0 0x7f7d14149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 -- 172.21.15.91:0/4210685178 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c009b30 con 0x7f7d14157e60 2023-12-13T22:26:48.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.828+0000 7f7d18b26640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e50 tx=0x7f7d0c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0c0070 con 0x7f7d14157e60 2023-12-13T22:26:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c0afb80 con 0x7f7d14157e60 2023-12-13T22:26:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1406d220 con 0x7f7d14157e60 2023-12-13T22:26:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c0b8400 con 0x7f7d14157e60 2023-12-13T22:26:48.833 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d14156320 con 0x7f7d14157e60 2023-12-13T22:26:48.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.836+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d14073e70 con 0x7f7d14157e60 2023-12-13T22:26:48.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.864+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f91640efe00 con 0x7f91700c65f0 2023-12-13T22:26:48.896 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.896+0000 7fb6d7fff640 1 -- 172.21.15.91:0/1615494466 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6f01ef860 con 0x7fb6f01512c0 2023-12-13T22:26:48.896 INFO:teuthology.orchestra.run.smithi091.stdout:64424509462 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 msgr2=0x7fb6dc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 0x7fb6dc068d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b2000 tx=0x7fb6e40aa070 comp rx=0 tx=0).stop 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 msgr2=0x7fb6f0148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800cbf0 tx=0x7fb6e800a430 comp rx=0 tx=0).stop 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 shutdown_connections 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb6dc066840 0x7fb6dc068d00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6f01512c0 0x7fb6f0148db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb6f00cb8a0 0x7fb6f01eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 --2- 172.21.15.91:0/1615494466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6f00c6370 0x7fb6f01efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 >> 172.21.15.91:0/1615494466 conn(0x7fb6f006b670 msgr2=0x7fb6f00c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 shutdown_connections 2023-12-13T22:26:48.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:48.900+0000 7fb6f58b3640 1 -- 172.21.15.91:0/1615494466 wait complete. 2023-12-13T22:26:48.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.2 2023-12-13T22:26:48.923 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:49.028 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.028+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9170073e70 con 0x7f91700c65f0 2023-12-13T22:26:49.036 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.036+0000 7f916d7fa640 1 -- 172.21.15.91:0/3223670563 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91640b5030 con 0x7f91700c65f0 2023-12-13T22:26:49.036 INFO:teuthology.orchestra.run.smithi091.stdout:60129542166 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 msgr2=0x7f9154068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 0x7f9154068d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f91700c1d50 tx=0x7f915c006bb0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 msgr2=0x7f9170156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f916401b8c0 tx=0x7f916401ba50 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 shutdown_connections 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9154066840 0x7f9154068d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f91700cc0c0 0x7f91701eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f91700cbce0 0x7f9170155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 --2- 172.21.15.91:0/3223670563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91700c65f0 0x7f9170156410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 >> 172.21.15.91:0/3223670563 conn(0x7f9170070160 msgr2=0x7f91701582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 shutdown_connections 2023-12-13T22:26:49.039 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.040+0000 7f917714a640 1 -- 172.21.15.91:0/3223670563 wait complete. 2023-12-13T22:26:49.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542166 got 60129542166 for osd.0 2023-12-13T22:26:49.054 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:49.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.112+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7d0c0b6040 con 0x7f7d14157e60 2023-12-13T22:26:49.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.112+0000 7f7d10ff9640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 0x7f7d00068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.112+0000 7f7d13fff640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 0x7f7d00068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:49.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.112+0000 7f7d13fff640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 0x7f7d00068d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d04007fd0 tx=0x7f7d04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:49.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.140+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d0c0f3a80 con 0x7f7d14157e60 2023-12-13T22:26:49.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.140+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7d0c0ef6c0 con 0x7f7d14157e60 2023-12-13T22:26:49.309 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.312+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7d14156ab0 con 0x7f7d14157e60 2023-12-13T22:26:49.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d10ff9640 1 -- 172.21.15.91:0/4210685178 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d0c0b4070 con 0x7f7d14157e60 2023-12-13T22:26:49.318 INFO:teuthology.orchestra.run.smithi091.stdout:68719476760 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 msgr2=0x7f7d00068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 0x7f7d00068d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d04007fd0 tx=0x7f7d04009040 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 msgr2=0x7f7d1406bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009e50 tx=0x7f7d0c01bf60 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 shutdown_connections 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7d00066840 0x7f7d00068d00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f7d14157e60 0x7f7d1406bc90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d141513c0 0x7f7d14149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 --2- 172.21.15.91:0/4210685178 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d140c94b0 0x7f7d1406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.320+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 >> 172.21.15.91:0/4210685178 conn(0x7f7d140613d0 msgr2=0x7f7d1414f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:49.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.324+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 shutdown_connections 2023-12-13T22:26:49.322 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.324+0000 7f7d1a589640 1 -- 172.21.15.91:0/4210685178 wait complete. 2023-12-13T22:26:49.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476760 got 68719476760 for osd.4 2023-12-13T22:26:49.338 DEBUG:teuthology.parallel:result is None 2023-12-13T22:26:49.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-13T22:26:49.339 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:26:49.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 Processor -- start 2023-12-13T22:26:49.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 -- start start 2023-12-13T22:26:49.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f54cc151340 0x7f54cc06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc151720 0x7f54cc157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc06f4a0 con 0x7f54cc0c40e0 2023-12-13T22:26:49.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc072570 con 0x7f54cc151340 2023-12-13T22:26:49.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54d228f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc070be0 con 0x7f54cc151720 2023-12-13T22:26:49.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54c37fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc151720 0x7f54cc157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:49.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54c37fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc151720 0x7f54cc157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:59534/0 (socket says 172.21.15.91:59534) 2023-12-13T22:26:49.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.480+0000 7f54c37fe640 1 -- 172.21.15.91:0/707287417 learned_addr learned my addr 172.21.15.91:0/707287417 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:49.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.488+0000 7f54c37fe640 1 -- 172.21.15.91:0/707287417 >> v2:172.21.15.91:3300/0 conn(0x7f54cc151340 msgr2=0x7f54cc06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:49.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.488+0000 7f54c37fe640 1 --2- 172.21.15.91:0/707287417 >> v2:172.21.15.91:3300/0 conn(0x7f54cc151340 0x7f54cc06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.488+0000 7f54c37fe640 1 -- 172.21.15.91:0/707287417 >> v1:172.21.15.91:6789/0 conn(0x7f54cc0c40e0 legacy=0x7f54cc0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:49.487 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.488+0000 7f54c37fe640 1 -- 172.21.15.91:0/707287417 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc158190 con 0x7f54cc151720 2023-12-13T22:26:49.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.492+0000 7f54c37fe640 1 --2- 172.21.15.91:0/707287417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc157c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54cc06c1d0 tx=0x7f54b401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0546d31ac4bad76 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:49.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54cb7fe640 1 -- 172.21.15.91:0/707287417 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40aa610 con 0x7f54cc151720 2023-12-13T22:26:49.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54cb7fe640 1 -- 172.21.15.91:0/707287417 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40a6040 con 0x7f54cc151720 2023-12-13T22:26:49.502 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54cb7fe640 1 -- 172.21.15.91:0/707287417 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40aa990 con 0x7f54cc151720 2023-12-13T22:26:49.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 -- 172.21.15.91:0/707287417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 msgr2=0x7f54cc157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.503 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 --2- 172.21.15.91:0/707287417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc157c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54cc06c1d0 tx=0x7f54b401c490 comp rx=0 tx=0).stop 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 -- 172.21.15.91:0/707287417 shutdown_connections 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 --2- 172.21.15.91:0/707287417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc157c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 --2- 172.21.15.91:0/707287417 >> v2:172.21.15.91:3300/0 conn(0x7f54cc151340 0x7f54cc06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 -- 172.21.15.91:0/707287417 >> 172.21.15.91:0/707287417 conn(0x7f54cc06c6a0 msgr2=0x7f54cc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 -- 172.21.15.91:0/707287417 shutdown_connections 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.504+0000 7f54d228f640 1 -- 172.21.15.91:0/707287417 wait complete. 2023-12-13T22:26:49.504 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 Processor -- start 2023-12-13T22:26:49.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 -- start start 2023-12-13T22:26:49.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c40e0 0x7f54cc1f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c50c0 con 0x7f54cc151340 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc1f2ad0 con 0x7f54cc151720 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54d228f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc160a40 con 0x7f54cc0c40e0 2023-12-13T22:26:49.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:49.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54c37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50642/0 (socket says 172.21.15.91:50642) 2023-12-13T22:26:49.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.508+0000 7f54c37fe640 1 -- 172.21.15.91:0/205228964 learned_addr learned my addr 172.21.15.91:0/205228964 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:49.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54cbfff640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c40e0 0x7f54cc1f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:49.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54c37fe640 1 -- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c40e0 msgr2=0x7f54cc1f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54c37fe640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c40e0 0x7f54cc1f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54c37fe640 1 -- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 msgr2=0x7f54cc156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:49.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54c37fe640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:49.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.512+0000 7f54c37fe640 1 -- 172.21.15.91:0/205228964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40094d0 con 0x7f54cc151340 2023-12-13T22:26:49.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.516+0000 7f54c37fe640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54b401ab40 tx=0x7f54b4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:49.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40b4810 con 0x7f54cc151340 2023-12-13T22:26:49.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40b4970 con 0x7f54cc151340 2023-12-13T22:26:49.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40b4d20 con 0x7f54cc151340 2023-12-13T22:26:49.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc160ce0 con 0x7f54cc151340 2023-12-13T22:26:49.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc0c52a0 con 0x7f54cc151340 2023-12-13T22:26:49.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.520+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc0c6cb0 con 0x7f54cc151340 2023-12-13T22:26:49.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.540+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f54b40c73f0 con 0x7f54cc151340 2023-12-13T22:26:49.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.540+0000 7f54c97fa640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:49.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.540+0000 7f54cbfff640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:49.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.540+0000 7f54cbfff640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00a790 tx=0x7f54bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:49.542 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.544+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54b40aae20 con 0x7f54cc151340 2023-12-13T22:26:49.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.804+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f54b40ec420 con 0x7f54cc151340 2023-12-13T22:26:49.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:49.980+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54cc0729a0 con 0x7f54ac066870 2023-12-13T22:26:50.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.012+0000 7f54c97fa640 1 -- 172.21.15.91:0/205228964 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367894 (secure 0 0 0) 0x7f54cc0729a0 con 0x7f54ac066870 2023-12-13T22:26:50.017 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:50.020 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 msgr2=0x7f54ac068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00a790 tx=0x7f54bc008040 comp rx=0 tx=0).stop 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 msgr2=0x7f54cc1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54b401ab40 tx=0x7f54b4019230 comp rx=0 tx=0).stop 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 shutdown_connections 2023-12-13T22:26:50.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc151720 0x7f54cc156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc151340 0x7f54cc1489a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 --2- 172.21.15.91:0/205228964 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c40e0 0x7f54cc1f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 >> 172.21.15.91:0/205228964 conn(0x7f54cc06c6a0 msgr2=0x7f54cc06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 shutdown_connections 2023-12-13T22:26:50.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.020+0000 7f54d228f640 1 -- 172.21.15.91:0/205228964 wait complete. 2023-12-13T22:26:50.040 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-12-13T22:26:48.579008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":293,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223976,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750744,"statfs":{"total":773094113280,"available":772864761856,"internally_reserved":0,"allocated":3776512,"data_stored":2167718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004124"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.748283+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:26:41.748283+0000","last_peered":"2023-12-13T22:26:41.748283+0000","last_clean":"2023-12-13T22:26:41.748283+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:26:41.748283+0000","last_undegraded":"2023-12-13T22:26:41.748283+0000","last_fullsized":"2023-12-13T22:26:41.748283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282945+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:26:07.282945+0000","last_peered":"2023-12-13T22:26:07.282945+0000","last_clean":"2023-12-13T22:26:07.282945+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:26:07.282945+0000","last_undegraded":"2023-12-13T22:26:07.282945+0000","last_fullsized":"2023-12-13T22:26:07.282945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064619+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:26:09.064619+0000","last_peered":"2023-12-13T22:26:09.064619+0000","last_clean":"2023-12-13T22:26:09.064619+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:26:09.064619+0000","last_undegraded":"2023-12-13T22:26:09.064619+0000","last_fullsized":"2023-12-13T22:26:09.064619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858067+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:26:06.858067+0000","last_peered":"2023-12-13T22:26:06.858067+0000","last_clean":"2023-12-13T22:26:06.858067+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:26:06.858067+0000","last_undegraded":"2023-12-13T22:26:06.858067+0000","last_fullsized":"2023-12-13T22:26:06.858067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017099+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:26:08.017099+0000","last_peered":"2023-12-13T22:26:08.017099+0000","last_clean":"2023-12-13T22:26:08.017099+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:26:08.017099+0000","last_undegraded":"2023-12-13T22:26:08.017099+0000","last_fullsized":"2023-12-13T22:26:08.017099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.789931+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:26:41.789931+0000","last_peered":"2023-12-13T22:26:41.789931+0000","last_clean":"2023-12-13T22:26:41.789931+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:26:41.789931+0000","last_undegraded":"2023-12-13T22:26:41.789931+0000","last_fullsized":"2023-12-13T22:26:41.789931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994069+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:26:06.994069+0000","last_peered":"2023-12-13T22:26:06.994069+0000","last_clean":"2023-12-13T22:26:06.994069+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:26:06.994069+0000","last_undegraded":"2023-12-13T22:26:06.994069+0000","last_fullsized":"2023-12-13T22:26:06.994069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017831+0000","last_change":"2023-12-13T22:26:05.940088+0000","last_active":"2023-12-13T22:26:08.017831+0000","last_peered":"2023-12-13T22:26:08.017831+0000","last_clean":"2023-12-13T22:26:08.017831+0000","last_became_active":"2023-12-13T22:26:05.939662+0000","last_became_peered":"2023-12-13T22:26:05.939662+0000","last_unstale":"2023-12-13T22:26:08.017831+0000","last_undegraded":"2023-12-13T22:26:08.017831+0000","last_fullsized":"2023-12-13T22:26:08.017831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:15.268425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890675+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:26:06.890675+0000","last_peered":"2023-12-13T22:26:06.890675+0000","last_clean":"2023-12-13T22:26:06.890675+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:26:06.890675+0000","last_undegraded":"2023-12-13T22:26:06.890675+0000","last_fullsized":"2023-12-13T22:26:06.890675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994756+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:26:06.994756+0000","last_peered":"2023-12-13T22:26:06.994756+0000","last_clean":"2023-12-13T22:26:06.994756+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:26:06.994756+0000","last_undegraded":"2023-12-13T22:26:06.994756+0000","last_fullsized":"2023-12-13T22:26:06.994756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017505+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:26:08.017505+0000","last_peered":"2023-12-13T22:26:08.017505+0000","last_clean":"2023-12-13T22:26:08.017505+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:26:08.017505+0000","last_undegraded":"2023-12-13T22:26:08.017505+0000","last_fullsized":"2023-12-13T22:26:08.017505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911212+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:26:06.911212+0000","last_peered":"2023-12-13T22:26:06.911212+0000","last_clean":"2023-12-13T22:26:06.911212+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:26:06.911212+0000","last_undegraded":"2023-12-13T22:26:06.911212+0000","last_fullsized":"2023-12-13T22:26:06.911212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.688525+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:26:38.688525+0000","last_peered":"2023-12-13T22:26:38.688525+0000","last_clean":"2023-12-13T22:26:38.688525+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:26:38.688525+0000","last_undegraded":"2023-12-13T22:26:38.688525+0000","last_fullsized":"2023-12-13T22:26:38.688525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018802+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:26:08.018802+0000","last_peered":"2023-12-13T22:26:08.018802+0000","last_clean":"2023-12-13T22:26:08.018802+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:26:08.018802+0000","last_undegraded":"2023-12-13T22:26:08.018802+0000","last_fullsized":"2023-12-13T22:26:08.018802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282430+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:26:07.282430+0000","last_peered":"2023-12-13T22:26:07.282430+0000","last_clean":"2023-12-13T22:26:07.282430+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:26:07.282430+0000","last_undegraded":"2023-12-13T22:26:07.282430+0000","last_fullsized":"2023-12-13T22:26:07.282430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062084+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:26:09.062084+0000","last_peered":"2023-12-13T22:26:09.062084+0000","last_clean":"2023-12-13T22:26:09.062084+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:26:09.062084+0000","last_undegraded":"2023-12-13T22:26:09.062084+0000","last_fullsized":"2023-12-13T22:26:09.062084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019042+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:26:08.019042+0000","last_peered":"2023-12-13T22:26:08.019042+0000","last_clean":"2023-12-13T22:26:08.019042+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:26:08.019042+0000","last_undegraded":"2023-12-13T22:26:08.019042+0000","last_fullsized":"2023-12-13T22:26:08.019042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282270+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:26:07.282270+0000","last_peered":"2023-12-13T22:26:07.282270+0000","last_clean":"2023-12-13T22:26:07.282270+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:26:07.282270+0000","last_undegraded":"2023-12-13T22:26:07.282270+0000","last_fullsized":"2023-12-13T22:26:07.282270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.836271+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:26:38.836271+0000","last_peered":"2023-12-13T22:26:38.836271+0000","last_clean":"2023-12-13T22:26:38.836271+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:26:38.836271+0000","last_undegraded":"2023-12-13T22:26:38.836271+0000","last_fullsized":"2023-12-13T22:26:38.836271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062830+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:26:09.062830+0000","last_peered":"2023-12-13T22:26:09.062830+0000","last_clean":"2023-12-13T22:26:09.062830+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:26:09.062830+0000","last_undegraded":"2023-12-13T22:26:09.062830+0000","last_fullsized":"2023-12-13T22:26:09.062830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291842+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:26:07.291842+0000","last_peered":"2023-12-13T22:26:07.291842+0000","last_clean":"2023-12-13T22:26:07.291842+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:26:07.291842+0000","last_undegraded":"2023-12-13T22:26:07.291842+0000","last_fullsized":"2023-12-13T22:26:07.291842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.688564+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:26:38.688564+0000","last_peered":"2023-12-13T22:26:38.688564+0000","last_clean":"2023-12-13T22:26:38.688564+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:26:38.688564+0000","last_undegraded":"2023-12-13T22:26:38.688564+0000","last_fullsized":"2023-12-13T22:26:38.688564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018910+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:26:08.018910+0000","last_peered":"2023-12-13T22:26:08.018910+0000","last_clean":"2023-12-13T22:26:08.018910+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:26:08.018910+0000","last_undegraded":"2023-12-13T22:26:08.018910+0000","last_fullsized":"2023-12-13T22:26:08.018910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858749+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:26:06.858749+0000","last_peered":"2023-12-13T22:26:06.858749+0000","last_clean":"2023-12-13T22:26:06.858749+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:26:06.858749+0000","last_undegraded":"2023-12-13T22:26:06.858749+0000","last_fullsized":"2023-12-13T22:26:06.858749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890233+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:26:38.890233+0000","last_peered":"2023-12-13T22:26:38.890233+0000","last_clean":"2023-12-13T22:26:38.890233+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:26:38.890233+0000","last_undegraded":"2023-12-13T22:26:38.890233+0000","last_fullsized":"2023-12-13T22:26:38.890233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017812+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:26:08.017812+0000","last_peered":"2023-12-13T22:26:08.017812+0000","last_clean":"2023-12-13T22:26:08.017812+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:26:08.017812+0000","last_undegraded":"2023-12-13T22:26:08.017812+0000","last_fullsized":"2023-12-13T22:26:08.017812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283278+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:26:07.283278+0000","last_peered":"2023-12-13T22:26:07.283278+0000","last_clean":"2023-12-13T22:26:07.283278+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:26:07.283278+0000","last_undegraded":"2023-12-13T22:26:07.283278+0000","last_fullsized":"2023-12-13T22:26:07.283278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.610452+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:26:41.610452+0000","last_peered":"2023-12-13T22:26:41.610452+0000","last_clean":"2023-12-13T22:26:41.610452+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:26:41.610452+0000","last_undegraded":"2023-12-13T22:26:41.610452+0000","last_fullsized":"2023-12-13T22:26:41.610452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063386+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:26:09.063386+0000","last_peered":"2023-12-13T22:26:09.063386+0000","last_clean":"2023-12-13T22:26:09.063386+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:26:09.063386+0000","last_undegraded":"2023-12-13T22:26:09.063386+0000","last_fullsized":"2023-12-13T22:26:09.063386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286245+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:26:07.286245+0000","last_peered":"2023-12-13T22:26:07.286245+0000","last_clean":"2023-12-13T22:26:07.286245+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:26:07.286245+0000","last_undegraded":"2023-12-13T22:26:07.286245+0000","last_fullsized":"2023-12-13T22:26:07.286245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063558+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:26:09.063558+0000","last_peered":"2023-12-13T22:26:09.063558+0000","last_clean":"2023-12-13T22:26:09.063558+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:26:09.063558+0000","last_undegraded":"2023-12-13T22:26:09.063558+0000","last_fullsized":"2023-12-13T22:26:09.063558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.983999+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:26:07.983999+0000","last_peered":"2023-12-13T22:26:07.983999+0000","last_clean":"2023-12-13T22:26:07.983999+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:26:07.983999+0000","last_undegraded":"2023-12-13T22:26:07.983999+0000","last_fullsized":"2023-12-13T22:26:07.983999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994774+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:26:06.994774+0000","last_peered":"2023-12-13T22:26:06.994774+0000","last_clean":"2023-12-13T22:26:06.994774+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:26:06.994774+0000","last_undegraded":"2023-12-13T22:26:06.994774+0000","last_fullsized":"2023-12-13T22:26:06.994774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286309+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:26:07.286309+0000","last_peered":"2023-12-13T22:26:07.286309+0000","last_clean":"2023-12-13T22:26:07.286309+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:26:07.286309+0000","last_undegraded":"2023-12-13T22:26:07.286309+0000","last_fullsized":"2023-12-13T22:26:07.286309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061487+0000","last_change":"2023-12-13T22:26:05.944559+0000","last_active":"2023-12-13T22:26:09.061487+0000","last_peered":"2023-12-13T22:26:09.061487+0000","last_clean":"2023-12-13T22:26:09.061487+0000","last_became_active":"2023-12-13T22:26:05.943841+0000","last_became_peered":"2023-12-13T22:26:05.943841+0000","last_unstale":"2023-12-13T22:26:09.061487+0000","last_undegraded":"2023-12-13T22:26:09.061487+0000","last_fullsized":"2023-12-13T22:26:09.061487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291954+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:26:07.291954+0000","last_peered":"2023-12-13T22:26:07.291954+0000","last_clean":"2023-12-13T22:26:07.291954+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:26:07.291954+0000","last_undegraded":"2023-12-13T22:26:07.291954+0000","last_fullsized":"2023-12-13T22:26:07.291954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062351+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:26:09.062351+0000","last_peered":"2023-12-13T22:26:09.062351+0000","last_clean":"2023-12-13T22:26:09.062351+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:26:09.062351+0000","last_undegraded":"2023-12-13T22:26:09.062351+0000","last_fullsized":"2023-12-13T22:26:09.062351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062075+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:26:09.062075+0000","last_peered":"2023-12-13T22:26:09.062075+0000","last_clean":"2023-12-13T22:26:09.062075+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:26:09.062075+0000","last_undegraded":"2023-12-13T22:26:09.062075+0000","last_fullsized":"2023-12-13T22:26:09.062075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285856+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:26:07.285856+0000","last_peered":"2023-12-13T22:26:07.285856+0000","last_clean":"2023-12-13T22:26:07.285856+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:26:07.285856+0000","last_undegraded":"2023-12-13T22:26:07.285856+0000","last_fullsized":"2023-12-13T22:26:07.285856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775826+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:26:41.775826+0000","last_peered":"2023-12-13T22:26:41.775826+0000","last_clean":"2023-12-13T22:26:41.775826+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:26:41.775826+0000","last_undegraded":"2023-12-13T22:26:41.775826+0000","last_fullsized":"2023-12-13T22:26:41.775826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063001+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:26:09.063001+0000","last_peered":"2023-12-13T22:26:09.063001+0000","last_clean":"2023-12-13T22:26:09.063001+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:26:09.063001+0000","last_undegraded":"2023-12-13T22:26:09.063001+0000","last_fullsized":"2023-12-13T22:26:09.063001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857511+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:26:06.857511+0000","last_peered":"2023-12-13T22:26:06.857511+0000","last_clean":"2023-12-13T22:26:06.857511+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:26:06.857511+0000","last_undegraded":"2023-12-13T22:26:06.857511+0000","last_fullsized":"2023-12-13T22:26:06.857511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.789235+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:26:41.789235+0000","last_peered":"2023-12-13T22:26:41.789235+0000","last_clean":"2023-12-13T22:26:41.789235+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:26:41.789235+0000","last_undegraded":"2023-12-13T22:26:41.789235+0000","last_fullsized":"2023-12-13T22:26:41.789235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984268+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:26:07.984268+0000","last_peered":"2023-12-13T22:26:07.984268+0000","last_clean":"2023-12-13T22:26:07.984268+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:26:07.984268+0000","last_undegraded":"2023-12-13T22:26:07.984268+0000","last_fullsized":"2023-12-13T22:26:07.984268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282052+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:26:07.282052+0000","last_peered":"2023-12-13T22:26:07.282052+0000","last_clean":"2023-12-13T22:26:07.282052+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:26:07.282052+0000","last_undegraded":"2023-12-13T22:26:07.282052+0000","last_fullsized":"2023-12-13T22:26:07.282052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.897514+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:26:38.897514+0000","last_peered":"2023-12-13T22:26:38.897514+0000","last_clean":"2023-12-13T22:26:38.897514+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:26:38.897514+0000","last_undegraded":"2023-12-13T22:26:38.897514+0000","last_fullsized":"2023-12-13T22:26:38.897514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889497+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:26:06.889497+0000","last_peered":"2023-12-13T22:26:06.889497+0000","last_clean":"2023-12-13T22:26:06.889497+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:26:06.889497+0000","last_undegraded":"2023-12-13T22:26:06.889497+0000","last_fullsized":"2023-12-13T22:26:06.889497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924748+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:26:07.924748+0000","last_peered":"2023-12-13T22:26:07.924748+0000","last_clean":"2023-12-13T22:26:07.924748+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:26:07.924748+0000","last_undegraded":"2023-12-13T22:26:07.924748+0000","last_fullsized":"2023-12-13T22:26:07.924748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890978+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:26:06.890978+0000","last_peered":"2023-12-13T22:26:06.890978+0000","last_clean":"2023-12-13T22:26:06.890978+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:26:06.890978+0000","last_undegraded":"2023-12-13T22:26:06.890978+0000","last_fullsized":"2023-12-13T22:26:06.890978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775205+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:26:41.775205+0000","last_peered":"2023-12-13T22:26:41.775205+0000","last_clean":"2023-12-13T22:26:41.775205+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:26:41.775205+0000","last_undegraded":"2023-12-13T22:26:41.775205+0000","last_fullsized":"2023-12-13T22:26:41.775205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924406+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:26:07.924406+0000","last_peered":"2023-12-13T22:26:07.924406+0000","last_clean":"2023-12-13T22:26:07.924406+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:26:07.924406+0000","last_undegraded":"2023-12-13T22:26:07.924406+0000","last_fullsized":"2023-12-13T22:26:07.924406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994199+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:26:06.994199+0000","last_peered":"2023-12-13T22:26:06.994199+0000","last_clean":"2023-12-13T22:26:06.994199+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:26:06.994199+0000","last_undegraded":"2023-12-13T22:26:06.994199+0000","last_fullsized":"2023-12-13T22:26:06.994199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286596+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:26:07.286596+0000","last_peered":"2023-12-13T22:26:07.286596+0000","last_clean":"2023-12-13T22:26:07.286596+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:26:07.286596+0000","last_undegraded":"2023-12-13T22:26:07.286596+0000","last_fullsized":"2023-12-13T22:26:07.286596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984240+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:26:07.984240+0000","last_peered":"2023-12-13T22:26:07.984240+0000","last_clean":"2023-12-13T22:26:07.984240+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:26:07.984240+0000","last_undegraded":"2023-12-13T22:26:07.984240+0000","last_fullsized":"2023-12-13T22:26:07.984240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893338+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:26:06.893338+0000","last_peered":"2023-12-13T22:26:06.893338+0000","last_clean":"2023-12-13T22:26:06.893338+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:26:06.893338+0000","last_undegraded":"2023-12-13T22:26:06.893338+0000","last_fullsized":"2023-12-13T22:26:06.893338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827411+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:26:07.827411+0000","last_peered":"2023-12-13T22:26:07.827411+0000","last_clean":"2023-12-13T22:26:07.827411+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:26:07.827411+0000","last_undegraded":"2023-12-13T22:26:07.827411+0000","last_fullsized":"2023-12-13T22:26:07.827411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.060442+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:26:09.060442+0000","last_peered":"2023-12-13T22:26:09.060442+0000","last_clean":"2023-12-13T22:26:09.060442+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:26:09.060442+0000","last_undegraded":"2023-12-13T22:26:09.060442+0000","last_fullsized":"2023-12-13T22:26:09.060442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891642+0000","last_change":"2023-12-13T22:26:00.418974+0000","last_active":"2023-12-13T22:26:06.891642+0000","last_peered":"2023-12-13T22:26:06.891642+0000","last_clean":"2023-12-13T22:26:06.891642+0000","last_became_active":"2023-12-13T22:26:00.418573+0000","last_became_peered":"2023-12-13T22:26:00.418573+0000","last_unstale":"2023-12-13T22:26:06.891642+0000","last_undegraded":"2023-12-13T22:26:06.891642+0000","last_fullsized":"2023-12-13T22:26:06.891642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019674+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:26:08.019674+0000","last_peered":"2023-12-13T22:26:08.019674+0000","last_clean":"2023-12-13T22:26:08.019674+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:26:08.019674+0000","last_undegraded":"2023-12-13T22:26:08.019674+0000","last_fullsized":"2023-12-13T22:26:08.019674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017051+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:26:08.017051+0000","last_peered":"2023-12-13T22:26:08.017051+0000","last_clean":"2023-12-13T22:26:08.017051+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:26:08.017051+0000","last_undegraded":"2023-12-13T22:26:08.017051+0000","last_fullsized":"2023-12-13T22:26:08.017051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889629+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:26:06.889629+0000","last_peered":"2023-12-13T22:26:06.889629+0000","last_clean":"2023-12-13T22:26:06.889629+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:26:06.889629+0000","last_undegraded":"2023-12-13T22:26:06.889629+0000","last_fullsized":"2023-12-13T22:26:06.889629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.777594+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:26:41.777594+0000","last_peered":"2023-12-13T22:26:41.777594+0000","last_clean":"2023-12-13T22:26:41.777594+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:26:41.777594+0000","last_undegraded":"2023-12-13T22:26:41.777594+0000","last_fullsized":"2023-12-13T22:26:41.777594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984199+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:26:07.984199+0000","last_peered":"2023-12-13T22:26:07.984199+0000","last_clean":"2023-12-13T22:26:07.984199+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:26:07.984199+0000","last_undegraded":"2023-12-13T22:26:07.984199+0000","last_fullsized":"2023-12-13T22:26:07.984199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909876+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:26:06.909876+0000","last_peered":"2023-12-13T22:26:06.909876+0000","last_clean":"2023-12-13T22:26:06.909876+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:26:06.909876+0000","last_undegraded":"2023-12-13T22:26:06.909876+0000","last_fullsized":"2023-12-13T22:26:06.909876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.746838+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:26:41.746838+0000","last_peered":"2023-12-13T22:26:41.746838+0000","last_clean":"2023-12-13T22:26:41.746838+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:26:41.746838+0000","last_undegraded":"2023-12-13T22:26:41.746838+0000","last_fullsized":"2023-12-13T22:26:41.746838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064384+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:26:09.064384+0000","last_peered":"2023-12-13T22:26:09.064384+0000","last_clean":"2023-12-13T22:26:09.064384+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:26:09.064384+0000","last_undegraded":"2023-12-13T22:26:09.064384+0000","last_fullsized":"2023-12-13T22:26:09.064384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890397+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:26:06.890397+0000","last_peered":"2023-12-13T22:26:06.890397+0000","last_clean":"2023-12-13T22:26:06.890397+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:26:06.890397+0000","last_undegraded":"2023-12-13T22:26:06.890397+0000","last_fullsized":"2023-12-13T22:26:06.890397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.897482+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:26:38.897482+0000","last_peered":"2023-12-13T22:26:38.897482+0000","last_clean":"2023-12-13T22:26:38.897482+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:26:38.897482+0000","last_undegraded":"2023-12-13T22:26:38.897482+0000","last_fullsized":"2023-12-13T22:26:38.897482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064123+0000","last_change":"2023-12-13T22:26:06.547843+0000","last_active":"2023-12-13T22:26:09.064123+0000","last_peered":"2023-12-13T22:26:09.064123+0000","last_clean":"2023-12-13T22:26:09.064123+0000","last_became_active":"2023-12-13T22:26:06.546738+0000","last_became_peered":"2023-12-13T22:26:06.546738+0000","last_unstale":"2023-12-13T22:26:09.064123+0000","last_undegraded":"2023-12-13T22:26:09.064123+0000","last_fullsized":"2023-12-13T22:26:09.064123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:02:37.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858138+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:26:06.858138+0000","last_peered":"2023-12-13T22:26:06.858138+0000","last_clean":"2023-12-13T22:26:06.858138+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:26:06.858138+0000","last_undegraded":"2023-12-13T22:26:06.858138+0000","last_fullsized":"2023-12-13T22:26:06.858138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.742916+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:26:41.742916+0000","last_peered":"2023-12-13T22:26:41.742916+0000","last_clean":"2023-12-13T22:26:41.742916+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:26:41.742916+0000","last_undegraded":"2023-12-13T22:26:41.742916+0000","last_fullsized":"2023-12-13T22:26:41.742916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061946+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:26:09.061946+0000","last_peered":"2023-12-13T22:26:09.061946+0000","last_clean":"2023-12-13T22:26:09.061946+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:26:09.061946+0000","last_undegraded":"2023-12-13T22:26:09.061946+0000","last_fullsized":"2023-12-13T22:26:09.061946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890732+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:26:06.890732+0000","last_peered":"2023-12-13T22:26:06.890732+0000","last_clean":"2023-12-13T22:26:06.890732+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:26:06.890732+0000","last_undegraded":"2023-12-13T22:26:06.890732+0000","last_fullsized":"2023-12-13T22:26:06.890732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890051+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:26:38.890051+0000","last_peered":"2023-12-13T22:26:38.890051+0000","last_clean":"2023-12-13T22:26:38.890051+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:26:38.890051+0000","last_undegraded":"2023-12-13T22:26:38.890051+0000","last_fullsized":"2023-12-13T22:26:38.890051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061708+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:26:09.061708+0000","last_peered":"2023-12-13T22:26:09.061708+0000","last_clean":"2023-12-13T22:26:09.061708+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:26:09.061708+0000","last_undegraded":"2023-12-13T22:26:09.061708+0000","last_fullsized":"2023-12-13T22:26:09.061708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292771+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:26:07.292771+0000","last_peered":"2023-12-13T22:26:07.292771+0000","last_clean":"2023-12-13T22:26:07.292771+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:26:07.292771+0000","last_undegraded":"2023-12-13T22:26:07.292771+0000","last_fullsized":"2023-12-13T22:26:07.292771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062550+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:26:09.062550+0000","last_peered":"2023-12-13T22:26:09.062550+0000","last_clean":"2023-12-13T22:26:09.062550+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:26:09.062550+0000","last_undegraded":"2023-12-13T22:26:09.062550+0000","last_fullsized":"2023-12-13T22:26:09.062550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018583+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:26:08.018583+0000","last_peered":"2023-12-13T22:26:08.018583+0000","last_clean":"2023-12-13T22:26:08.018583+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:26:08.018583+0000","last_undegraded":"2023-12-13T22:26:08.018583+0000","last_fullsized":"2023-12-13T22:26:08.018583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858759+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:26:06.858759+0000","last_peered":"2023-12-13T22:26:06.858759+0000","last_clean":"2023-12-13T22:26:06.858759+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:26:06.858759+0000","last_undegraded":"2023-12-13T22:26:06.858759+0000","last_fullsized":"2023-12-13T22:26:06.858759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.896323+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:26:38.896323+0000","last_peered":"2023-12-13T22:26:38.896323+0000","last_clean":"2023-12-13T22:26:38.896323+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:26:38.896323+0000","last_undegraded":"2023-12-13T22:26:38.896323+0000","last_fullsized":"2023-12-13T22:26:38.896323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063423+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:26:09.063423+0000","last_peered":"2023-12-13T22:26:09.063423+0000","last_clean":"2023-12-13T22:26:09.063423+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:26:09.063423+0000","last_undegraded":"2023-12-13T22:26:09.063423+0000","last_fullsized":"2023-12-13T22:26:09.063423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994895+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:26:06.994895+0000","last_peered":"2023-12-13T22:26:06.994895+0000","last_clean":"2023-12-13T22:26:06.994895+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:26:06.994895+0000","last_undegraded":"2023-12-13T22:26:06.994895+0000","last_fullsized":"2023-12-13T22:26:06.994895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890672+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:26:38.890672+0000","last_peered":"2023-12-13T22:26:38.890672+0000","last_clean":"2023-12-13T22:26:38.890672+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:26:38.890672+0000","last_undegraded":"2023-12-13T22:26:38.890672+0000","last_fullsized":"2023-12-13T22:26:38.890672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984083+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:26:07.984083+0000","last_peered":"2023-12-13T22:26:07.984083+0000","last_clean":"2023-12-13T22:26:07.984083+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:26:07.984083+0000","last_undegraded":"2023-12-13T22:26:07.984083+0000","last_fullsized":"2023-12-13T22:26:07.984083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285814+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:26:07.285814+0000","last_peered":"2023-12-13T22:26:07.285814+0000","last_clean":"2023-12-13T22:26:07.285814+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:26:07.285814+0000","last_undegraded":"2023-12-13T22:26:07.285814+0000","last_fullsized":"2023-12-13T22:26:07.285814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061356+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:26:09.061356+0000","last_peered":"2023-12-13T22:26:09.061356+0000","last_clean":"2023-12-13T22:26:09.061356+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:26:09.061356+0000","last_undegraded":"2023-12-13T22:26:09.061356+0000","last_fullsized":"2023-12-13T22:26:09.061356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.925274+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:26:07.925274+0000","last_peered":"2023-12-13T22:26:07.925274+0000","last_clean":"2023-12-13T22:26:07.925274+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:26:07.925274+0000","last_undegraded":"2023-12-13T22:26:07.925274+0000","last_fullsized":"2023-12-13T22:26:07.925274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282151+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:26:07.282151+0000","last_peered":"2023-12-13T22:26:07.282151+0000","last_clean":"2023-12-13T22:26:07.282151+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:26:07.282151+0000","last_undegraded":"2023-12-13T22:26:07.282151+0000","last_fullsized":"2023-12-13T22:26:07.282151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.751410+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:26:41.751410+0000","last_peered":"2023-12-13T22:26:41.751410+0000","last_clean":"2023-12-13T22:26:41.751410+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:26:41.751410+0000","last_undegraded":"2023-12-13T22:26:41.751410+0000","last_fullsized":"2023-12-13T22:26:41.751410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.746077+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:26:41.746077+0000","last_peered":"2023-12-13T22:26:41.746077+0000","last_clean":"2023-12-13T22:26:41.746077+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:26:41.746077+0000","last_undegraded":"2023-12-13T22:26:41.746077+0000","last_fullsized":"2023-12-13T22:26:41.746077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858860+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:26:06.858860+0000","last_peered":"2023-12-13T22:26:06.858860+0000","last_clean":"2023-12-13T22:26:06.858860+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:26:06.858860+0000","last_undegraded":"2023-12-13T22:26:06.858860+0000","last_fullsized":"2023-12-13T22:26:06.858860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.815590+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:26:08.815590+0000","last_peered":"2023-12-13T22:26:08.815590+0000","last_clean":"2023-12-13T22:26:08.815590+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:26:08.815590+0000","last_undegraded":"2023-12-13T22:26:08.815590+0000","last_fullsized":"2023-12-13T22:26:08.815590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.914814+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:26:38.914814+0000","last_peered":"2023-12-13T22:26:38.914814+0000","last_clean":"2023-12-13T22:26:38.914814+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:26:38.914814+0000","last_undegraded":"2023-12-13T22:26:38.914814+0000","last_fullsized":"2023-12-13T22:26:38.914814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291838+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:26:07.291838+0000","last_peered":"2023-12-13T22:26:07.291838+0000","last_clean":"2023-12-13T22:26:07.291838+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:26:07.291838+0000","last_undegraded":"2023-12-13T22:26:07.291838+0000","last_fullsized":"2023-12-13T22:26:07.291838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064331+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:26:09.064331+0000","last_peered":"2023-12-13T22:26:09.064331+0000","last_clean":"2023-12-13T22:26:09.064331+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:26:09.064331+0000","last_undegraded":"2023-12-13T22:26:09.064331+0000","last_fullsized":"2023-12-13T22:26:09.064331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909726+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:26:06.909726+0000","last_peered":"2023-12-13T22:26:06.909726+0000","last_clean":"2023-12-13T22:26:06.909726+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:26:06.909726+0000","last_undegraded":"2023-12-13T22:26:06.909726+0000","last_fullsized":"2023-12-13T22:26:06.909726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.826916+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:26:07.826916+0000","last_peered":"2023-12-13T22:26:07.826916+0000","last_clean":"2023-12-13T22:26:07.826916+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:26:07.826916+0000","last_undegraded":"2023-12-13T22:26:07.826916+0000","last_fullsized":"2023-12-13T22:26:07.826916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994203+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:26:06.994203+0000","last_peered":"2023-12-13T22:26:06.994203+0000","last_clean":"2023-12-13T22:26:06.994203+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:26:06.994203+0000","last_undegraded":"2023-12-13T22:26:06.994203+0000","last_fullsized":"2023-12-13T22:26:06.994203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858620+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:26:06.858620+0000","last_peered":"2023-12-13T22:26:06.858620+0000","last_clean":"2023-12-13T22:26:06.858620+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:26:06.858620+0000","last_undegraded":"2023-12-13T22:26:06.858620+0000","last_fullsized":"2023-12-13T22:26:06.858620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282688+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:26:07.282688+0000","last_peered":"2023-12-13T22:26:07.282688+0000","last_clean":"2023-12-13T22:26:07.282688+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:26:07.282688+0000","last_undegraded":"2023-12-13T22:26:07.282688+0000","last_fullsized":"2023-12-13T22:26:07.282688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286261+0000","last_change":"2023-12-13T22:26:00.413885+0000","last_active":"2023-12-13T22:26:07.286261+0000","last_peered":"2023-12-13T22:26:07.286261+0000","last_clean":"2023-12-13T22:26:07.286261+0000","last_became_active":"2023-12-13T22:26:00.413588+0000","last_became_peered":"2023-12-13T22:26:00.413588+0000","last_unstale":"2023-12-13T22:26:07.286261+0000","last_undegraded":"2023-12-13T22:26:07.286261+0000","last_fullsized":"2023-12-13T22:26:07.286261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912253+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:26:06.912253+0000","last_peered":"2023-12-13T22:26:06.912253+0000","last_clean":"2023-12-13T22:26:06.912253+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:26:06.912253+0000","last_undegraded":"2023-12-13T22:26:06.912253+0000","last_fullsized":"2023-12-13T22:26:06.912253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283197+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:26:07.283197+0000","last_peered":"2023-12-13T22:26:07.283197+0000","last_clean":"2023-12-13T22:26:07.283197+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:26:07.283197+0000","last_undegraded":"2023-12-13T22:26:07.283197+0000","last_fullsized":"2023-12-13T22:26:07.283197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994173+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:26:06.994173+0000","last_peered":"2023-12-13T22:26:06.994173+0000","last_clean":"2023-12-13T22:26:06.994173+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:26:06.994173+0000","last_undegraded":"2023-12-13T22:26:06.994173+0000","last_fullsized":"2023-12-13T22:26:06.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282308+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:26:07.282308+0000","last_peered":"2023-12-13T22:26:07.282308+0000","last_clean":"2023-12-13T22:26:07.282308+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282308+0000","last_undegraded":"2023-12-13T22:26:07.282308+0000","last_fullsized":"2023-12-13T22:26:07.282308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994078+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:26:06.994078+0000","last_peered":"2023-12-13T22:26:06.994078+0000","last_clean":"2023-12-13T22:26:06.994078+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:26:06.994078+0000","last_undegraded":"2023-12-13T22:26:06.994078+0000","last_fullsized":"2023-12-13T22:26:06.994078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858162+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:26:06.858162+0000","last_peered":"2023-12-13T22:26:06.858162+0000","last_clean":"2023-12-13T22:26:06.858162+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:26:06.858162+0000","last_undegraded":"2023-12-13T22:26:06.858162+0000","last_fullsized":"2023-12-13T22:26:06.858162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910747+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:26:06.910747+0000","last_peered":"2023-12-13T22:26:06.910747+0000","last_clean":"2023-12-13T22:26:06.910747+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:26:06.910747+0000","last_undegraded":"2023-12-13T22:26:06.910747+0000","last_fullsized":"2023-12-13T22:26:06.910747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891457+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:26:06.891457+0000","last_peered":"2023-12-13T22:26:06.891457+0000","last_clean":"2023-12-13T22:26:06.891457+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:26:06.891457+0000","last_undegraded":"2023-12-13T22:26:06.891457+0000","last_fullsized":"2023-12-13T22:26:06.891457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827315+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:26:07.827315+0000","last_peered":"2023-12-13T22:26:07.827315+0000","last_clean":"2023-12-13T22:26:07.827315+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:26:07.827315+0000","last_undegraded":"2023-12-13T22:26:07.827315+0000","last_fullsized":"2023-12-13T22:26:07.827315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.995002+0000","last_change":"2023-12-13T22:26:00.417280+0000","last_active":"2023-12-13T22:26:06.995002+0000","last_peered":"2023-12-13T22:26:06.995002+0000","last_clean":"2023-12-13T22:26:06.995002+0000","last_became_active":"2023-12-13T22:26:00.410002+0000","last_became_peered":"2023-12-13T22:26:00.410002+0000","last_unstale":"2023-12-13T22:26:06.995002+0000","last_undegraded":"2023-12-13T22:26:06.995002+0000","last_fullsized":"2023-12-13T22:26:06.995002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994368+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:26:06.994368+0000","last_peered":"2023-12-13T22:26:06.994368+0000","last_clean":"2023-12-13T22:26:06.994368+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:26:06.994368+0000","last_undegraded":"2023-12-13T22:26:06.994368+0000","last_fullsized":"2023-12-13T22:26:06.994368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285823+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:26:07.285823+0000","last_peered":"2023-12-13T22:26:07.285823+0000","last_clean":"2023-12-13T22:26:07.285823+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:26:07.285823+0000","last_undegraded":"2023-12-13T22:26:07.285823+0000","last_fullsized":"2023-12-13T22:26:07.285823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857773+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:26:06.857773+0000","last_peered":"2023-12-13T22:26:06.857773+0000","last_clean":"2023-12-13T22:26:06.857773+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:26:06.857773+0000","last_undegraded":"2023-12-13T22:26:06.857773+0000","last_fullsized":"2023-12-13T22:26:06.857773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282281+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:26:07.282281+0000","last_peered":"2023-12-13T22:26:07.282281+0000","last_clean":"2023-12-13T22:26:07.282281+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:26:07.282281+0000","last_undegraded":"2023-12-13T22:26:07.282281+0000","last_fullsized":"2023-12-13T22:26:07.282281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292704+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:26:07.292704+0000","last_peered":"2023-12-13T22:26:07.292704+0000","last_clean":"2023-12-13T22:26:07.292704+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:26:07.292704+0000","last_undegraded":"2023-12-13T22:26:07.292704+0000","last_fullsized":"2023-12-13T22:26:07.292704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911675+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:26:06.911675+0000","last_peered":"2023-12-13T22:26:06.911675+0000","last_clean":"2023-12-13T22:26:06.911675+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:26:06.911675+0000","last_undegraded":"2023-12-13T22:26:06.911675+0000","last_fullsized":"2023-12-13T22:26:06.911675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912154+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:26:06.912154+0000","last_peered":"2023-12-13T22:26:06.912154+0000","last_clean":"2023-12-13T22:26:06.912154+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:26:06.912154+0000","last_undegraded":"2023-12-13T22:26:06.912154+0000","last_fullsized":"2023-12-13T22:26:06.912154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893269+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:26:06.893269+0000","last_peered":"2023-12-13T22:26:06.893269+0000","last_clean":"2023-12-13T22:26:06.893269+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:26:06.893269+0000","last_undegraded":"2023-12-13T22:26:06.893269+0000","last_fullsized":"2023-12-13T22:26:06.893269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282030+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:26:07.282030+0000","last_peered":"2023-12-13T22:26:07.282030+0000","last_clean":"2023-12-13T22:26:07.282030+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282030+0000","last_undegraded":"2023-12-13T22:26:07.282030+0000","last_fullsized":"2023-12-13T22:26:07.282030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889619+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:26:06.889619+0000","last_peered":"2023-12-13T22:26:06.889619+0000","last_clean":"2023-12-13T22:26:06.889619+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:26:06.889619+0000","last_undegraded":"2023-12-13T22:26:06.889619+0000","last_fullsized":"2023-12-13T22:26:06.889619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994089+0000","last_change":"2023-12-13T22:26:00.401677+0000","last_active":"2023-12-13T22:26:06.994089+0000","last_peered":"2023-12-13T22:26:06.994089+0000","last_clean":"2023-12-13T22:26:06.994089+0000","last_became_active":"2023-12-13T22:26:00.401389+0000","last_became_peered":"2023-12-13T22:26:00.401389+0000","last_unstale":"2023-12-13T22:26:06.994089+0000","last_undegraded":"2023-12-13T22:26:06.994089+0000","last_fullsized":"2023-12-13T22:26:06.994089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889973+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:26:06.889973+0000","last_peered":"2023-12-13T22:26:06.889973+0000","last_clean":"2023-12-13T22:26:06.889973+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:26:06.889973+0000","last_undegraded":"2023-12-13T22:26:06.889973+0000","last_fullsized":"2023-12-13T22:26:06.889973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.993884+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:26:06.993884+0000","last_peered":"2023-12-13T22:26:06.993884+0000","last_clean":"2023-12-13T22:26:06.993884+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:26:06.993884+0000","last_undegraded":"2023-12-13T22:26:06.993884+0000","last_fullsized":"2023-12-13T22:26:06.993884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858013+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:26:06.858013+0000","last_peered":"2023-12-13T22:26:06.858013+0000","last_clean":"2023-12-13T22:26:06.858013+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:26:06.858013+0000","last_undegraded":"2023-12-13T22:26:06.858013+0000","last_fullsized":"2023-12-13T22:26:06.858013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286435+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:26:07.286435+0000","last_peered":"2023-12-13T22:26:07.286435+0000","last_clean":"2023-12-13T22:26:07.286435+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:26:07.286435+0000","last_undegraded":"2023-12-13T22:26:07.286435+0000","last_fullsized":"2023-12-13T22:26:07.286435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893056+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:26:06.893056+0000","last_peered":"2023-12-13T22:26:06.893056+0000","last_clean":"2023-12-13T22:26:06.893056+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:26:06.893056+0000","last_undegraded":"2023-12-13T22:26:06.893056+0000","last_fullsized":"2023-12-13T22:26:06.893056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":917504,"data_stored":713194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1279999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.107}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.075}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.032},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2649999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.2390000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":126029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.0489999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1359999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.284},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.3580000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.393}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.238},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.3149999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.4370000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476760,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.73899999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0349999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.089},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.117}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1799999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.155}]}]},{"osd":4,"up_from":16,"seq":68719476761,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":122224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.626}]},{"osd":1,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.878},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.077}]},{"osd":6,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.175}]}]},{"osd":3,"up_from":16,"seq":68719476760,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":126063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.82899999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.90100000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476761,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":122454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.439}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.876}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.59999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.747}]},{"osd":3,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98299999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.117}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":712538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.498},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.874},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.64100000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.95199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:26:50.046 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:26:50.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.220+0000 7f4b8a392640 1 Processor -- start 2023-12-13T22:26:50.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.220+0000 7f4b8a392640 1 -- start start 2023-12-13T22:26:50.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b8a392640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 0x7f4b840c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:50.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b8a392640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8406f4a0 con 0x7f4b84151720 2023-12-13T22:26:50.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b8a392640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b84070be0 con 0x7f4b84151340 2023-12-13T22:26:50.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b8a392640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8406f2c0 con 0x7f4b8406ee10 2023-12-13T22:26:50.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b83fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4b84151340 0x7f4b84157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:55526/0 (socket says 172.21.15.91:55526) 2023-12-13T22:26:50.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.224+0000 7f4b83fff640 1 -- 172.21.15.91:0/302768517 learned_addr learned my addr 172.21.15.91:0/302768517 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:50.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.248+0000 7f4b8892f640 1 --2- 172.21.15.91:0/302768517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 0x7f4b840c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:50.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.260+0000 7f4b8892f640 1 -- 172.21.15.91:0/302768517 >> v1:172.21.15.152:6789/0 conn(0x7f4b84151340 legacy=0x7f4b84157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.260+0000 7f4b8892f640 1 -- 172.21.15.91:0/302768517 >> v1:172.21.15.91:6789/0 conn(0x7f4b84151720 legacy=0x7f4b840c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:50.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.260+0000 7f4b8892f640 1 -- 172.21.15.91:0/302768517 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84070e80 con 0x7f4b8406ee10 2023-12-13T22:26:50.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.356+0000 7f4b8892f640 1 --2- 172.21.15.91:0/302768517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 0x7f4b840c70c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009dc0 tx=0x7f4b7c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e954f3a1eb5f290 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:50.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b82ffd640 1 -- 172.21.15.91:0/302768517 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a57f0 con 0x7f4b8406ee10 2023-12-13T22:26:50.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b82ffd640 1 -- 172.21.15.91:0/302768517 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0a5950 con 0x7f4b8406ee10 2023-12-13T22:26:50.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b82ffd640 1 -- 172.21.15.91:0/302768517 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0a5ce0 con 0x7f4b8406ee10 2023-12-13T22:26:50.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 -- 172.21.15.91:0/302768517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 msgr2=0x7f4b840c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 --2- 172.21.15.91:0/302768517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 0x7f4b840c70c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009dc0 tx=0x7f4b7c01c930 comp rx=0 tx=0).stop 2023-12-13T22:26:50.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 -- 172.21.15.91:0/302768517 shutdown_connections 2023-12-13T22:26:50.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 --2- 172.21.15.91:0/302768517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b8406ee10 0x7f4b840c70c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 -- 172.21.15.91:0/302768517 >> 172.21.15.91:0/302768517 conn(0x7f4b8406c6a0 msgr2=0x7f4b8406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:50.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 -- 172.21.15.91:0/302768517 shutdown_connections 2023-12-13T22:26:50.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.368+0000 7f4b8a392640 1 -- 172.21.15.91:0/302768517 wait complete. 2023-12-13T22:26:50.369 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 Processor -- start 2023-12-13T22:26:50.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 -- start start 2023-12-13T22:26:50.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8406ee10 0x7f4b840c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:50.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:50.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b84151720 0x7f4b84154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:50.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84153260 con 0x7f4b84151720 2023-12-13T22:26:50.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8415fe80 con 0x7f4b8406ee10 2023-12-13T22:26:50.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b8a392640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84160400 con 0x7f4b84151340 2023-12-13T22:26:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b837fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b837fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:60870/0 (socket says 172.21.15.91:60870) 2023-12-13T22:26:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b837fe640 1 -- 172.21.15.91:0/702413458 learned_addr learned my addr 172.21.15.91:0/702413458 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:50.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.372+0000 7f4b83fff640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8406ee10 0x7f4b840c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:50.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.376+0000 7f4b837fe640 1 -- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8406ee10 msgr2=0x7f4b840c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.376+0000 7f4b837fe640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8406ee10 0x7f4b840c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.376+0000 7f4b837fe640 1 -- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b84151720 msgr2=0x7f4b84154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.376+0000 7f4b837fe640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b84151720 0x7f4b84154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.376+0000 7f4b837fe640 1 -- 172.21.15.91:0/702413458 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c009a70 con 0x7f4b84151340 2023-12-13T22:26:50.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.380+0000 7f4b837fe640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c490 tx=0x7f4b74001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:50.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.384+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74003600 con 0x7f4b84151340 2023-12-13T22:26:50.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.384+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84160120 con 0x7f4b84151340 2023-12-13T22:26:50.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.384+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84152ef0 con 0x7f4b84151340 2023-12-13T22:26:50.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.388+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b841533d0 con 0x7f4b84151340 2023-12-13T22:26:50.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.388+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74001150 con 0x7f4b84151340 2023-12-13T22:26:50.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.388+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b74007250 con 0x7f4b84151340 2023-12-13T22:26:50.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.704+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4b740073b0 con 0x7f4b84151340 2023-12-13T22:26:50.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.704+0000 7f4b80ff9640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 0x7f4b70068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:50.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.708+0000 7f4b83fff640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 0x7f4b70068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:50.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.708+0000 7f4b83fff640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 0x7f4b70068cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005890 tx=0x7f4b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:50.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.712+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b74054960 con 0x7f4b84151340 2023-12-13T22:26:50.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.740+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4b74050ca0 con 0x7f4b84151340 2023-12-13T22:26:50.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.892+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b840c47f0 con 0x7f4b700667f0 2023-12-13T22:26:50.902 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.904+0000 7f4b80ff9640 1 -- 172.21.15.91:0/702413458 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367894 (secure 0 0 0) 0x7f4b78001510 con 0x7f4b700667f0 2023-12-13T22:26:50.906 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:50.908 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 msgr2=0x7f4b70068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 0x7f4b70068cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b78005890 tx=0x7f4b78009040 comp rx=0 tx=0).stop 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 msgr2=0x7f4b841536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400c490 tx=0x7f4b74001e80 comp rx=0 tx=0).stop 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 shutdown_connections 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4b700667f0 0x7f4b70068cb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4b84151720 0x7f4b84154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4b84151340 0x7f4b841536f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 --2- 172.21.15.91:0/702413458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b8406ee10 0x7f4b840c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:50.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 >> 172.21.15.91:0/702413458 conn(0x7f4b8406c6a0 msgr2=0x7f4b840c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:50.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 shutdown_connections 2023-12-13T22:26:50.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:50.908+0000 7f4b8a392640 1 -- 172.21.15.91:0/702413458 wait complete. 2023-12-13T22:26:50.924 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-12-13T22:26:50.579596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":293,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223976,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750744,"statfs":{"total":773094113280,"available":772864761856,"internally_reserved":0,"allocated":3776512,"data_stored":2167718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004028"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.748283+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:26:41.748283+0000","last_peered":"2023-12-13T22:26:41.748283+0000","last_clean":"2023-12-13T22:26:41.748283+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:26:41.748283+0000","last_undegraded":"2023-12-13T22:26:41.748283+0000","last_fullsized":"2023-12-13T22:26:41.748283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282945+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:26:07.282945+0000","last_peered":"2023-12-13T22:26:07.282945+0000","last_clean":"2023-12-13T22:26:07.282945+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:26:07.282945+0000","last_undegraded":"2023-12-13T22:26:07.282945+0000","last_fullsized":"2023-12-13T22:26:07.282945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064619+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:26:09.064619+0000","last_peered":"2023-12-13T22:26:09.064619+0000","last_clean":"2023-12-13T22:26:09.064619+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:26:09.064619+0000","last_undegraded":"2023-12-13T22:26:09.064619+0000","last_fullsized":"2023-12-13T22:26:09.064619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858067+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:26:06.858067+0000","last_peered":"2023-12-13T22:26:06.858067+0000","last_clean":"2023-12-13T22:26:06.858067+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:26:06.858067+0000","last_undegraded":"2023-12-13T22:26:06.858067+0000","last_fullsized":"2023-12-13T22:26:06.858067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017099+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:26:08.017099+0000","last_peered":"2023-12-13T22:26:08.017099+0000","last_clean":"2023-12-13T22:26:08.017099+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:26:08.017099+0000","last_undegraded":"2023-12-13T22:26:08.017099+0000","last_fullsized":"2023-12-13T22:26:08.017099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.789931+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:26:41.789931+0000","last_peered":"2023-12-13T22:26:41.789931+0000","last_clean":"2023-12-13T22:26:41.789931+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:26:41.789931+0000","last_undegraded":"2023-12-13T22:26:41.789931+0000","last_fullsized":"2023-12-13T22:26:41.789931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994069+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:26:06.994069+0000","last_peered":"2023-12-13T22:26:06.994069+0000","last_clean":"2023-12-13T22:26:06.994069+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:26:06.994069+0000","last_undegraded":"2023-12-13T22:26:06.994069+0000","last_fullsized":"2023-12-13T22:26:06.994069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017831+0000","last_change":"2023-12-13T22:26:05.940088+0000","last_active":"2023-12-13T22:26:08.017831+0000","last_peered":"2023-12-13T22:26:08.017831+0000","last_clean":"2023-12-13T22:26:08.017831+0000","last_became_active":"2023-12-13T22:26:05.939662+0000","last_became_peered":"2023-12-13T22:26:05.939662+0000","last_unstale":"2023-12-13T22:26:08.017831+0000","last_undegraded":"2023-12-13T22:26:08.017831+0000","last_fullsized":"2023-12-13T22:26:08.017831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:15.268425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890675+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:26:06.890675+0000","last_peered":"2023-12-13T22:26:06.890675+0000","last_clean":"2023-12-13T22:26:06.890675+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:26:06.890675+0000","last_undegraded":"2023-12-13T22:26:06.890675+0000","last_fullsized":"2023-12-13T22:26:06.890675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994756+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:26:06.994756+0000","last_peered":"2023-12-13T22:26:06.994756+0000","last_clean":"2023-12-13T22:26:06.994756+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:26:06.994756+0000","last_undegraded":"2023-12-13T22:26:06.994756+0000","last_fullsized":"2023-12-13T22:26:06.994756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017505+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:26:08.017505+0000","last_peered":"2023-12-13T22:26:08.017505+0000","last_clean":"2023-12-13T22:26:08.017505+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:26:08.017505+0000","last_undegraded":"2023-12-13T22:26:08.017505+0000","last_fullsized":"2023-12-13T22:26:08.017505+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911212+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:26:06.911212+0000","last_peered":"2023-12-13T22:26:06.911212+0000","last_clean":"2023-12-13T22:26:06.911212+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:26:06.911212+0000","last_undegraded":"2023-12-13T22:26:06.911212+0000","last_fullsized":"2023-12-13T22:26:06.911212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.688525+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:26:38.688525+0000","last_peered":"2023-12-13T22:26:38.688525+0000","last_clean":"2023-12-13T22:26:38.688525+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:26:38.688525+0000","last_undegraded":"2023-12-13T22:26:38.688525+0000","last_fullsized":"2023-12-13T22:26:38.688525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018802+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:26:08.018802+0000","last_peered":"2023-12-13T22:26:08.018802+0000","last_clean":"2023-12-13T22:26:08.018802+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:26:08.018802+0000","last_undegraded":"2023-12-13T22:26:08.018802+0000","last_fullsized":"2023-12-13T22:26:08.018802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282430+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:26:07.282430+0000","last_peered":"2023-12-13T22:26:07.282430+0000","last_clean":"2023-12-13T22:26:07.282430+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:26:07.282430+0000","last_undegraded":"2023-12-13T22:26:07.282430+0000","last_fullsized":"2023-12-13T22:26:07.282430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062084+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:26:09.062084+0000","last_peered":"2023-12-13T22:26:09.062084+0000","last_clean":"2023-12-13T22:26:09.062084+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:26:09.062084+0000","last_undegraded":"2023-12-13T22:26:09.062084+0000","last_fullsized":"2023-12-13T22:26:09.062084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019042+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:26:08.019042+0000","last_peered":"2023-12-13T22:26:08.019042+0000","last_clean":"2023-12-13T22:26:08.019042+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:26:08.019042+0000","last_undegraded":"2023-12-13T22:26:08.019042+0000","last_fullsized":"2023-12-13T22:26:08.019042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282270+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:26:07.282270+0000","last_peered":"2023-12-13T22:26:07.282270+0000","last_clean":"2023-12-13T22:26:07.282270+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:26:07.282270+0000","last_undegraded":"2023-12-13T22:26:07.282270+0000","last_fullsized":"2023-12-13T22:26:07.282270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.836271+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:26:38.836271+0000","last_peered":"2023-12-13T22:26:38.836271+0000","last_clean":"2023-12-13T22:26:38.836271+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:26:38.836271+0000","last_undegraded":"2023-12-13T22:26:38.836271+0000","last_fullsized":"2023-12-13T22:26:38.836271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062830+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:26:09.062830+0000","last_peered":"2023-12-13T22:26:09.062830+0000","last_clean":"2023-12-13T22:26:09.062830+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:26:09.062830+0000","last_undegraded":"2023-12-13T22:26:09.062830+0000","last_fullsized":"2023-12-13T22:26:09.062830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291842+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:26:07.291842+0000","last_peered":"2023-12-13T22:26:07.291842+0000","last_clean":"2023-12-13T22:26:07.291842+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:26:07.291842+0000","last_undegraded":"2023-12-13T22:26:07.291842+0000","last_fullsized":"2023-12-13T22:26:07.291842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.688564+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:26:38.688564+0000","last_peered":"2023-12-13T22:26:38.688564+0000","last_clean":"2023-12-13T22:26:38.688564+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:26:38.688564+0000","last_undegraded":"2023-12-13T22:26:38.688564+0000","last_fullsized":"2023-12-13T22:26:38.688564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018910+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:26:08.018910+0000","last_peered":"2023-12-13T22:26:08.018910+0000","last_clean":"2023-12-13T22:26:08.018910+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:26:08.018910+0000","last_undegraded":"2023-12-13T22:26:08.018910+0000","last_fullsized":"2023-12-13T22:26:08.018910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858749+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:26:06.858749+0000","last_peered":"2023-12-13T22:26:06.858749+0000","last_clean":"2023-12-13T22:26:06.858749+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:26:06.858749+0000","last_undegraded":"2023-12-13T22:26:06.858749+0000","last_fullsized":"2023-12-13T22:26:06.858749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890233+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:26:38.890233+0000","last_peered":"2023-12-13T22:26:38.890233+0000","last_clean":"2023-12-13T22:26:38.890233+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:26:38.890233+0000","last_undegraded":"2023-12-13T22:26:38.890233+0000","last_fullsized":"2023-12-13T22:26:38.890233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017812+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:26:08.017812+0000","last_peered":"2023-12-13T22:26:08.017812+0000","last_clean":"2023-12-13T22:26:08.017812+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:26:08.017812+0000","last_undegraded":"2023-12-13T22:26:08.017812+0000","last_fullsized":"2023-12-13T22:26:08.017812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283278+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:26:07.283278+0000","last_peered":"2023-12-13T22:26:07.283278+0000","last_clean":"2023-12-13T22:26:07.283278+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:26:07.283278+0000","last_undegraded":"2023-12-13T22:26:07.283278+0000","last_fullsized":"2023-12-13T22:26:07.283278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.610452+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:26:41.610452+0000","last_peered":"2023-12-13T22:26:41.610452+0000","last_clean":"2023-12-13T22:26:41.610452+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:26:41.610452+0000","last_undegraded":"2023-12-13T22:26:41.610452+0000","last_fullsized":"2023-12-13T22:26:41.610452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063386+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:26:09.063386+0000","last_peered":"2023-12-13T22:26:09.063386+0000","last_clean":"2023-12-13T22:26:09.063386+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:26:09.063386+0000","last_undegraded":"2023-12-13T22:26:09.063386+0000","last_fullsized":"2023-12-13T22:26:09.063386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286245+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:26:07.286245+0000","last_peered":"2023-12-13T22:26:07.286245+0000","last_clean":"2023-12-13T22:26:07.286245+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:26:07.286245+0000","last_undegraded":"2023-12-13T22:26:07.286245+0000","last_fullsized":"2023-12-13T22:26:07.286245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063558+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:26:09.063558+0000","last_peered":"2023-12-13T22:26:09.063558+0000","last_clean":"2023-12-13T22:26:09.063558+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:26:09.063558+0000","last_undegraded":"2023-12-13T22:26:09.063558+0000","last_fullsized":"2023-12-13T22:26:09.063558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.983999+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:26:07.983999+0000","last_peered":"2023-12-13T22:26:07.983999+0000","last_clean":"2023-12-13T22:26:07.983999+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:26:07.983999+0000","last_undegraded":"2023-12-13T22:26:07.983999+0000","last_fullsized":"2023-12-13T22:26:07.983999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994774+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:26:06.994774+0000","last_peered":"2023-12-13T22:26:06.994774+0000","last_clean":"2023-12-13T22:26:06.994774+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:26:06.994774+0000","last_undegraded":"2023-12-13T22:26:06.994774+0000","last_fullsized":"2023-12-13T22:26:06.994774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286309+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:26:07.286309+0000","last_peered":"2023-12-13T22:26:07.286309+0000","last_clean":"2023-12-13T22:26:07.286309+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:26:07.286309+0000","last_undegraded":"2023-12-13T22:26:07.286309+0000","last_fullsized":"2023-12-13T22:26:07.286309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061487+0000","last_change":"2023-12-13T22:26:05.944559+0000","last_active":"2023-12-13T22:26:09.061487+0000","last_peered":"2023-12-13T22:26:09.061487+0000","last_clean":"2023-12-13T22:26:09.061487+0000","last_became_active":"2023-12-13T22:26:05.943841+0000","last_became_peered":"2023-12-13T22:26:05.943841+0000","last_unstale":"2023-12-13T22:26:09.061487+0000","last_undegraded":"2023-12-13T22:26:09.061487+0000","last_fullsized":"2023-12-13T22:26:09.061487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291954+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:26:07.291954+0000","last_peered":"2023-12-13T22:26:07.291954+0000","last_clean":"2023-12-13T22:26:07.291954+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:26:07.291954+0000","last_undegraded":"2023-12-13T22:26:07.291954+0000","last_fullsized":"2023-12-13T22:26:07.291954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062351+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:26:09.062351+0000","last_peered":"2023-12-13T22:26:09.062351+0000","last_clean":"2023-12-13T22:26:09.062351+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:26:09.062351+0000","last_undegraded":"2023-12-13T22:26:09.062351+0000","last_fullsized":"2023-12-13T22:26:09.062351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062075+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:26:09.062075+0000","last_peered":"2023-12-13T22:26:09.062075+0000","last_clean":"2023-12-13T22:26:09.062075+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:26:09.062075+0000","last_undegraded":"2023-12-13T22:26:09.062075+0000","last_fullsized":"2023-12-13T22:26:09.062075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285856+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:26:07.285856+0000","last_peered":"2023-12-13T22:26:07.285856+0000","last_clean":"2023-12-13T22:26:07.285856+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:26:07.285856+0000","last_undegraded":"2023-12-13T22:26:07.285856+0000","last_fullsized":"2023-12-13T22:26:07.285856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775826+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:26:41.775826+0000","last_peered":"2023-12-13T22:26:41.775826+0000","last_clean":"2023-12-13T22:26:41.775826+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:26:41.775826+0000","last_undegraded":"2023-12-13T22:26:41.775826+0000","last_fullsized":"2023-12-13T22:26:41.775826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063001+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:26:09.063001+0000","last_peered":"2023-12-13T22:26:09.063001+0000","last_clean":"2023-12-13T22:26:09.063001+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:26:09.063001+0000","last_undegraded":"2023-12-13T22:26:09.063001+0000","last_fullsized":"2023-12-13T22:26:09.063001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857511+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:26:06.857511+0000","last_peered":"2023-12-13T22:26:06.857511+0000","last_clean":"2023-12-13T22:26:06.857511+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:26:06.857511+0000","last_undegraded":"2023-12-13T22:26:06.857511+0000","last_fullsized":"2023-12-13T22:26:06.857511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.789235+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:26:41.789235+0000","last_peered":"2023-12-13T22:26:41.789235+0000","last_clean":"2023-12-13T22:26:41.789235+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:26:41.789235+0000","last_undegraded":"2023-12-13T22:26:41.789235+0000","last_fullsized":"2023-12-13T22:26:41.789235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984268+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:26:07.984268+0000","last_peered":"2023-12-13T22:26:07.984268+0000","last_clean":"2023-12-13T22:26:07.984268+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:26:07.984268+0000","last_undegraded":"2023-12-13T22:26:07.984268+0000","last_fullsized":"2023-12-13T22:26:07.984268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282052+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:26:07.282052+0000","last_peered":"2023-12-13T22:26:07.282052+0000","last_clean":"2023-12-13T22:26:07.282052+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:26:07.282052+0000","last_undegraded":"2023-12-13T22:26:07.282052+0000","last_fullsized":"2023-12-13T22:26:07.282052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.897514+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:26:38.897514+0000","last_peered":"2023-12-13T22:26:38.897514+0000","last_clean":"2023-12-13T22:26:38.897514+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:26:38.897514+0000","last_undegraded":"2023-12-13T22:26:38.897514+0000","last_fullsized":"2023-12-13T22:26:38.897514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889497+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:26:06.889497+0000","last_peered":"2023-12-13T22:26:06.889497+0000","last_clean":"2023-12-13T22:26:06.889497+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:26:06.889497+0000","last_undegraded":"2023-12-13T22:26:06.889497+0000","last_fullsized":"2023-12-13T22:26:06.889497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924748+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:26:07.924748+0000","last_peered":"2023-12-13T22:26:07.924748+0000","last_clean":"2023-12-13T22:26:07.924748+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:26:07.924748+0000","last_undegraded":"2023-12-13T22:26:07.924748+0000","last_fullsized":"2023-12-13T22:26:07.924748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890978+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:26:06.890978+0000","last_peered":"2023-12-13T22:26:06.890978+0000","last_clean":"2023-12-13T22:26:06.890978+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:26:06.890978+0000","last_undegraded":"2023-12-13T22:26:06.890978+0000","last_fullsized":"2023-12-13T22:26:06.890978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.775205+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:26:41.775205+0000","last_peered":"2023-12-13T22:26:41.775205+0000","last_clean":"2023-12-13T22:26:41.775205+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:26:41.775205+0000","last_undegraded":"2023-12-13T22:26:41.775205+0000","last_fullsized":"2023-12-13T22:26:41.775205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.924406+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:26:07.924406+0000","last_peered":"2023-12-13T22:26:07.924406+0000","last_clean":"2023-12-13T22:26:07.924406+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:26:07.924406+0000","last_undegraded":"2023-12-13T22:26:07.924406+0000","last_fullsized":"2023-12-13T22:26:07.924406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994199+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:26:06.994199+0000","last_peered":"2023-12-13T22:26:06.994199+0000","last_clean":"2023-12-13T22:26:06.994199+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:26:06.994199+0000","last_undegraded":"2023-12-13T22:26:06.994199+0000","last_fullsized":"2023-12-13T22:26:06.994199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286596+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:26:07.286596+0000","last_peered":"2023-12-13T22:26:07.286596+0000","last_clean":"2023-12-13T22:26:07.286596+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:26:07.286596+0000","last_undegraded":"2023-12-13T22:26:07.286596+0000","last_fullsized":"2023-12-13T22:26:07.286596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984240+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:26:07.984240+0000","last_peered":"2023-12-13T22:26:07.984240+0000","last_clean":"2023-12-13T22:26:07.984240+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:26:07.984240+0000","last_undegraded":"2023-12-13T22:26:07.984240+0000","last_fullsized":"2023-12-13T22:26:07.984240+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893338+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:26:06.893338+0000","last_peered":"2023-12-13T22:26:06.893338+0000","last_clean":"2023-12-13T22:26:06.893338+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:26:06.893338+0000","last_undegraded":"2023-12-13T22:26:06.893338+0000","last_fullsized":"2023-12-13T22:26:06.893338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827411+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:26:07.827411+0000","last_peered":"2023-12-13T22:26:07.827411+0000","last_clean":"2023-12-13T22:26:07.827411+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:26:07.827411+0000","last_undegraded":"2023-12-13T22:26:07.827411+0000","last_fullsized":"2023-12-13T22:26:07.827411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.060442+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:26:09.060442+0000","last_peered":"2023-12-13T22:26:09.060442+0000","last_clean":"2023-12-13T22:26:09.060442+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:26:09.060442+0000","last_undegraded":"2023-12-13T22:26:09.060442+0000","last_fullsized":"2023-12-13T22:26:09.060442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891642+0000","last_change":"2023-12-13T22:26:00.418974+0000","last_active":"2023-12-13T22:26:06.891642+0000","last_peered":"2023-12-13T22:26:06.891642+0000","last_clean":"2023-12-13T22:26:06.891642+0000","last_became_active":"2023-12-13T22:26:00.418573+0000","last_became_peered":"2023-12-13T22:26:00.418573+0000","last_unstale":"2023-12-13T22:26:06.891642+0000","last_undegraded":"2023-12-13T22:26:06.891642+0000","last_fullsized":"2023-12-13T22:26:06.891642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.019674+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:26:08.019674+0000","last_peered":"2023-12-13T22:26:08.019674+0000","last_clean":"2023-12-13T22:26:08.019674+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:26:08.019674+0000","last_undegraded":"2023-12-13T22:26:08.019674+0000","last_fullsized":"2023-12-13T22:26:08.019674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.017051+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:26:08.017051+0000","last_peered":"2023-12-13T22:26:08.017051+0000","last_clean":"2023-12-13T22:26:08.017051+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:26:08.017051+0000","last_undegraded":"2023-12-13T22:26:08.017051+0000","last_fullsized":"2023-12-13T22:26:08.017051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889629+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:26:06.889629+0000","last_peered":"2023-12-13T22:26:06.889629+0000","last_clean":"2023-12-13T22:26:06.889629+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:26:06.889629+0000","last_undegraded":"2023-12-13T22:26:06.889629+0000","last_fullsized":"2023-12-13T22:26:06.889629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.777594+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:26:41.777594+0000","last_peered":"2023-12-13T22:26:41.777594+0000","last_clean":"2023-12-13T22:26:41.777594+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:26:41.777594+0000","last_undegraded":"2023-12-13T22:26:41.777594+0000","last_fullsized":"2023-12-13T22:26:41.777594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984199+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:26:07.984199+0000","last_peered":"2023-12-13T22:26:07.984199+0000","last_clean":"2023-12-13T22:26:07.984199+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:26:07.984199+0000","last_undegraded":"2023-12-13T22:26:07.984199+0000","last_fullsized":"2023-12-13T22:26:07.984199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909876+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:26:06.909876+0000","last_peered":"2023-12-13T22:26:06.909876+0000","last_clean":"2023-12-13T22:26:06.909876+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:26:06.909876+0000","last_undegraded":"2023-12-13T22:26:06.909876+0000","last_fullsized":"2023-12-13T22:26:06.909876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.746838+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:26:41.746838+0000","last_peered":"2023-12-13T22:26:41.746838+0000","last_clean":"2023-12-13T22:26:41.746838+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:26:41.746838+0000","last_undegraded":"2023-12-13T22:26:41.746838+0000","last_fullsized":"2023-12-13T22:26:41.746838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064384+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:26:09.064384+0000","last_peered":"2023-12-13T22:26:09.064384+0000","last_clean":"2023-12-13T22:26:09.064384+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:26:09.064384+0000","last_undegraded":"2023-12-13T22:26:09.064384+0000","last_fullsized":"2023-12-13T22:26:09.064384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890397+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:26:06.890397+0000","last_peered":"2023-12-13T22:26:06.890397+0000","last_clean":"2023-12-13T22:26:06.890397+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:26:06.890397+0000","last_undegraded":"2023-12-13T22:26:06.890397+0000","last_fullsized":"2023-12-13T22:26:06.890397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.897482+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:26:38.897482+0000","last_peered":"2023-12-13T22:26:38.897482+0000","last_clean":"2023-12-13T22:26:38.897482+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:26:38.897482+0000","last_undegraded":"2023-12-13T22:26:38.897482+0000","last_fullsized":"2023-12-13T22:26:38.897482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064123+0000","last_change":"2023-12-13T22:26:06.547843+0000","last_active":"2023-12-13T22:26:09.064123+0000","last_peered":"2023-12-13T22:26:09.064123+0000","last_clean":"2023-12-13T22:26:09.064123+0000","last_became_active":"2023-12-13T22:26:06.546738+0000","last_became_peered":"2023-12-13T22:26:06.546738+0000","last_unstale":"2023-12-13T22:26:09.064123+0000","last_undegraded":"2023-12-13T22:26:09.064123+0000","last_fullsized":"2023-12-13T22:26:09.064123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:02:37.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858138+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:26:06.858138+0000","last_peered":"2023-12-13T22:26:06.858138+0000","last_clean":"2023-12-13T22:26:06.858138+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:26:06.858138+0000","last_undegraded":"2023-12-13T22:26:06.858138+0000","last_fullsized":"2023-12-13T22:26:06.858138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.742916+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:26:41.742916+0000","last_peered":"2023-12-13T22:26:41.742916+0000","last_clean":"2023-12-13T22:26:41.742916+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:26:41.742916+0000","last_undegraded":"2023-12-13T22:26:41.742916+0000","last_fullsized":"2023-12-13T22:26:41.742916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061946+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:26:09.061946+0000","last_peered":"2023-12-13T22:26:09.061946+0000","last_clean":"2023-12-13T22:26:09.061946+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:26:09.061946+0000","last_undegraded":"2023-12-13T22:26:09.061946+0000","last_fullsized":"2023-12-13T22:26:09.061946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.890732+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:26:06.890732+0000","last_peered":"2023-12-13T22:26:06.890732+0000","last_clean":"2023-12-13T22:26:06.890732+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:26:06.890732+0000","last_undegraded":"2023-12-13T22:26:06.890732+0000","last_fullsized":"2023-12-13T22:26:06.890732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890051+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:26:38.890051+0000","last_peered":"2023-12-13T22:26:38.890051+0000","last_clean":"2023-12-13T22:26:38.890051+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:26:38.890051+0000","last_undegraded":"2023-12-13T22:26:38.890051+0000","last_fullsized":"2023-12-13T22:26:38.890051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061708+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:26:09.061708+0000","last_peered":"2023-12-13T22:26:09.061708+0000","last_clean":"2023-12-13T22:26:09.061708+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:26:09.061708+0000","last_undegraded":"2023-12-13T22:26:09.061708+0000","last_fullsized":"2023-12-13T22:26:09.061708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292771+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:26:07.292771+0000","last_peered":"2023-12-13T22:26:07.292771+0000","last_clean":"2023-12-13T22:26:07.292771+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:26:07.292771+0000","last_undegraded":"2023-12-13T22:26:07.292771+0000","last_fullsized":"2023-12-13T22:26:07.292771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.062550+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:26:09.062550+0000","last_peered":"2023-12-13T22:26:09.062550+0000","last_clean":"2023-12-13T22:26:09.062550+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:26:09.062550+0000","last_undegraded":"2023-12-13T22:26:09.062550+0000","last_fullsized":"2023-12-13T22:26:09.062550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.018583+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:26:08.018583+0000","last_peered":"2023-12-13T22:26:08.018583+0000","last_clean":"2023-12-13T22:26:08.018583+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:26:08.018583+0000","last_undegraded":"2023-12-13T22:26:08.018583+0000","last_fullsized":"2023-12-13T22:26:08.018583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858759+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:26:06.858759+0000","last_peered":"2023-12-13T22:26:06.858759+0000","last_clean":"2023-12-13T22:26:06.858759+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:26:06.858759+0000","last_undegraded":"2023-12-13T22:26:06.858759+0000","last_fullsized":"2023-12-13T22:26:06.858759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.896323+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:26:38.896323+0000","last_peered":"2023-12-13T22:26:38.896323+0000","last_clean":"2023-12-13T22:26:38.896323+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:26:38.896323+0000","last_undegraded":"2023-12-13T22:26:38.896323+0000","last_fullsized":"2023-12-13T22:26:38.896323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063423+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:26:09.063423+0000","last_peered":"2023-12-13T22:26:09.063423+0000","last_clean":"2023-12-13T22:26:09.063423+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:26:09.063423+0000","last_undegraded":"2023-12-13T22:26:09.063423+0000","last_fullsized":"2023-12-13T22:26:09.063423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994895+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:26:06.994895+0000","last_peered":"2023-12-13T22:26:06.994895+0000","last_clean":"2023-12-13T22:26:06.994895+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:26:06.994895+0000","last_undegraded":"2023-12-13T22:26:06.994895+0000","last_fullsized":"2023-12-13T22:26:06.994895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.890672+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:26:38.890672+0000","last_peered":"2023-12-13T22:26:38.890672+0000","last_clean":"2023-12-13T22:26:38.890672+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:26:38.890672+0000","last_undegraded":"2023-12-13T22:26:38.890672+0000","last_fullsized":"2023-12-13T22:26:38.890672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.063443+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:26:09.063443+0000","last_peered":"2023-12-13T22:26:09.063443+0000","last_clean":"2023-12-13T22:26:09.063443+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:26:09.063443+0000","last_undegraded":"2023-12-13T22:26:09.063443+0000","last_fullsized":"2023-12-13T22:26:09.063443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.984083+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:26:07.984083+0000","last_peered":"2023-12-13T22:26:07.984083+0000","last_clean":"2023-12-13T22:26:07.984083+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:26:07.984083+0000","last_undegraded":"2023-12-13T22:26:07.984083+0000","last_fullsized":"2023-12-13T22:26:07.984083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285814+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:26:07.285814+0000","last_peered":"2023-12-13T22:26:07.285814+0000","last_clean":"2023-12-13T22:26:07.285814+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:26:07.285814+0000","last_undegraded":"2023-12-13T22:26:07.285814+0000","last_fullsized":"2023-12-13T22:26:07.285814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.061356+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:26:09.061356+0000","last_peered":"2023-12-13T22:26:09.061356+0000","last_clean":"2023-12-13T22:26:09.061356+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:26:09.061356+0000","last_undegraded":"2023-12-13T22:26:09.061356+0000","last_fullsized":"2023-12-13T22:26:09.061356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.925274+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:26:07.925274+0000","last_peered":"2023-12-13T22:26:07.925274+0000","last_clean":"2023-12-13T22:26:07.925274+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:26:07.925274+0000","last_undegraded":"2023-12-13T22:26:07.925274+0000","last_fullsized":"2023-12-13T22:26:07.925274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282151+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:26:07.282151+0000","last_peered":"2023-12-13T22:26:07.282151+0000","last_clean":"2023-12-13T22:26:07.282151+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:26:07.282151+0000","last_undegraded":"2023-12-13T22:26:07.282151+0000","last_fullsized":"2023-12-13T22:26:07.282151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.751410+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:26:41.751410+0000","last_peered":"2023-12-13T22:26:41.751410+0000","last_clean":"2023-12-13T22:26:41.751410+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:26:41.751410+0000","last_undegraded":"2023-12-13T22:26:41.751410+0000","last_fullsized":"2023-12-13T22:26:41.751410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:41.746077+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:26:41.746077+0000","last_peered":"2023-12-13T22:26:41.746077+0000","last_clean":"2023-12-13T22:26:41.746077+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:26:41.746077+0000","last_undegraded":"2023-12-13T22:26:41.746077+0000","last_fullsized":"2023-12-13T22:26:41.746077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858860+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:26:06.858860+0000","last_peered":"2023-12-13T22:26:06.858860+0000","last_clean":"2023-12-13T22:26:06.858860+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:26:06.858860+0000","last_undegraded":"2023-12-13T22:26:06.858860+0000","last_fullsized":"2023-12-13T22:26:06.858860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:08.815590+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:26:08.815590+0000","last_peered":"2023-12-13T22:26:08.815590+0000","last_clean":"2023-12-13T22:26:08.815590+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:26:08.815590+0000","last_undegraded":"2023-12-13T22:26:08.815590+0000","last_fullsized":"2023-12-13T22:26:08.815590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:38.914814+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:26:38.914814+0000","last_peered":"2023-12-13T22:26:38.914814+0000","last_clean":"2023-12-13T22:26:38.914814+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:26:38.914814+0000","last_undegraded":"2023-12-13T22:26:38.914814+0000","last_fullsized":"2023-12-13T22:26:38.914814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.291838+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:26:07.291838+0000","last_peered":"2023-12-13T22:26:07.291838+0000","last_clean":"2023-12-13T22:26:07.291838+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:26:07.291838+0000","last_undegraded":"2023-12-13T22:26:07.291838+0000","last_fullsized":"2023-12-13T22:26:07.291838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-13T22:26:09.064331+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:26:09.064331+0000","last_peered":"2023-12-13T22:26:09.064331+0000","last_clean":"2023-12-13T22:26:09.064331+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:26:09.064331+0000","last_undegraded":"2023-12-13T22:26:09.064331+0000","last_fullsized":"2023-12-13T22:26:09.064331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.909726+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:26:06.909726+0000","last_peered":"2023-12-13T22:26:06.909726+0000","last_clean":"2023-12-13T22:26:06.909726+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:26:06.909726+0000","last_undegraded":"2023-12-13T22:26:06.909726+0000","last_fullsized":"2023-12-13T22:26:06.909726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.826916+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:26:07.826916+0000","last_peered":"2023-12-13T22:26:07.826916+0000","last_clean":"2023-12-13T22:26:07.826916+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:26:07.826916+0000","last_undegraded":"2023-12-13T22:26:07.826916+0000","last_fullsized":"2023-12-13T22:26:07.826916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994203+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:26:06.994203+0000","last_peered":"2023-12-13T22:26:06.994203+0000","last_clean":"2023-12-13T22:26:06.994203+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:26:06.994203+0000","last_undegraded":"2023-12-13T22:26:06.994203+0000","last_fullsized":"2023-12-13T22:26:06.994203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858620+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:26:06.858620+0000","last_peered":"2023-12-13T22:26:06.858620+0000","last_clean":"2023-12-13T22:26:06.858620+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:26:06.858620+0000","last_undegraded":"2023-12-13T22:26:06.858620+0000","last_fullsized":"2023-12-13T22:26:06.858620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282688+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:26:07.282688+0000","last_peered":"2023-12-13T22:26:07.282688+0000","last_clean":"2023-12-13T22:26:07.282688+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:26:07.282688+0000","last_undegraded":"2023-12-13T22:26:07.282688+0000","last_fullsized":"2023-12-13T22:26:07.282688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286261+0000","last_change":"2023-12-13T22:26:00.413885+0000","last_active":"2023-12-13T22:26:07.286261+0000","last_peered":"2023-12-13T22:26:07.286261+0000","last_clean":"2023-12-13T22:26:07.286261+0000","last_became_active":"2023-12-13T22:26:00.413588+0000","last_became_peered":"2023-12-13T22:26:00.413588+0000","last_unstale":"2023-12-13T22:26:07.286261+0000","last_undegraded":"2023-12-13T22:26:07.286261+0000","last_fullsized":"2023-12-13T22:26:07.286261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912253+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:26:06.912253+0000","last_peered":"2023-12-13T22:26:06.912253+0000","last_clean":"2023-12-13T22:26:06.912253+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:26:06.912253+0000","last_undegraded":"2023-12-13T22:26:06.912253+0000","last_fullsized":"2023-12-13T22:26:06.912253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.283197+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:26:07.283197+0000","last_peered":"2023-12-13T22:26:07.283197+0000","last_clean":"2023-12-13T22:26:07.283197+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:26:07.283197+0000","last_undegraded":"2023-12-13T22:26:07.283197+0000","last_fullsized":"2023-12-13T22:26:07.283197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994173+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:26:06.994173+0000","last_peered":"2023-12-13T22:26:06.994173+0000","last_clean":"2023-12-13T22:26:06.994173+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:26:06.994173+0000","last_undegraded":"2023-12-13T22:26:06.994173+0000","last_fullsized":"2023-12-13T22:26:06.994173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282308+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:26:07.282308+0000","last_peered":"2023-12-13T22:26:07.282308+0000","last_clean":"2023-12-13T22:26:07.282308+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282308+0000","last_undegraded":"2023-12-13T22:26:07.282308+0000","last_fullsized":"2023-12-13T22:26:07.282308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994078+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:26:06.994078+0000","last_peered":"2023-12-13T22:26:06.994078+0000","last_clean":"2023-12-13T22:26:06.994078+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:26:06.994078+0000","last_undegraded":"2023-12-13T22:26:06.994078+0000","last_fullsized":"2023-12-13T22:26:06.994078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858162+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:26:06.858162+0000","last_peered":"2023-12-13T22:26:06.858162+0000","last_clean":"2023-12-13T22:26:06.858162+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:26:06.858162+0000","last_undegraded":"2023-12-13T22:26:06.858162+0000","last_fullsized":"2023-12-13T22:26:06.858162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.910747+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:26:06.910747+0000","last_peered":"2023-12-13T22:26:06.910747+0000","last_clean":"2023-12-13T22:26:06.910747+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:26:06.910747+0000","last_undegraded":"2023-12-13T22:26:06.910747+0000","last_fullsized":"2023-12-13T22:26:06.910747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.891457+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:26:06.891457+0000","last_peered":"2023-12-13T22:26:06.891457+0000","last_clean":"2023-12-13T22:26:06.891457+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:26:06.891457+0000","last_undegraded":"2023-12-13T22:26:06.891457+0000","last_fullsized":"2023-12-13T22:26:06.891457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.827315+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:26:07.827315+0000","last_peered":"2023-12-13T22:26:07.827315+0000","last_clean":"2023-12-13T22:26:07.827315+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:26:07.827315+0000","last_undegraded":"2023-12-13T22:26:07.827315+0000","last_fullsized":"2023-12-13T22:26:07.827315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.995002+0000","last_change":"2023-12-13T22:26:00.417280+0000","last_active":"2023-12-13T22:26:06.995002+0000","last_peered":"2023-12-13T22:26:06.995002+0000","last_clean":"2023-12-13T22:26:06.995002+0000","last_became_active":"2023-12-13T22:26:00.410002+0000","last_became_peered":"2023-12-13T22:26:00.410002+0000","last_unstale":"2023-12-13T22:26:06.995002+0000","last_undegraded":"2023-12-13T22:26:06.995002+0000","last_fullsized":"2023-12-13T22:26:06.995002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994368+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:26:06.994368+0000","last_peered":"2023-12-13T22:26:06.994368+0000","last_clean":"2023-12-13T22:26:06.994368+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:26:06.994368+0000","last_undegraded":"2023-12-13T22:26:06.994368+0000","last_fullsized":"2023-12-13T22:26:06.994368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.285823+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:26:07.285823+0000","last_peered":"2023-12-13T22:26:07.285823+0000","last_clean":"2023-12-13T22:26:07.285823+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:26:07.285823+0000","last_undegraded":"2023-12-13T22:26:07.285823+0000","last_fullsized":"2023-12-13T22:26:07.285823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.857773+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:26:06.857773+0000","last_peered":"2023-12-13T22:26:06.857773+0000","last_clean":"2023-12-13T22:26:06.857773+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:26:06.857773+0000","last_undegraded":"2023-12-13T22:26:06.857773+0000","last_fullsized":"2023-12-13T22:26:06.857773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282281+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:26:07.282281+0000","last_peered":"2023-12-13T22:26:07.282281+0000","last_clean":"2023-12-13T22:26:07.282281+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:26:07.282281+0000","last_undegraded":"2023-12-13T22:26:07.282281+0000","last_fullsized":"2023-12-13T22:26:07.282281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.292704+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:26:07.292704+0000","last_peered":"2023-12-13T22:26:07.292704+0000","last_clean":"2023-12-13T22:26:07.292704+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:26:07.292704+0000","last_undegraded":"2023-12-13T22:26:07.292704+0000","last_fullsized":"2023-12-13T22:26:07.292704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.911675+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:26:06.911675+0000","last_peered":"2023-12-13T22:26:06.911675+0000","last_clean":"2023-12-13T22:26:06.911675+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:26:06.911675+0000","last_undegraded":"2023-12-13T22:26:06.911675+0000","last_fullsized":"2023-12-13T22:26:06.911675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.912154+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:26:06.912154+0000","last_peered":"2023-12-13T22:26:06.912154+0000","last_clean":"2023-12-13T22:26:06.912154+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:26:06.912154+0000","last_undegraded":"2023-12-13T22:26:06.912154+0000","last_fullsized":"2023-12-13T22:26:06.912154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893269+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:26:06.893269+0000","last_peered":"2023-12-13T22:26:06.893269+0000","last_clean":"2023-12-13T22:26:06.893269+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:26:06.893269+0000","last_undegraded":"2023-12-13T22:26:06.893269+0000","last_fullsized":"2023-12-13T22:26:06.893269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.282030+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:26:07.282030+0000","last_peered":"2023-12-13T22:26:07.282030+0000","last_clean":"2023-12-13T22:26:07.282030+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:26:07.282030+0000","last_undegraded":"2023-12-13T22:26:07.282030+0000","last_fullsized":"2023-12-13T22:26:07.282030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889619+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:26:06.889619+0000","last_peered":"2023-12-13T22:26:06.889619+0000","last_clean":"2023-12-13T22:26:06.889619+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:26:06.889619+0000","last_undegraded":"2023-12-13T22:26:06.889619+0000","last_fullsized":"2023-12-13T22:26:06.889619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.994089+0000","last_change":"2023-12-13T22:26:00.401677+0000","last_active":"2023-12-13T22:26:06.994089+0000","last_peered":"2023-12-13T22:26:06.994089+0000","last_clean":"2023-12-13T22:26:06.994089+0000","last_became_active":"2023-12-13T22:26:00.401389+0000","last_became_peered":"2023-12-13T22:26:00.401389+0000","last_unstale":"2023-12-13T22:26:06.994089+0000","last_undegraded":"2023-12-13T22:26:06.994089+0000","last_fullsized":"2023-12-13T22:26:06.994089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.889973+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:26:06.889973+0000","last_peered":"2023-12-13T22:26:06.889973+0000","last_clean":"2023-12-13T22:26:06.889973+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:26:06.889973+0000","last_undegraded":"2023-12-13T22:26:06.889973+0000","last_fullsized":"2023-12-13T22:26:06.889973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.993884+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:26:06.993884+0000","last_peered":"2023-12-13T22:26:06.993884+0000","last_clean":"2023-12-13T22:26:06.993884+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:26:06.993884+0000","last_undegraded":"2023-12-13T22:26:06.993884+0000","last_fullsized":"2023-12-13T22:26:06.993884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.858013+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:26:06.858013+0000","last_peered":"2023-12-13T22:26:06.858013+0000","last_clean":"2023-12-13T22:26:06.858013+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:26:06.858013+0000","last_undegraded":"2023-12-13T22:26:06.858013+0000","last_fullsized":"2023-12-13T22:26:06.858013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:07.286435+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:26:07.286435+0000","last_peered":"2023-12-13T22:26:07.286435+0000","last_clean":"2023-12-13T22:26:07.286435+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:26:07.286435+0000","last_undegraded":"2023-12-13T22:26:07.286435+0000","last_fullsized":"2023-12-13T22:26:07.286435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-13T22:26:06.893056+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:26:06.893056+0000","last_peered":"2023-12-13T22:26:06.893056+0000","last_clean":"2023-12-13T22:26:06.893056+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:26:06.893056+0000","last_undegraded":"2023-12-13T22:26:06.893056+0000","last_fullsized":"2023-12-13T22:26:06.893056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":917504,"data_stored":713194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1279999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.107}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.075}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.032},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2649999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.2390000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476760,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":126029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.68700000000000006}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.0489999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1359999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.284},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.3580000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.393}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.238},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.3149999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.4370000000000001}]}]},{"osd":5,"up_from":16,"seq":68719476760,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.73899999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0349999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.089},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.117}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.1799999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.155}]}]},{"osd":4,"up_from":16,"seq":68719476761,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":122224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.626}]},{"osd":1,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.878},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.077}]},{"osd":6,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.175}]}]},{"osd":3,"up_from":16,"seq":68719476760,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":126063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.77800000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.82899999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.93500000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Wed Dec 13 22:26:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":0.90100000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476761,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":122454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.439}]},{"osd":4,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.876}]},{"osd":6,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Dec 13 22:26:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.59999999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.502},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.747}]},{"osd":3,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98299999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:26:23 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.117}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":712538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Dec 13 22:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.44600000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.312}]},{"osd":4,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.3279999999999998,"5min":2.3279999999999998,"15min":2.3279999999999998},"last":0.78100000000000003}]},{"osd":7,"last update":"Wed Dec 13 22:26:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.497},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:26:50.930 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-13T22:26:50.930 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-13T22:26:50.930 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-13T22:26:50.930 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-13T22:26:51.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 Processor -- start 2023-12-13T22:26:51.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 -- start start 2023-12-13T22:26:51.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 0x7fc21815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2180c7910 con 0x7fc21806f1a0 2023-12-13T22:26:51.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2180c1fe0 con 0x7fc2181516c0 2023-12-13T22:26:51.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc21dff1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21815b700 con 0x7fc218159380 2023-12-13T22:26:51.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc2177fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc2181516c0 0x7fc2180ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:55540/0 (socket says 172.21.15.91:55540) 2023-12-13T22:26:51.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.088+0000 7fc2177fe640 1 -- 172.21.15.91:0/2894500722 learned_addr learned my addr 172.21.15.91:0/2894500722 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:51.089 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.092+0000 7fc217fff640 1 --2- 172.21.15.91:0/2894500722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 0x7fc21815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.100+0000 7fc216ffd640 1 -- 172.21.15.91:0/2894500722 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804510170 0 0) 0x7fc2180c1fe0 con 0x7fc2181516c0 2023-12-13T22:26:51.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.100+0000 7fc216ffd640 1 -- 172.21.15.91:0/2894500722 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc204003530 con 0x7fc2181516c0 2023-12-13T22:26:51.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.100+0000 7fc217fff640 1 -- 172.21.15.91:0/2894500722 >> v1:172.21.15.152:6789/0 conn(0x7fc2181516c0 legacy=0x7fc2180ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.100+0000 7fc217fff640 1 -- 172.21.15.91:0/2894500722 >> v1:172.21.15.91:6789/0 conn(0x7fc21806f1a0 legacy=0x7fc218158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:51.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.100+0000 7fc217fff640 1 -- 172.21.15.91:0/2894500722 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180c22c0 con 0x7fc218159380 2023-12-13T22:26:51.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.104+0000 7fc217fff640 1 --2- 172.21.15.91:0/2894500722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 0x7fc21815b1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc210009dc0 tx=0x7fc21001f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98eb3b21134362f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc216ffd640 1 -- 172.21.15.91:0/2894500722 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100af600 con 0x7fc218159380 2023-12-13T22:26:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc216ffd640 1 -- 172.21.15.91:0/2894500722 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2100ab050 con 0x7fc218159380 2023-12-13T22:26:51.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc216ffd640 1 -- 172.21.15.91:0/2894500722 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2100af980 con 0x7fc218159380 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 -- 172.21.15.91:0/2894500722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 msgr2=0x7fc21815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2894500722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 0x7fc21815b1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc210009dc0 tx=0x7fc21001f120 comp rx=0 tx=0).stop 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 -- 172.21.15.91:0/2894500722 shutdown_connections 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2894500722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc218159380 0x7fc21815b1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 -- 172.21.15.91:0/2894500722 >> 172.21.15.91:0/2894500722 conn(0x7fc218070a30 msgr2=0x7fc218070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 -- 172.21.15.91:0/2894500722 shutdown_connections 2023-12-13T22:26:51.116 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.116+0000 7fc21dff1640 1 -- 172.21.15.91:0/2894500722 wait complete. 2023-12-13T22:26:51.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 Processor -- start 2023-12-13T22:26:51.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 -- start start 2023-12-13T22:26:51.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc2181516c0 0x7fc21814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc218159380 0x7fc2181f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218154220 con 0x7fc21806f1a0 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180b1430 con 0x7fc218159380 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc21dff1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc218151f90 con 0x7fc2181516c0 2023-12-13T22:26:51.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50650/0 (socket says 172.21.15.91:50650) 2023-12-13T22:26:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc2177fe640 1 -- 172.21.15.91:0/2901957041 learned_addr learned my addr 172.21.15.91:0/2901957041 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc217fff640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc218159380 0x7fc2181f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.120 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.120+0000 7fc20ffff640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc2181516c0 0x7fc21814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.124+0000 7fc2177fe640 1 -- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc2181516c0 msgr2=0x7fc21814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.124+0000 7fc2177fe640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc2181516c0 0x7fc21814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.124+0000 7fc2177fe640 1 -- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc218159380 msgr2=0x7fc2181f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.124+0000 7fc2177fe640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc218159380 0x7fc2181f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.124+0000 7fc2177fe640 1 -- 172.21.15.91:0/2901957041 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210009a70 con 0x7fc21806f1a0 2023-12-13T22:26:51.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.128+0000 7fc2177fe640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c4d0 tx=0x7fc20800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208005cf0 con 0x7fc21806f1a0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208005e50 con 0x7fc21806f1a0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208007270 con 0x7fc21806f1a0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2180b16a0 con 0x7fc21806f1a0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2180b1c60 con 0x7fc21806f1a0 2023-12-13T22:26:51.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.136+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180c3200 con 0x7fc21806f1a0 2023-12-13T22:26:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.416+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc2080073d0 con 0x7fc21806f1a0 2023-12-13T22:26:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.416+0000 7fc214ff9640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 0x7fc1f8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.416+0000 7fc20ffff640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 0x7fc1f8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.420+0000 7fc20ffff640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 0x7fc1f8068d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc218154d60 tx=0x7fc200009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:51.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.460+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc208054b60 con 0x7fc21806f1a0 2023-12-13T22:26:51.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.492+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc208050ea0 con 0x7fc21806f1a0 2023-12-13T22:26:51.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.700+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc218067520 con 0x7fc21806f1a0 2023-12-13T22:26:51.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.712+0000 7fc214ff9640 1 -- 172.21.15.91:0/2901957041 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc2080544c0 con 0x7fc21806f1a0 2023-12-13T22:26:51.712 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:51.712 INFO:teuthology.orchestra.run.smithi091.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 msgr2=0x7fc1f8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 0x7fc1f8068d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc218154d60 tx=0x7fc200009060 comp rx=0 tx=0).stop 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 msgr2=0x7fc218061230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc20800c4d0 tx=0x7fc20800c990 comp rx=0 tx=0).stop 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 shutdown_connections 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fc1f8066870 0x7fc1f8068d30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc218159380 0x7fc2181f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc2181516c0 0x7fc21814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 --2- 172.21.15.91:0/2901957041 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fc21806f1a0 0x7fc218061230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 >> 172.21.15.91:0/2901957041 conn(0x7fc218070a30 msgr2=0x7fc218158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:51.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 shutdown_connections 2023-12-13T22:26:51.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.716+0000 7fc21dff1640 1 -- 172.21.15.91:0/2901957041 wait complete. 2023-12-13T22:26:51.732 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-13T22:26:51.732 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:51.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 Processor -- start 2023-12-13T22:26:51.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 -- start start 2023-12-13T22:26:51.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fae640c8e10 0x7fae64157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae64151950 con 0x7fae6406a560 2023-12-13T22:26:51.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6406ab80 con 0x7fae64151570 2023-12-13T22:26:51.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae6b977640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640c7d40 con 0x7fae640c8e10 2023-12-13T22:26:51.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae68f12640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fae6406a560 0x7fae6415fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37470/0 (socket says 172.21.15.91:37470) 2023-12-13T22:26:51.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.872+0000 7fae68f12640 1 -- 172.21.15.91:0/3013557464 learned_addr learned my addr 172.21.15.91:0/3013557464 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:51.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.876+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649834374 0 0) 0x7fae64151950 con 0x7fae6406a560 2023-12-13T22:26:51.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.876+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae50003530 con 0x7fae6406a560 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312249372 0 0) 0x7fae50003530 con 0x7fae6406a560 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 >> v2:172.21.15.152:3300/0 conn(0x7fae640c8e10 msgr2=0x7fae64157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 --2- 172.21.15.91:0/3013557464 >> v2:172.21.15.152:3300/0 conn(0x7fae640c8e10 0x7fae64157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 >> v1:172.21.15.152:6789/0 conn(0x7fae64151570 legacy=0x7fae640c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6406ae20 con 0x7fae6406a560 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fae54001680 con 0x7fae6406a560 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 >> v1:172.21.15.91:6789/0 conn(0x7fae6406a560 legacy=0x7fae6415fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 0x7fae50003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae500047d0 0x7fae50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae50005390 0x7fae5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae640c7d40 con 0x7fae50003a40 2023-12-13T22:26:51.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5000c250 con 0x7fae500047d0 2023-12-13T22:26:51.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5000c410 con 0x7fae50005390 2023-12-13T22:26:51.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.880+0000 7fae69713640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 0x7fae50003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69713640 1 -- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae50005390 msgr2=0x7fae5000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69713640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae50005390 0x7fae5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69713640 1 -- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae500047d0 msgr2=0x7fae50004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69713640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae500047d0 0x7fae50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69713640 1 -- 172.21.15.91:0/3013557464 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50003530 con 0x7fae50003a40 2023-12-13T22:26:51.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.884+0000 7fae69f14640 1 -- 172.21.15.91:0/3013557464 reap_dead start 2023-12-13T22:26:51.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.888+0000 7fae69713640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 0x7fae50003e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae60001650 tx=0x7fae6001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2d35d95da237ad server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:51.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60005270 con 0x7fae50003a40 2023-12-13T22:26:51.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae600a7070 con 0x7fae50003a40 2023-12-13T22:26:51.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae5bfff640 1 -- 172.21.15.91:0/3013557464 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60003860 con 0x7fae50003a40 2023-12-13T22:26:51.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 -- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 msgr2=0x7fae50003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 0x7fae50003e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae60001650 tx=0x7fae6001c2e0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 -- 172.21.15.91:0/3013557464 shutdown_connections 2023-12-13T22:26:51.892 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 --2- 172.21.15.91:0/3013557464 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae50003a40 0x7fae50003e40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 -- 172.21.15.91:0/3013557464 >> 172.21.15.91:0/3013557464 conn(0x7fae64070160 msgr2=0x7fae6406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:51.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 -- 172.21.15.91:0/3013557464 shutdown_connections 2023-12-13T22:26:51.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.892+0000 7fae6b977640 1 -- 172.21.15.91:0/3013557464 wait complete. 2023-12-13T22:26:51.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 Processor -- start 2023-12-13T22:26:51.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 -- start start 2023-12-13T22:26:51.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae50003a40 0x7fae641f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae64146020 0x7fae64146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641f13c0 con 0x7fae64155f70 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64146c80 con 0x7fae50003a40 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae6b977640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae64147b70 con 0x7fae64146020 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae69f14640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae69f14640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50658/0 (socket says 172.21.15.91:50658) 2023-12-13T22:26:51.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.896+0000 7fae69f14640 1 -- 172.21.15.91:0/2110791794 learned_addr learned my addr 172.21.15.91:0/2110791794 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:51.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.900+0000 7fae69f14640 1 -- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae64146020 msgr2=0x7fae64146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.900+0000 7fae69f14640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae64146020 0x7fae64146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.900+0000 7fae69f14640 1 -- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae50003a40 msgr2=0x7fae641f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:51.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.900+0000 7fae69f14640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae50003a40 0x7fae641f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:51.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.900+0000 7fae69f14640 1 -- 172.21.15.91:0/2110791794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64145d60 con 0x7fae64155f70 2023-12-13T22:26:51.901 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.904+0000 7fae69f14640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fae640c8b30 tx=0x7fae5c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:51.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00aa20 con 0x7fae64155f70 2023-12-13T22:26:51.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00ab80 con 0x7fae64155f70 2023-12-13T22:26:51.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c012400 con 0x7fae64155f70 2023-12-13T22:26:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae64156440 con 0x7fae64155f70 2023-12-13T22:26:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641f3b10 con 0x7fae64155f70 2023-12-13T22:26:51.906 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:51.908+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae641f3970 con 0x7fae64155f70 2023-12-13T22:26:52.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.184+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fae5c005d50 con 0x7fae64155f70 2023-12-13T22:26:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.188+0000 7fae59ffb640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 0x7fae48068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.188+0000 7fae69713640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 0x7fae48068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.188+0000 7fae69713640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 0x7fae48068d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae600aa000 tx=0x7fae60000fc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:52.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.228+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae5c0551e0 con 0x7fae64155f70 2023-12-13T22:26:52.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.228+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fae5c050e20 con 0x7fae64155f70 2023-12-13T22:26:52.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.396+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae641f3970 con 0x7fae64155f70 2023-12-13T22:26:52.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.448+0000 7fae59ffb640 1 -- 172.21.15.91:0/2110791794 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fae641f3970 con 0x7fae64155f70 2023-12-13T22:26:52.448 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:52.449 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 msgr2=0x7fae48068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 0x7fae48068d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae600aa000 tx=0x7fae60000fc0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 msgr2=0x7fae64147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fae640c8b30 tx=0x7fae5c00ccd0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 shutdown_connections 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fae48066840 0x7fae48068d00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fae64155f70 0x7fae64147630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae64146020 0x7fae64146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 --2- 172.21.15.91:0/2110791794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae50003a40 0x7fae641f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 >> 172.21.15.91:0/2110791794 conn(0x7fae64070160 msgr2=0x7fae640cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 shutdown_connections 2023-12-13T22:26:52.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.452+0000 7fae6b977640 1 -- 172.21.15.91:0/2110791794 wait complete. 2023-12-13T22:26:52.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:26:52.470 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:26:52.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.596+0000 7fcce3688640 1 Processor -- start 2023-12-13T22:26:52.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.596+0000 7fcce3688640 1 -- start start 2023-12-13T22:26:52.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce3688640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fccdc151340 0x7fccdc06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce3688640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc0c40e0 0x7fccdc0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce3688640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc06f4a0 con 0x7fccdc151720 2023-12-13T22:26:52.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce3688640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc072570 con 0x7fccdc151340 2023-12-13T22:26:52.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce3688640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc070be0 con 0x7fccdc0c40e0 2023-12-13T22:26:52.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce1424640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fccdc151340 0x7fccdc06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce1424640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fccdc151340 0x7fccdc06ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50668/0 (socket says 172.21.15.91:50668) 2023-12-13T22:26:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce1424640 1 -- 172.21.15.91:0/1881295933 learned_addr learned my addr 172.21.15.91:0/1881295933 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:52.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.600+0000 7fcce1c25640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc0c40e0 0x7fccdc0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.604+0000 7fcce1424640 1 -- 172.21.15.91:0/1881295933 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc0c40e0 msgr2=0x7fccdc0c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:52.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.604+0000 7fcce1424640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc0c40e0 0x7fccdc0c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.604+0000 7fcce1424640 1 -- 172.21.15.91:0/1881295933 >> v1:172.21.15.91:6789/0 conn(0x7fccdc151720 legacy=0x7fccdc157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:52.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.604+0000 7fcce1424640 1 -- 172.21.15.91:0/1881295933 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc070e80 con 0x7fccdc151340 2023-12-13T22:26:52.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.608+0000 7fcce1424640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc151340 0x7fccdc06ee10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0c5090 tx=0x7fccd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207481cd001b178 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:52.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fccd3fff640 1 -- 172.21.15.91:0/1881295933 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80ab650 con 0x7fccdc151340 2023-12-13T22:26:52.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fccd3fff640 1 -- 172.21.15.91:0/1881295933 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80ab7b0 con 0x7fccdc151340 2023-12-13T22:26:52.613 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fccd3fff640 1 -- 172.21.15.91:0/1881295933 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80abb40 con 0x7fccdc151340 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- 172.21.15.91:0/1881295933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc151340 msgr2=0x7fccdc06ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc151340 0x7fccdc06ee10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0c5090 tx=0x7fccd801c490 comp rx=0 tx=0).stop 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- 172.21.15.91:0/1881295933 shutdown_connections 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc0c40e0 0x7fccdc0c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- 172.21.15.91:0/1881295933 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc151340 0x7fccdc06ee10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- 172.21.15.91:0/1881295933 >> 172.21.15.91:0/1881295933 conn(0x7fccdc06c6a0 msgr2=0x7fccdc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- 172.21.15.91:0/1881295933 shutdown_connections 2023-12-13T22:26:52.614 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- 172.21.15.91:0/1881295933 wait complete. 2023-12-13T22:26:52.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 Processor -- start 2023-12-13T22:26:52.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- start start 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc151340 0x7fccdc1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccdc151720 0x7fccdc1f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1f2640 con 0x7fccdc0c40e0 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c91a0 con 0x7fccdc151720 2023-12-13T22:26:52.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.616+0000 7fcce3688640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1f5b00 con 0x7fccdc151340 2023-12-13T22:26:52.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.620+0000 7fcce1424640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.620+0000 7fcce1424640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50684/0 (socket says 172.21.15.91:50684) 2023-12-13T22:26:52.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.620+0000 7fcce1424640 1 -- 172.21.15.91:0/187818919 learned_addr learned my addr 172.21.15.91:0/187818919 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:52.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.620+0000 7fcce1c25640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccdc151720 0x7fccdc1f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.617 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.620+0000 7fcce0c23640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc151340 0x7fccdc1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 -- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc151340 msgr2=0x7fccdc1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:52.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc151340 0x7fccdc1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 -- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccdc151720 msgr2=0x7fccdc1f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:52.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccdc151720 0x7fccdc1f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:52.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 -- 172.21.15.91:0/187818919 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80094d0 con 0x7fccdc0c40e0 2023-12-13T22:26:52.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.624+0000 7fcce1424640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccd801cd30 tx=0x7fccd801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80be5f0 con 0x7fccdc0c40e0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80be750 con 0x7fccdc0c40e0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc1f2fa0 con 0x7fccdc0c40e0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd80beb00 con 0x7fccdc0c40e0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1f5fe0 con 0x7fccdc0c40e0 2023-12-13T22:26:52.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.628+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc067520 con 0x7fccdc0c40e0 2023-12-13T22:26:52.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.656+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fccd80b4600 con 0x7fccdc0c40e0 2023-12-13T22:26:52.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.656+0000 7fccd1ffb640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 0x7fccc0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:52.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.656+0000 7fcce0c23640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 0x7fccc0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:52.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.656+0000 7fcce0c23640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 0x7fccc0068d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccdc150160 tx=0x7fcccc007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:52.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.932+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccd80f0540 con 0x7fccdc0c40e0 2023-12-13T22:26:52.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:52.932+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fccd80ec880 con 0x7fccdc0c40e0 2023-12-13T22:26:53.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.128+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccdc150230 con 0x7fccdc0c40e0 2023-12-13T22:26:53.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fccd1ffb640 1 -- 172.21.15.91:0/187818919 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccd80efea0 con 0x7fccdc0c40e0 2023-12-13T22:26:53.153 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 msgr2=0x7fccc0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 0x7fccc0068d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccdc150160 tx=0x7fcccc007e40 comp rx=0 tx=0).stop 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 msgr2=0x7fccdc14fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fccd801cd30 tx=0x7fccd801acd0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 shutdown_connections 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fccc0066870 0x7fccc0068d30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fccdc151720 0x7fccdc1f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fccdc151340 0x7fccdc1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.156 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 --2- 172.21.15.91:0/187818919 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fccdc0c40e0 0x7fccdc14fc20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 >> 172.21.15.91:0/187818919 conn(0x7fccdc06c6a0 msgr2=0x7fccdc0c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:53.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 shutdown_connections 2023-12-13T22:26:53.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.156+0000 7fcce3688640 1 -- 172.21.15.91:0/187818919 wait complete. 2023-12-13T22:26:53.174 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:26:53.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.304+0000 7f733dea2640 1 Processor -- start 2023-12-13T22:26:53.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.304+0000 7f733dea2640 1 -- start start 2023-12-13T22:26:53.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.304+0000 7f733dea2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73380ccfb0 0x7f73380cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f733dea2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f73381572c0 0x7f73380c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f733dea2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73380c9aa0 con 0x7f733815a830 2023-12-13T22:26:53.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f733dea2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73381576f0 con 0x7f73380ccfb0 2023-12-13T22:26:53.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f733dea2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733815adb0 con 0x7f73381572c0 2023-12-13T22:26:53.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73380ccfb0 0x7f73380cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f73380ccfb0 0x7f73380cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50686/0 (socket says 172.21.15.91:50686) 2023-12-13T22:26:53.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 -- 172.21.15.91:0/3157175892 learned_addr learned my addr 172.21.15.91:0/3157175892 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:53.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 -- 172.21.15.91:0/3157175892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f73381572c0 msgr2=0x7f73380c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:53.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 --2- 172.21.15.91:0/3157175892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f73381572c0 0x7f73380c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 -- 172.21.15.91:0/3157175892 >> v1:172.21.15.152:6789/0 conn(0x7f733815a830 legacy=0x7f7338151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:53.308 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.308+0000 7f73377fe640 1 -- 172.21.15.91:0/3157175892 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733815b050 con 0x7f73380ccfb0 2023-12-13T22:26:53.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.312+0000 7f73377fe640 1 --2- 172.21.15.91:0/3157175892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f73380cc470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f732801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41579979b6dcd33e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:53.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f73367fc640 1 -- 172.21.15.91:0/3157175892 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a89b0 con 0x7f73380ccfb0 2023-12-13T22:26:53.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f73367fc640 1 -- 172.21.15.91:0/3157175892 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280a8b10 con 0x7f73380ccfb0 2023-12-13T22:26:53.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f73367fc640 1 -- 172.21.15.91:0/3157175892 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a8ea0 con 0x7f73380ccfb0 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 -- 172.21.15.91:0/3157175892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 msgr2=0x7f73380cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 --2- 172.21.15.91:0/3157175892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f73380cc470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7328009870 tx=0x7f732801ecf0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 -- 172.21.15.91:0/3157175892 shutdown_connections 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 --2- 172.21.15.91:0/3157175892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f73381572c0 0x7f73380c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 --2- 172.21.15.91:0/3157175892 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f73380cc470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.316 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 -- 172.21.15.91:0/3157175892 >> 172.21.15.91:0/3157175892 conn(0x7f7338061400 msgr2=0x7f7338061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:53.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 -- 172.21.15.91:0/3157175892 shutdown_connections 2023-12-13T22:26:53.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.316+0000 7f733dea2640 1 -- 172.21.15.91:0/3157175892 wait complete. 2023-12-13T22:26:53.317 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 Processor -- start 2023-12-13T22:26:53.318 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 -- start start 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73381572c0 0x7f73381ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f733815a830 0x7f73380c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73381edbf0 con 0x7f73380ccfb0 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73381466d0 con 0x7f73381572c0 2023-12-13T22:26:53.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f733dea2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73380c6440 con 0x7f733815a830 2023-12-13T22:26:53.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f73377fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f73377fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50688/0 (socket says 172.21.15.91:50688) 2023-12-13T22:26:53.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.320+0000 7f73377fe640 1 -- 172.21.15.91:0/2268191243 learned_addr learned my addr 172.21.15.91:0/2268191243 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:53.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.324+0000 7f73377fe640 1 -- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f733815a830 msgr2=0x7f73380c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.324+0000 7f73377fe640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f733815a830 0x7f73380c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.324+0000 7f73377fe640 1 -- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73381572c0 msgr2=0x7f73381ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.324+0000 7f73377fe640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73381572c0 0x7f73381ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.324+0000 7f73377fe640 1 -- 172.21.15.91:0/2268191243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280094d0 con 0x7f73380ccfb0 2023-12-13T22:26:53.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.328+0000 7f73377fe640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f73280b3040 tx=0x7f732801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:53.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280b0e40 con 0x7f73380ccfb0 2023-12-13T22:26:53.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280bb470 con 0x7f73380ccfb0 2023-12-13T22:26:53.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280bb820 con 0x7f73380ccfb0 2023-12-13T22:26:53.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733814d0b0 con 0x7f73380ccfb0 2023-12-13T22:26:53.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73380c5420 con 0x7f73380ccfb0 2023-12-13T22:26:53.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.332+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7338150e40 con 0x7f73380ccfb0 2023-12-13T22:26:53.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.352+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f73280b7070 con 0x7f73380ccfb0 2023-12-13T22:26:53.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.352+0000 7f731ffff640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 0x7f7324068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.352+0000 7f7336ffd640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 0x7f7324068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.352+0000 7f7336ffd640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 0x7f7324068d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f732c007fd0 tx=0x7f732c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:53.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.636+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73280f45e0 con 0x7f73380ccfb0 2023-12-13T22:26:53.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.636+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f73280f0220 con 0x7f73380ccfb0 2023-12-13T22:26:53.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.804+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7338150e40 con 0x7f73380ccfb0 2023-12-13T22:26:53.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f731ffff640 1 -- 172.21.15.91:0/2268191243 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73280b5020 con 0x7f73380ccfb0 2023-12-13T22:26:53.813 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 msgr2=0x7f7324068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 0x7f7324068d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f732c007fd0 tx=0x7f732c0079a0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 msgr2=0x7f733814c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f73280b3040 tx=0x7f732801ba90 comp rx=0 tx=0).stop 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 shutdown_connections 2023-12-13T22:26:53.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f7324066870 0x7f7324068d30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f733815a830 0x7f73380c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73381572c0 0x7f73381ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 --2- 172.21.15.91:0/2268191243 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f73380ccfb0 0x7f733814c880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 >> 172.21.15.91:0/2268191243 conn(0x7f7338061400 msgr2=0x7f733814ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 shutdown_connections 2023-12-13T22:26:53.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.816+0000 7f733dea2640 1 -- 172.21.15.91:0/2268191243 wait complete. 2023-12-13T22:26:53.835 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:26:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 Processor -- start 2023-12-13T22:26:53.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 -- start start 2023-12-13T22:26:53.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06dc70 0x7f077c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f077c156710 0x7f077c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0c1bf0 con 0x7f077c06d890 2023-12-13T22:26:53.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c155a20 con 0x7f077c156710 2023-12-13T22:26:53.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f0782e3e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0c1ed0 con 0x7f077c06dc70 2023-12-13T22:26:53.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f07813db640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f077c156710 0x7f077c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f07813db640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f077c156710 0x7f077c152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50702/0 (socket says 172.21.15.91:50702) 2023-12-13T22:26:53.967 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f07813db640 1 -- 172.21.15.91:0/1211129387 learned_addr learned my addr 172.21.15.91:0/1211129387 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:53.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.968+0000 7f077bfff640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06dc70 0x7f077c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.972+0000 7f07813db640 1 -- 172.21.15.91:0/1211129387 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06dc70 msgr2=0x7f077c0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:53.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.972+0000 7f07813db640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06dc70 0x7f077c0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.972+0000 7f07813db640 1 -- 172.21.15.91:0/1211129387 >> v1:172.21.15.152:6789/0 conn(0x7f077c06d890 legacy=0x7f077c0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.970 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.972+0000 7f07813db640 1 -- 172.21.15.91:0/1211129387 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c155c30 con 0x7f077c156710 2023-12-13T22:26:53.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.976+0000 7f07813db640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c152a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0774009e50 tx=0x7f077401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac06a846220b33e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:53.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f077b7fe640 1 -- 172.21.15.91:0/1211129387 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740af400 con 0x7f077c156710 2023-12-13T22:26:53.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f077b7fe640 1 -- 172.21.15.91:0/1211129387 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740ab050 con 0x7f077c156710 2023-12-13T22:26:53.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f077b7fe640 1 -- 172.21.15.91:0/1211129387 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740af780 con 0x7f077c156710 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- 172.21.15.91:0/1211129387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 msgr2=0x7f077c152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c152a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0774009e50 tx=0x7f077401f1f0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- 172.21.15.91:0/1211129387 shutdown_connections 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c152a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- 172.21.15.91:0/1211129387 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06dc70 0x7f077c0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- 172.21.15.91:0/1211129387 >> 172.21.15.91:0/1211129387 conn(0x7f077c0c79b0 msgr2=0x7f077c0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- 172.21.15.91:0/1211129387 shutdown_connections 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- 172.21.15.91:0/1211129387 wait complete. 2023-12-13T22:26:53.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 Processor -- start 2023-12-13T22:26:53.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- start start 2023-12-13T22:26:53.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06d890 0x7f077c1ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.979 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c06dc70 0x7f077c0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c1541a0 con 0x7f077c156710 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c154760 con 0x7f077c06dc70 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f0782e3e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c151c20 con 0x7f077c06d890 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f07813db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f07813db640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50710/0 (socket says 172.21.15.91:50710) 2023-12-13T22:26:53.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.980+0000 7f07813db640 1 -- 172.21.15.91:0/274780989 learned_addr learned my addr 172.21.15.91:0/274780989 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:53.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f077bfff640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c06dc70 0x7f077c0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.981 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f0780bda640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06d890 0x7f077c1ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:53.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f07813db640 1 -- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06d890 msgr2=0x7f077c1ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f07813db640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06d890 0x7f077c1ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f07813db640 1 -- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c06dc70 msgr2=0x7f077c0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:53.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f07813db640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c06dc70 0x7f077c0c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:53.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.984+0000 7f07813db640 1 -- 172.21.15.91:0/274780989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009b30 con 0x7f077c156710 2023-12-13T22:26:53.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.988+0000 7f07813db640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07740b2040 tx=0x7f077401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:53.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740c0070 con 0x7f077c156710 2023-12-13T22:26:53.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774009510 con 0x7f077c156710 2023-12-13T22:26:53.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c151ec0 con 0x7f077c156710 2023-12-13T22:26:53.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740afe40 con 0x7f077c156710 2023-12-13T22:26:53.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c1543f0 con 0x7f077c156710 2023-12-13T22:26:53.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:53.992+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c061bf0 con 0x7f077c156710 2023-12-13T22:26:54.269 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.272+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f07740b6040 con 0x7f077c156710 2023-12-13T22:26:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.272+0000 7f07797fa640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 0x7f0760068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.272+0000 7f0780bda640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 0x7f0760068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:54.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.272+0000 7f0780bda640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 0x7f0760068d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0770007fd0 tx=0x7f0770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:54.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.308+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07740f2d00 con 0x7f077c156710 2023-12-13T22:26:54.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.308+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f07740ef040 con 0x7f077c156710 2023-12-13T22:26:54.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.468+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f077c067520 con 0x7f077c156710 2023-12-13T22:26:54.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f07797fa640 1 -- 172.21.15.91:0/274780989 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07740b4020 con 0x7f077c156710 2023-12-13T22:26:54.477 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:26:54.479 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 msgr2=0x7f0760068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 0x7f0760068d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0770007fd0 tx=0x7f0770009040 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 msgr2=0x7f077c154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f07740b2040 tx=0x7f077401bf90 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 shutdown_connections 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0760066840 0x7f0760068d00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f077c156710 0x7f077c154bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c06dc70 0x7f077c0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 --2- 172.21.15.91:0/274780989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f077c06d890 0x7f077c1ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 >> 172.21.15.91:0/274780989 conn(0x7f077c0c79b0 msgr2=0x7f077c0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 shutdown_connections 2023-12-13T22:26:54.480 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.480+0000 7f0782e3e640 1 -- 172.21.15.91:0/274780989 wait complete. 2023-12-13T22:26:54.497 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:26:54.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 Processor -- start 2023-12-13T22:26:54.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 -- start start 2023-12-13T22:26:54.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 0x7f5c20156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c200c6820 con 0x7f5c200c5560 2023-12-13T22:26:54.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c20156af0 con 0x7f5c200c5180 2023-12-13T22:26:54.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c27040640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c200c4370 con 0x7f5c200c7440 2023-12-13T22:26:54.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c1ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f5c200c5560 0x7f5c2014ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37490/0 (socket says 172.21.15.91:37490) 2023-12-13T22:26:54.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.624+0000 7f5c1ffff640 1 -- 172.21.15.91:0/2307653363 learned_addr learned my addr 172.21.15.91:0/2307653363 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:54.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.628+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719669476 0 0) 0x7f5c200c6820 con 0x7f5c200c5560 2023-12-13T22:26:54.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.628+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c08005740 con 0x7f5c200c5560 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237427039 0 0) 0x7f5c08005740 con 0x7f5c200c5560 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 msgr2=0x7f5c20156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 0x7f5c20156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 >> v1:172.21.15.152:6789/0 conn(0x7f5c200c5180 legacy=0x7f5c2006b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200c6260 con 0x7f5c200c5560 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f5c14001680 con 0x7f5c200c5560 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 >> v1:172.21.15.91:6789/0 conn(0x7f5c200c5560 legacy=0x7f5c2014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c08005c30 0x7f5c08006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 0x7f5c080069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c08007040 0x7f5c0800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c200c4370 con 0x7f5c08005c30 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08007760 con 0x7f5c08007040 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.632+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0800e0e0 con 0x7f5c200c7440 2023-12-13T22:26:54.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.636+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c08005c30 0x7f5c08006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:54.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.640+0000 7f5c24ddc640 1 -- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 msgr2=0x7f5c080069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:54.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.640+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c200c7440 0x7f5c080069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.640+0000 7f5c24ddc640 1 -- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c08007040 msgr2=0x7f5c0800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:54.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.640+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c08007040 0x7f5c0800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.640+0000 7f5c24ddc640 1 -- 172.21.15.91:0/2307653363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08005740 con 0x7f5c08005c30 2023-12-13T22:26:54.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.644+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c08005c30 0x7f5c08006030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c10001650 tx=0x7f5c1001c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acafaa91cf18ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:54.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10005270 con 0x7f5c08005c30 2023-12-13T22:26:54.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c100a7070 con 0x7f5c08005c30 2023-12-13T22:26:54.646 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c1f7fe640 1 -- 172.21.15.91:0/2307653363 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10003620 con 0x7f5c08005c30 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- 172.21.15.91:0/2307653363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c08005c30 msgr2=0x7f5c08006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 --2- 172.21.15.91:0/2307653363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c08005c30 0x7f5c08006030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c10001650 tx=0x7f5c1001c2b0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c255dd640 1 -- 172.21.15.91:0/2307653363 reap_dead start 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- 172.21.15.91:0/2307653363 shutdown_connections 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- 172.21.15.91:0/2307653363 >> 172.21.15.91:0/2307653363 conn(0x7f5c2006d220 msgr2=0x7f5c2006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- 172.21.15.91:0/2307653363 shutdown_connections 2023-12-13T22:26:54.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- 172.21.15.91:0/2307653363 wait complete. 2023-12-13T22:26:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 Processor -- start 2023-12-13T22:26:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.648+0000 7f5c27040640 1 -- start start 2023-12-13T22:26:54.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c201422a0 0x7f5c20149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c20146ea0 0x7f5c201f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c201f2770 con 0x7f5c20142680 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c20148610 con 0x7f5c201422a0 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c27040640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c20151530 con 0x7f5c20146ea0 2023-12-13T22:26:54.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c255dd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:54.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c255dd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50726/0 (socket says 172.21.15.91:50726) 2023-12-13T22:26:54.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.652+0000 7f5c255dd640 1 -- 172.21.15.91:0/1138138717 learned_addr learned my addr 172.21.15.91:0/1138138717 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:54.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 -- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c20146ea0 msgr2=0x7f5c201f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c20146ea0 0x7f5c201f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 -- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c201422a0 msgr2=0x7f5c20149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:54.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c201422a0 0x7f5c20149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:54.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 -- 172.21.15.91:0/1138138717 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20151810 con 0x7f5c20142680 2023-12-13T22:26:54.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.656+0000 7f5c255dd640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c200c26d0 tx=0x7f5c1800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1800aa20 con 0x7f5c20142680 2023-12-13T22:26:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1800aba0 con 0x7f5c20142680 2023-12-13T22:26:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18012400 con 0x7f5c20142680 2023-12-13T22:26:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c20151af0 con 0x7f5c20142680 2023-12-13T22:26:54.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c20148b60 con 0x7f5c20142680 2023-12-13T22:26:54.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.664+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c20148d20 con 0x7f5c20142680 2023-12-13T22:26:54.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.684+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5c18005d50 con 0x7f5c20142680 2023-12-13T22:26:54.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.684+0000 7f5c1d7fa640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 0x7f5c0c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:54.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.684+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 0x7f5c0c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:54.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.684+0000 7f5c24ddc640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 0x7f5c0c068d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c100aa000 tx=0x7f5c10000fc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:54.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.688+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c18055320 con 0x7f5c20142680 2023-12-13T22:26:54.931 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:54.932+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5c18050f60 con 0x7f5c20142680 2023-12-13T22:26:55.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.100+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5c20155f30 con 0x7f5c20142680 2023-12-13T22:26:55.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.120+0000 7f5c1d7fa640 1 -- 172.21.15.91:0/1138138717 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c180170a0 con 0x7f5c20142680 2023-12-13T22:26:55.118 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.120+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 msgr2=0x7f5c0c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.120+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 0x7f5c0c068d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c100aa000 tx=0x7f5c10000fc0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 msgr2=0x7f5c201546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c200c26d0 tx=0x7f5c1800ccd0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 shutdown_connections 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5c0c066840 0x7f5c0c068d00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5c20142680 0x7f5c201546e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c20146ea0 0x7f5c201f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 --2- 172.21.15.91:0/1138138717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c201422a0 0x7f5c20149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 >> 172.21.15.91:0/1138138717 conn(0x7f5c2006d220 msgr2=0x7f5c2006edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 shutdown_connections 2023-12-13T22:26:55.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.124+0000 7f5c27040640 1 -- 172.21.15.91:0/1138138717 wait complete. 2023-12-13T22:26:55.139 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:26:55.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.260+0000 7f114337f640 1 Processor -- start 2023-12-13T22:26:55.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.260+0000 7f114337f640 1 -- start start 2023-12-13T22:26:55.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114337f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f113c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114337f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c0c72b0 con 0x7f113c156dc0 2023-12-13T22:26:55.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114337f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c15a100 con 0x7f113c0c4a10 2023-12-13T22:26:55.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114337f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0c4f40 con 0x7f113c0c4630 2023-12-13T22:26:55.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114191c640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f113c156dc0 0x7f113c14fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37498/0 (socket says 172.21.15.91:37498) 2023-12-13T22:26:55.262 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114191c640 1 -- 172.21.15.91:0/1302774002 learned_addr learned my addr 172.21.15.91:0/1302774002 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:55.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.264+0000 7f114111b640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f113c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.268+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160290966 0 0) 0x7f113c0c72b0 con 0x7f113c156dc0 2023-12-13T22:26:55.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.268+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128003530 con 0x7f113c156dc0 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2375148818 0 0) 0x7f1128003530 con 0x7f113c156dc0 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 msgr2=0x7f113c0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f113c0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 >> v1:172.21.15.152:6789/0 conn(0x7f113c0c4a10 legacy=0x7f113c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c15a3e0 con 0x7f113c156dc0 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f1134001680 con 0x7f113c156dc0 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 >> v1:172.21.15.91:6789/0 conn(0x7f113c156dc0 legacy=0x7f113c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1128003a20 0x7f1128003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11280047d0 0x7f1128004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f11280051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112800ddc0 con 0x7f11280047d0 2023-12-13T22:26:55.270 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112800df30 con 0x7f1128003a20 2023-12-13T22:26:55.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112800e0f0 con 0x7f113c0c4630 2023-12-13T22:26:55.271 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.272+0000 7f114091a640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11280047d0 0x7f1128004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.275 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114111b640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1128003a20 0x7f1128003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114191c640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f11280051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114091a640 1 -- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 msgr2=0x7f11280051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114091a640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c0c4630 0x7f11280051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114091a640 1 -- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1128003a20 msgr2=0x7f1128003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114091a640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1128003a20 0x7f1128003e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.276 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.276+0000 7f114091a640 1 -- 172.21.15.91:0/1302774002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128003530 con 0x7f11280047d0 2023-12-13T22:26:55.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.280+0000 7f114091a640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11280047d0 0x7f1128004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f112c001750 tx=0x7f112c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8ed217d6ce75aa server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:55.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.284+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0052d0 con 0x7f11280047d0 2023-12-13T22:26:55.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.284+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c0a7050 con 0x7f11280047d0 2023-12-13T22:26:55.284 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.284+0000 7f1133fff640 1 -- 172.21.15.91:0/1302774002 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c003840 con 0x7f11280047d0 2023-12-13T22:26:55.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- 172.21.15.91:0/1302774002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11280047d0 msgr2=0x7f1128004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 --2- 172.21.15.91:0/1302774002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f11280047d0 0x7f1128004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f112c001750 tx=0x7f112c01c3c0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114191c640 1 -- 172.21.15.91:0/1302774002 reap_dead start 2023-12-13T22:26:55.285 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- 172.21.15.91:0/1302774002 shutdown_connections 2023-12-13T22:26:55.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- 172.21.15.91:0/1302774002 >> 172.21.15.91:0/1302774002 conn(0x7f113c06c6a0 msgr2=0x7f113c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:55.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- 172.21.15.91:0/1302774002 shutdown_connections 2023-12-13T22:26:55.286 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- 172.21.15.91:0/1302774002 wait complete. 2023-12-13T22:26:55.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 Processor -- start 2023-12-13T22:26:55.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- start start 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11280047d0 0x7f113c141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c072280 0x7f113c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0c9d70 con 0x7f113c1f27f0 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c1477f0 con 0x7f11280047d0 2023-12-13T22:26:55.288 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114337f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0ca050 con 0x7f113c072280 2023-12-13T22:26:55.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.288+0000 7f114191c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.292+0000 7f114191c640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50742/0 (socket says 172.21.15.91:50742) 2023-12-13T22:26:55.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.292+0000 7f114191c640 1 -- 172.21.15.91:0/2184661362 learned_addr learned my addr 172.21.15.91:0/2184661362 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:55.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.292+0000 7f114111b640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11280047d0 0x7f113c141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.289 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.292+0000 7f114091a640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c072280 0x7f113c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 -- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c072280 msgr2=0x7f113c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c072280 0x7f113c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 -- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11280047d0 msgr2=0x7f113c141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11280047d0 0x7f113c141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 -- 172.21.15.91:0/2184661362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0c8e10 con 0x7f113c1f27f0 2023-12-13T22:26:55.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.296+0000 7f114191c640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f113c06e0b0 tx=0x7f113400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:55.299 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.300+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134007440 con 0x7f113c1f27f0 2023-12-13T22:26:55.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.300+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11340075a0 con 0x7f113c1f27f0 2023-12-13T22:26:55.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.300+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c0c90f0 con 0x7f113c1f27f0 2023-12-13T22:26:55.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.300+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134004a30 con 0x7f113c1f27f0 2023-12-13T22:26:55.300 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.300+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c0c96b0 con 0x7f113c1f27f0 2023-12-13T22:26:55.301 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.304+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0c9eb0 con 0x7f113c1f27f0 2023-12-13T22:26:55.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.320+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1134004b90 con 0x7f113c1f27f0 2023-12-13T22:26:55.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.320+0000 7f1131ffb640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 0x7f1120068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.324+0000 7f114111b640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 0x7f1120068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.321 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.324+0000 7f114111b640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 0x7f1120068ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1138003c10 tx=0x7f113800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:55.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.576+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11340551e0 con 0x7f113c1f27f0 2023-12-13T22:26:55.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.576+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1134051520 con 0x7f113c1f27f0 2023-12-13T22:26:55.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.788+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f113c0c9eb0 con 0x7f113c1f27f0 2023-12-13T22:26:55.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.824+0000 7f1131ffb640 1 -- 172.21.15.91:0/2184661362 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6527 (secure 0 0 0) 0x7f113c0c9eb0 con 0x7f113c1f27f0 2023-12-13T22:26:55.823 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:55.823 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:41.869732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:26:55.823 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 15 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 msgr2=0x7f1120068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 0x7f1120068ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1138003c10 tx=0x7f113800b040 comp rx=0 tx=0).stop 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 msgr2=0x7f113c1492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f113c06e0b0 tx=0x7f113400d9d0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 shutdown_connections 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1120066820 0x7f1120068ce0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f113c1f27f0 0x7f113c1492c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f113c072280 0x7f113c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 --2- 172.21.15.91:0/2184661362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11280047d0 0x7f113c141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 >> 172.21.15.91:0/2184661362 conn(0x7f113c06c6a0 msgr2=0x7f113c1479b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:55.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 shutdown_connections 2023-12-13T22:26:55.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.828+0000 7f114337f640 1 -- 172.21.15.91:0/2184661362 wait complete. 2023-12-13T22:26:55.845 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:26:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 Processor -- start 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 -- start start 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb3840c5ab0 0x7fb384159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb3840c3320 0x7fb3840c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb384153b70 con 0x7fb384153460 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38415d730 con 0x7fb3840c3320 2023-12-13T22:26:55.972 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.972+0000 7fb38c495640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38415a3e0 con 0x7fb3840c5ab0 2023-12-13T22:26:55.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.976+0000 7fb38aa32640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb3840c3320 0x7fb3840c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.976+0000 7fb38aa32640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb3840c3320 0x7fb3840c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50756/0 (socket says 172.21.15.91:50756) 2023-12-13T22:26:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.976+0000 7fb38aa32640 1 -- 172.21.15.91:0/266961674 learned_addr learned my addr 172.21.15.91:0/266961674 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:55.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.980+0000 7fb38aa32640 1 -- 172.21.15.91:0/266961674 >> v2:172.21.15.152:3300/0 conn(0x7fb3840c5ab0 msgr2=0x7fb384159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:55.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.980+0000 7fb38aa32640 1 --2- 172.21.15.91:0/266961674 >> v2:172.21.15.152:3300/0 conn(0x7fb3840c5ab0 0x7fb384159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.980+0000 7fb38aa32640 1 -- 172.21.15.91:0/266961674 >> v1:172.21.15.152:6789/0 conn(0x7fb384153460 legacy=0x7fb3840c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:55.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.980+0000 7fb38aa32640 1 -- 172.21.15.91:0/266961674 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384153840 con 0x7fb3840c3320 2023-12-13T22:26:55.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.980+0000 7fb38aa32640 1 --2- 172.21.15.91:0/266961674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3840c3320 0x7fb3840c3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb3840c82f0 tx=0x7fb37c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b9baf4f45d48a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:55.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38922f640 1 -- 172.21.15.91:0/266961674 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0af400 con 0x7fb3840c3320 2023-12-13T22:26:55.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38922f640 1 -- 172.21.15.91:0/266961674 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c0ab050 con 0x7fb3840c3320 2023-12-13T22:26:55.985 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38922f640 1 -- 172.21.15.91:0/266961674 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0af780 con 0x7fb3840c3320 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- 172.21.15.91:0/266961674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3840c3320 msgr2=0x7fb3840c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- 172.21.15.91:0/266961674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3840c3320 0x7fb3840c3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb3840c82f0 tx=0x7fb37c01f180 comp rx=0 tx=0).stop 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- 172.21.15.91:0/266961674 shutdown_connections 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- 172.21.15.91:0/266961674 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb3840c3320 0x7fb3840c3750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- 172.21.15.91:0/266961674 >> v2:172.21.15.152:3300/0 conn(0x7fb3840c5ab0 0x7fb384159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- 172.21.15.91:0/266961674 >> 172.21.15.91:0/266961674 conn(0x7fb38406c6a0 msgr2=0x7fb38406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- 172.21.15.91:0/266961674 shutdown_connections 2023-12-13T22:26:55.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- 172.21.15.91:0/266961674 wait complete. 2023-12-13T22:26:55.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 Processor -- start 2023-12-13T22:26:55.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- start start 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb3840c3320 0x7fb384148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3840c5ab0 0x7fb3841427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841471f0 con 0x7fb384153460 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb384148890 con 0x7fb3840c5ab0 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38c495640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb384142ce0 con 0x7fb3840c3320 2023-12-13T22:26:55.988 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.988+0000 7fb38aa32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:55.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.992+0000 7fb38aa32640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50770/0 (socket says 172.21.15.91:50770) 2023-12-13T22:26:55.989 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.992+0000 7fb38aa32640 1 -- 172.21.15.91:0/4119880409 learned_addr learned my addr 172.21.15.91:0/4119880409 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:55.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 -- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb3840c3320 msgr2=0x7fb384148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb3840c3320 0x7fb384148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.993 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 -- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3840c5ab0 msgr2=0x7fb3841427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:55.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3840c5ab0 0x7fb3841427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:55.994 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 -- 172.21.15.91:0/4119880409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c009b30 con 0x7fb384153460 2023-12-13T22:26:55.996 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:55.996+0000 7fb38aa32640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb37c01cdb0 tx=0x7fb37c01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:56.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0afd60 con 0x7fb384153460 2023-12-13T22:26:56.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c0b9410 con 0x7fb384153460 2023-12-13T22:26:56.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38414a7a0 con 0x7fb384153460 2023-12-13T22:26:56.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0b97c0 con 0x7fb384153460 2023-12-13T22:26:56.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38415af50 con 0x7fb384153460 2023-12-13T22:26:56.002 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.004+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384070bd0 con 0x7fb384153460 2023-12-13T22:26:56.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.292+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb37c0b6050 con 0x7fb384153460 2023-12-13T22:26:56.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.292+0000 7fb37affd640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 0x7fb368068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.292+0000 7fb38a231640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 0x7fb368068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:56.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.296+0000 7fb38a231640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 0x7fb368068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb380009650 tx=0x7fb380006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:56.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.328+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb37c0f41e0 con 0x7fb384153460 2023-12-13T22:26:56.327 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.328+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb37c0efe20 con 0x7fb384153460 2023-12-13T22:26:56.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.496+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb384153b70 con 0x7fb384153460 2023-12-13T22:26:56.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb37affd640 1 -- 172.21.15.91:0/4119880409 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7fb384153b70 con 0x7fb384153460 2023-12-13T22:26:56.542 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:26:56.542 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 msgr2=0x7fb368068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 0x7fb368068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb380009650 tx=0x7fb380006bb0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 msgr2=0x7fb38415b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb37c01cdb0 tx=0x7fb37c01bf20 comp rx=0 tx=0).stop 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 shutdown_connections 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb368066840 0x7fb368068d00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb384153460 0x7fb38415b3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3840c5ab0 0x7fb3841427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 --2- 172.21.15.91:0/4119880409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb3840c3320 0x7fb384148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 >> 172.21.15.91:0/4119880409 conn(0x7fb38406c6a0 msgr2=0x7fb3841e2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:56.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 shutdown_connections 2023-12-13T22:26:56.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.544+0000 7fb38c495640 1 -- 172.21.15.91:0/4119880409 wait complete. 2023-12-13T22:26:56.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:26:56.562 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:26:56.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 Processor -- start 2023-12-13T22:26:56.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 -- start start 2023-12-13T22:26:56.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 0x7f43400c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f434006e530 0x7f434006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400c4350 con 0x7f43400c53d0 2023-12-13T22:26:56.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43401558c0 con 0x7f434006e530 2023-12-13T22:26:56.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.708+0000 7f4344a01640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400c4610 con 0x7f434014f950 2023-12-13T22:26:56.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.712+0000 7f433e59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 0x7f43400c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:56.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.712+0000 7f433e59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 0x7f43400c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:32802/0 (socket says 172.21.15.91:32802) 2023-12-13T22:26:56.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.712+0000 7f433e59c640 1 -- 172.21.15.91:0/1461549061 learned_addr learned my addr 172.21.15.91:0/1461549061 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:56.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.740+0000 7f433ed9d640 1 --2- 172.21.15.91:0/1461549061 >> v2:172.21.15.91:3300/0 conn(0x7f434006e530 0x7f434006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:56.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.748+0000 7f433ed9d640 1 -- 172.21.15.91:0/1461549061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 msgr2=0x7f43400c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:56.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.748+0000 7f433ed9d640 1 --2- 172.21.15.91:0/1461549061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 0x7f43400c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.748+0000 7f433ed9d640 1 -- 172.21.15.91:0/1461549061 >> v1:172.21.15.91:6789/0 conn(0x7f43400c53d0 legacy=0x7f43400c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.748+0000 7f433ed9d640 1 -- 172.21.15.91:0/1461549061 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340155b80 con 0x7f434006e530 2023-12-13T22:26:56.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.752+0000 7f433ed9d640 1 --2- 172.21.15.91:0/1461549061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f434006e530 0x7f434006e9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4338009c80 tx=0x7f4338020250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5555ea65a2977f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:56.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f433dd9b640 1 -- 172.21.15.91:0/1461549061 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380b0600 con 0x7f434006e530 2023-12-13T22:26:56.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f433dd9b640 1 -- 172.21.15.91:0/1461549061 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43380ac050 con 0x7f434006e530 2023-12-13T22:26:56.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f433dd9b640 1 -- 172.21.15.91:0/1461549061 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380b0980 con 0x7f434006e530 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- 172.21.15.91:0/1461549061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f434006e530 msgr2=0x7f434006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 --2- 172.21.15.91:0/1461549061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f434006e530 0x7f434006e9a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4338009c80 tx=0x7f4338020250 comp rx=0 tx=0).stop 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- 172.21.15.91:0/1461549061 shutdown_connections 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 --2- 172.21.15.91:0/1461549061 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f434006e530 0x7f434006e9a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 --2- 172.21.15.91:0/1461549061 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434014f950 0x7f43400c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- 172.21.15.91:0/1461549061 >> 172.21.15.91:0/1461549061 conn(0x7f434006c6a0 msgr2=0x7f434006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:56.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- 172.21.15.91:0/1461549061 shutdown_connections 2023-12-13T22:26:56.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- 172.21.15.91:0/1461549061 wait complete. 2023-12-13T22:26:56.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 Processor -- start 2023-12-13T22:26:56.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.760+0000 7f4344a01640 1 -- start start 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434006e530 0x7f43400723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f434014f950 0x7f43401efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400729e0 con 0x7f43400c53d0 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400c97c0 con 0x7f434014f950 2023-12-13T22:26:56.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4344a01640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400c9240 con 0x7f434006e530 2023-12-13T22:26:56.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4335d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:56.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4335d9b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50794/0 (socket says 172.21.15.91:50794) 2023-12-13T22:26:56.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.764+0000 7f4335d9b640 1 -- 172.21.15.91:0/1351932504 learned_addr learned my addr 172.21.15.91:0/1351932504 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:56.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 -- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434006e530 msgr2=0x7f43400723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434006e530 0x7f43400723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 -- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f434014f950 msgr2=0x7f43401efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:56.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f434014f950 0x7f43401efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:56.766 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 -- 172.21.15.91:0/1351932504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433800d040 con 0x7f43400c53d0 2023-12-13T22:26:56.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.768+0000 7f4335d9b640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f432800c420 tx=0x7f432800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:56.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.772+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280052d0 con 0x7f43400c53d0 2023-12-13T22:26:56.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.772+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328005430 con 0x7f43400c53d0 2023-12-13T22:26:56.771 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.772+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328007260 con 0x7f43400c53d0 2023-12-13T22:26:56.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.772+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43400c94e0 con 0x7f43400c53d0 2023-12-13T22:26:56.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.772+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43401ef530 con 0x7f43400c53d0 2023-12-13T22:26:56.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.776+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43401ef750 con 0x7f43400c53d0 2023-12-13T22:26:56.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.792+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f43280073c0 con 0x7f43400c53d0 2023-12-13T22:26:56.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.796+0000 7f43377fe640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 0x7f4324068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:56.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.796+0000 7f433e59c640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 0x7f4324068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:56.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:56.796+0000 7f433e59c640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 0x7f4324068d00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f433000b850 tx=0x7f4330008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:57.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.076+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4328007670 con 0x7f43400c53d0 2023-12-13T22:26:57.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.076+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4328050c80 con 0x7f43400c53d0 2023-12-13T22:26:57.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.236+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4340067520 con 0x7f43400c53d0 2023-12-13T22:26:57.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.248+0000 7f43377fe640 1 -- 172.21.15.91:0/1351932504 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4328020070 con 0x7f43400c53d0 2023-12-13T22:26:57.248 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 msgr2=0x7f4324068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 0x7f4324068d00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f433000b850 tx=0x7f4330008040 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 msgr2=0x7f43400ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f432800c420 tx=0x7f432800c8e0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 shutdown_connections 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4324066840 0x7f4324068d00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f434014f950 0x7f43401efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f43400c53d0 0x7f43400ca370 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 --2- 172.21.15.91:0/1351932504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f434006e530 0x7f43400723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 >> 172.21.15.91:0/1351932504 conn(0x7f434006c6a0 msgr2=0x7f434006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 shutdown_connections 2023-12-13T22:26:57.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.252+0000 7f4344a01640 1 -- 172.21.15.91:0/1351932504 wait complete. 2023-12-13T22:26:57.268 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:26:57.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.392+0000 7f5109222640 1 Processor -- start 2023-12-13T22:26:57.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.392+0000 7f5109222640 1 -- start start 2023-12-13T22:26:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f5109222640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51040c1ed0 0x7f510406e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f5109222640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5104070ab0 0x7f510406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f5109222640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51040c3b10 con 0x7f510414f850 2023-12-13T22:26:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f5109222640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040c46b0 con 0x7f5104070ab0 2023-12-13T22:26:57.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f5109222640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510414fc30 con 0x7f51040c1ed0 2023-12-13T22:26:57.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f510359e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5104070ab0 0x7f510406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f510359e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5104070ab0 0x7f510406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50800/0 (socket says 172.21.15.91:50800) 2023-12-13T22:26:57.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f510359e640 1 -- 172.21.15.91:0/1133517294 learned_addr learned my addr 172.21.15.91:0/1133517294 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:57.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.396+0000 7f50fa59c640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51040c1ed0 0x7f510406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.400+0000 7f510359e640 1 -- 172.21.15.91:0/1133517294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51040c1ed0 msgr2=0x7f510406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:57.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.400+0000 7f510359e640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51040c1ed0 0x7f510406e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.400+0000 7f510359e640 1 -- 172.21.15.91:0/1133517294 >> v1:172.21.15.91:6789/0 conn(0x7f510414f850 legacy=0x7f51040c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.400+0000 7f510359e640 1 -- 172.21.15.91:0/1133517294 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040c11e0 con 0x7f5104070ab0 2023-12-13T22:26:57.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.408+0000 7f510359e640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5104070ab0 0x7f510406ea70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009e50 tx=0x7f50fc01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc827c31c36f874 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:57.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f510259c640 1 -- 172.21.15.91:0/1133517294 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0a7ac0 con 0x7f5104070ab0 2023-12-13T22:26:57.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f510259c640 1 -- 172.21.15.91:0/1133517294 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0a7c20 con 0x7f5104070ab0 2023-12-13T22:26:57.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f510259c640 1 -- 172.21.15.91:0/1133517294 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0af3f0 con 0x7f5104070ab0 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- 172.21.15.91:0/1133517294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5104070ab0 msgr2=0x7f510406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5104070ab0 0x7f510406ea70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009e50 tx=0x7f50fc01ebf0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- 172.21.15.91:0/1133517294 shutdown_connections 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5104070ab0 0x7f510406ea70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- 172.21.15.91:0/1133517294 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51040c1ed0 0x7f510406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- 172.21.15.91:0/1133517294 >> 172.21.15.91:0/1133517294 conn(0x7f510406c6a0 msgr2=0x7f510406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- 172.21.15.91:0/1133517294 shutdown_connections 2023-12-13T22:26:57.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- 172.21.15.91:0/1133517294 wait complete. 2023-12-13T22:26:57.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 Processor -- start 2023-12-13T22:26:57.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- start start 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5104070ab0 0x7f51041f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51040c1ed0 0x7f5104140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51041467a0 con 0x7f510414f850 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510415e310 con 0x7f51040c1ed0 2023-12-13T22:26:57.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f5109222640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510415ee50 con 0x7f5104070ab0 2023-12-13T22:26:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.412+0000 7f510359e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50808/0 (socket says 172.21.15.91:50808) 2023-12-13T22:26:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 -- 172.21.15.91:0/1268001023 learned_addr learned my addr 172.21.15.91:0/1268001023 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f50fa59c640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51040c1ed0 0x7f5104140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f5102d9d640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5104070ab0 0x7f51041f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 -- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5104070ab0 msgr2=0x7f51041f37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5104070ab0 0x7f51041f37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 -- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51040c1ed0 msgr2=0x7f5104140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51040c1ed0 0x7f5104140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.416+0000 7f510359e640 1 -- 172.21.15.91:0/1268001023 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009b30 con 0x7f510414f850 2023-12-13T22:26:57.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.420+0000 7f510359e640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0b1040 tx=0x7f50fc01b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0a7ac0 con 0x7f510414f850 2023-12-13T22:26:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00e150 con 0x7f510414f850 2023-12-13T22:26:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc007cf0 con 0x7f510414f850 2023-12-13T22:26:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51041417a0 con 0x7f510414f850 2023-12-13T22:26:57.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510415e520 con 0x7f510414f850 2023-12-13T22:26:57.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.424+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510415efe0 con 0x7f510414f850 2023-12-13T22:26:57.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.444+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f50fc0af3f0 con 0x7f510414f850 2023-12-13T22:26:57.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.444+0000 7f50fbfff640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 0x7f50e4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:57.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.444+0000 7f5102d9d640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 0x7f50e4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:57.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.448+0000 7f5102d9d640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 0x7f50e4068cb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50f4001810 tx=0x7f50f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:57.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.448+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50fc0ef860 con 0x7f510414f850 2023-12-13T22:26:57.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.732+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f50fc0ebba0 con 0x7f510414f850 2023-12-13T22:26:57.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.896+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5104067520 con 0x7f510414f850 2023-12-13T22:26:57.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f50fbfff640 1 -- 172.21.15.91:0/1268001023 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50fc0be020 con 0x7f510414f850 2023-12-13T22:26:57.909 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:57.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 msgr2=0x7f50e4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 0x7f50e4068cb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50f4001810 tx=0x7f50f4009040 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 msgr2=0x7f5104141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0b1040 tx=0x7f50fc01b990 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 shutdown_connections 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50e40667f0 0x7f50e4068cb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f510414f850 0x7f5104141260 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51040c1ed0 0x7f5104140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 --2- 172.21.15.91:0/1268001023 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5104070ab0 0x7f51041f37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.912+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 >> 172.21.15.91:0/1268001023 conn(0x7f510406c6a0 msgr2=0x7f51040c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.916+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 shutdown_connections 2023-12-13T22:26:57.913 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:57.916+0000 7f5109222640 1 -- 172.21.15.91:0/1268001023 wait complete. 2023-12-13T22:26:57.931 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:26:58.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.056+0000 7fdb567bb640 1 Processor -- start 2023-12-13T22:26:58.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.056+0000 7fdb567bb640 1 -- start start 2023-12-13T22:26:58.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb567bb640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb50151720 0x7fdb5006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb567bb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5006f4a0 con 0x7fdb50151340 2023-12-13T22:26:58.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb567bb640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb50070be0 con 0x7fdb500c40e0 2023-12-13T22:26:58.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb567bb640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb50072570 con 0x7fdb50151720 2023-12-13T22:26:58.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb4ffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fdb50151340 0x7fdb50157c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37524/0 (socket says 172.21.15.91:37524) 2023-12-13T22:26:58.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb4ffff640 1 -- 172.21.15.91:0/831951635 learned_addr learned my addr 172.21.15.91:0/831951635 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:58.059 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.060+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/831951635 >> v2:172.21.15.152:3300/0 conn(0x7fdb50151720 0x7fdb5006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.064+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169180818 0 0) 0x7fdb5006f4a0 con 0x7fdb50151340 2023-12-13T22:26:58.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.064+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb38003530 con 0x7fdb50151340 2023-12-13T22:26:58.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3453435542 0 0) 0x7fdb38003530 con 0x7fdb50151340 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 >> v2:172.21.15.152:3300/0 conn(0x7fdb50151720 msgr2=0x7fdb5006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 --2- 172.21.15.91:0/831951635 >> v2:172.21.15.152:3300/0 conn(0x7fdb50151720 0x7fdb5006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 >> v1:172.21.15.152:6789/0 conn(0x7fdb500c40e0 legacy=0x7fdb500c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50070e80 con 0x7fdb50151340 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fdb40001a00 con 0x7fdb50151340 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 >> v1:172.21.15.91:6789/0 conn(0x7fdb50151340 legacy=0x7fdb50157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb380039f0 0x7fdb38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38005190 0x7fdb3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3800c090 con 0x7fdb380047d0 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3800c200 con 0x7fdb38005190 2023-12-13T22:26:58.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3800c3c0 con 0x7fdb380039f0 2023-12-13T22:26:58.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.068+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.072+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb380039f0 0x7fdb38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.072+0000 7fdb54d58640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38005190 0x7fdb3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 -- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb380039f0 msgr2=0x7fdb38003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb380039f0 0x7fdb38003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 -- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38005190 msgr2=0x7fdb3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb38005190 0x7fdb3800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb54d58640 1 -- 172.21.15.91:0/831951635 reap_dead start 2023-12-13T22:26:58.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 -- 172.21.15.91:0/831951635 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38003530 con 0x7fdb380047d0 2023-12-13T22:26:58.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.076+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb38004c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009ae0 tx=0x7fdb4401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac318a9c2042a2e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:58.079 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.080+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440a5640 con 0x7fdb380047d0 2023-12-13T22:26:58.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.080+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb440a57a0 con 0x7fdb380047d0 2023-12-13T22:26:58.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.080+0000 7fdb4effd640 1 -- 172.21.15.91:0/831951635 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440a5b50 con 0x7fdb380047d0 2023-12-13T22:26:58.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.080+0000 7fdb567bb640 1 -- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 msgr2=0x7fdb38004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.080+0000 7fdb567bb640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb38004c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009ae0 tx=0x7fdb4401ca50 comp rx=0 tx=0).stop 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- 172.21.15.91:0/831951635 shutdown_connections 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 --2- 172.21.15.91:0/831951635 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb38004c50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- 172.21.15.91:0/831951635 >> 172.21.15.91:0/831951635 conn(0x7fdb5006c6a0 msgr2=0x7fdb5006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- 172.21.15.91:0/831951635 shutdown_connections 2023-12-13T22:26:58.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- 172.21.15.91:0/831951635 wait complete. 2023-12-13T22:26:58.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 Processor -- start 2023-12-13T22:26:58.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- start start 2023-12-13T22:26:58.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb501526f0 0x7fdb50153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb50158390 0x7fdb50153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50153180 con 0x7fdb380047d0 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501efdd0 con 0x7fdb50158390 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb567bb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501f0070 con 0x7fdb501526f0 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50820/0 (socket says 172.21.15.91:50820) 2023-12-13T22:26:58.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.084+0000 7fdb4ffff640 1 -- 172.21.15.91:0/1414776110 learned_addr learned my addr 172.21.15.91:0/1414776110 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:58.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb501526f0 0x7fdb50153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4ffff640 1 -- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb501526f0 msgr2=0x7fdb50153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb501526f0 0x7fdb50153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4ffff640 1 -- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb50158390 msgr2=0x7fdb50153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb50158390 0x7fdb50153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.088 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.088+0000 7fdb4ffff640 1 -- 172.21.15.91:0/1414776110 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb501f0330 con 0x7fdb380047d0 2023-12-13T22:26:58.094 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.092+0000 7fdb4ffff640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb40004c00 tx=0x7fdb4000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:58.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.096+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000ede0 con 0x7fdb380047d0 2023-12-13T22:26:58.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.096+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400143a0 con 0x7fdb380047d0 2023-12-13T22:26:58.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.096+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40014750 con 0x7fdb380047d0 2023-12-13T22:26:58.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.096+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb501f0610 con 0x7fdb380047d0 2023-12-13T22:26:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.096+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb501f0bd0 con 0x7fdb380047d0 2023-12-13T22:26:58.097 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.100+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb500c6cb0 con 0x7fdb380047d0 2023-12-13T22:26:58.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.376+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdb400148b0 con 0x7fdb380047d0 2023-12-13T22:26:58.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.380+0000 7fdb4cff9640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 0x7fdb3c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.380+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 0x7fdb3c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.378 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.380+0000 7fdb4f7fe640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 0x7fdb3c068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb440046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:58.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.408+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb40058450 con 0x7fdb380047d0 2023-12-13T22:26:58.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.408+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdb40054790 con 0x7fdb380047d0 2023-12-13T22:26:58.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.568+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb50067520 con 0x7fdb380047d0 2023-12-13T22:26:58.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb4cff9640 1 -- 172.21.15.91:0/1414776110 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb4001b020 con 0x7fdb380047d0 2023-12-13T22:26:58.578 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 msgr2=0x7fdb3c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 0x7fdb3c068d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb440046d0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 msgr2=0x7fdb500c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb40004c00 tx=0x7fdb4000e4d0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 shutdown_connections 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdb3c066840 0x7fdb3c068d00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb50158390 0x7fdb50153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb501526f0 0x7fdb50153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 --2- 172.21.15.91:0/1414776110 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdb380047d0 0x7fdb500c6370 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 >> 172.21.15.91:0/1414776110 conn(0x7fdb5006c6a0 msgr2=0x7fdb500c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:58.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 shutdown_connections 2023-12-13T22:26:58.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.580+0000 7fdb567bb640 1 -- 172.21.15.91:0/1414776110 wait complete. 2023-12-13T22:26:58.598 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:26:58.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 Processor -- start 2023-12-13T22:26:58.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 -- start start 2023-12-13T22:26:58.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 0x7f64cc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc15a4a0 con 0x7f64cc15c1c0 2023-12-13T22:26:58.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc06d560 con 0x7f64cc15c5a0 2023-12-13T22:26:58.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d3a4b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc06cc00 con 0x7f64cc15b620 2023-12-13T22:26:58.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d17e7640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f64cc15c1c0 0x7f64cc15af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:37536/0 (socket says 172.21.15.91:37536) 2023-12-13T22:26:58.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d17e7640 1 -- 172.21.15.91:0/3867331126 learned_addr learned my addr 172.21.15.91:0/3867331126 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:26:58.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.724+0000 7f64d1fe8640 1 --2- 172.21.15.91:0/3867331126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 0x7f64cc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.728+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309603166 0 0) 0x7f64c8001120 con 0x7f64cc15c1c0 2023-12-13T22:26:58.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.728+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b8003530 con 0x7f64cc15c1c0 2023-12-13T22:26:58.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.732+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669283363 0 0) 0x7f64cc06d560 con 0x7f64cc15c5a0 2023-12-13T22:26:58.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.732+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c8001120 con 0x7f64cc15c5a0 2023-12-13T22:26:58.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.732+0000 7f64d1fe8640 1 -- 172.21.15.91:0/3867331126 >> v1:172.21.15.152:6789/0 conn(0x7f64cc15c5a0 legacy=0x7f64cc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.732+0000 7f64d1fe8640 1 -- 172.21.15.91:0/3867331126 >> v1:172.21.15.91:6789/0 conn(0x7f64cc15c1c0 legacy=0x7f64cc15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.732+0000 7f64d1fe8640 1 -- 172.21.15.91:0/3867331126 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc06c680 con 0x7f64cc15b620 2023-12-13T22:26:58.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.740+0000 7f64d1fe8640 1 --2- 172.21.15.91:0/3867331126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 0x7f64cc159f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009dc0 tx=0x7f64c401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93bf300f8ade3613 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40a5a00 con 0x7f64cc15b620 2023-12-13T22:26:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40a5b60 con 0x7f64cc15b620 2023-12-13T22:26:58.747 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64c3fff640 1 -- 172.21.15.91:0/3867331126 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40ad440 con 0x7f64cc15b620 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 -- 172.21.15.91:0/3867331126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 msgr2=0x7f64cc159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/3867331126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 0x7f64cc159f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009dc0 tx=0x7f64c401c940 comp rx=0 tx=0).stop 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 -- 172.21.15.91:0/3867331126 shutdown_connections 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/3867331126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15b620 0x7f64cc159f60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 -- 172.21.15.91:0/3867331126 >> 172.21.15.91:0/3867331126 conn(0x7f64cc060fd0 msgr2=0x7f64cc0613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 -- 172.21.15.91:0/3867331126 shutdown_connections 2023-12-13T22:26:58.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.748+0000 7f64d3a4b640 1 -- 172.21.15.91:0/3867331126 wait complete. 2023-12-13T22:26:58.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 Processor -- start 2023-12-13T22:26:58.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 -- start start 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc15b620 0x7f64cc147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15c5a0 0x7f64cc0c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc150480 con 0x7f64cc15c1c0 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0ce390 con 0x7f64cc15b620 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d3a4b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1f2a30 con 0x7f64cc15c5a0 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d0fe6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d0fe6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50826/0 (socket says 172.21.15.91:50826) 2023-12-13T22:26:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d0fe6640 1 -- 172.21.15.91:0/2591740877 learned_addr learned my addr 172.21.15.91:0/2591740877 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d17e7640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc15b620 0x7f64cc147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.752+0000 7f64d1fe8640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15c5a0 0x7f64cc0c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:58.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.756+0000 7f64d0fe6640 1 -- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15c5a0 msgr2=0x7f64cc0c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.756+0000 7f64d0fe6640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15c5a0 0x7f64cc0c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.756+0000 7f64d0fe6640 1 -- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc15b620 msgr2=0x7f64cc147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:58.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.756+0000 7f64d0fe6640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc15b620 0x7f64cc147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:58.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.756+0000 7f64d0fe6640 1 -- 172.21.15.91:0/2591740877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4009a70 con 0x7f64cc15c1c0 2023-12-13T22:26:58.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.760+0000 7f64d0fe6640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c530 tx=0x7f64bc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:58.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0052d0 con 0x7f64cc15c1c0 2023-12-13T22:26:58.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc005450 con 0x7f64cc15c1c0 2023-12-13T22:26:58.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc1f2d10 con 0x7f64cc15c1c0 2023-12-13T22:26:58.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc012870 con 0x7f64cc15c1c0 2023-12-13T22:26:58.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc1501a0 con 0x7f64cc15c1c0 2023-12-13T22:26:58.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:58.764+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0728b0 con 0x7f64cc15c1c0 2023-12-13T22:26:59.041 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.044+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f64bc0129d0 con 0x7f64cc15c1c0 2023-12-13T22:26:59.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.044+0000 7f64c1ffb640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 0x7f64b0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.043 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.044+0000 7f64d17e7640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 0x7f64b0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.044 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.044+0000 7f64d17e7640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 0x7f64b0068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64c8001380 tx=0x7f64c8007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:59.081 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.084+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64bc055620 con 0x7f64cc15c1c0 2023-12-13T22:26:59.087 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.088+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f64bc051960 con 0x7f64cc15c1c0 2023-12-13T22:26:59.231 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:26:59.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:26:59.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.256+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64cc067d50 con 0x7f64cc15c1c0 2023-12-13T22:26:59.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64c1ffb640 1 -- 172.21.15.91:0/2591740877 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f64bc054f80 con 0x7f64cc15c1c0 2023-12-13T22:26:59.261 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:26:59.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 msgr2=0x7f64b0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:59.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 0x7f64b0068d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64c8001380 tx=0x7f64c8007d40 comp rx=0 tx=0).stop 2023-12-13T22:26:59.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 msgr2=0x7f64cc0c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c530 tx=0x7f64bc00c9f0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 shutdown_connections 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f64b0066840 0x7f64b0068d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc15c5a0 0x7f64cc0c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f64cc15c1c0 0x7f64cc0c38c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 --2- 172.21.15.91:0/2591740877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc15b620 0x7f64cc147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 >> 172.21.15.91:0/2591740877 conn(0x7f64cc060fd0 msgr2=0x7f64cc158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 shutdown_connections 2023-12-13T22:26:59.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.264+0000 7f64d3a4b640 1 -- 172.21.15.91:0/2591740877 wait complete. 2023-12-13T22:26:59.280 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:26:59.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.448+0000 7f50d3989640 1 Processor -- start 2023-12-13T22:26:59.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.448+0000 7f50d3989640 1 -- start start 2023-12-13T22:26:59.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50cc0cc3c0 0x7f50cc159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 0x7f50cc15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0ca550 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0ce9e0 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d3989640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0cd9a0 con 0x7f50cc0cdb70 2023-12-13T22:26:59.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d1725640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d1f26640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 0x7f50cc15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d0f24640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f50cc0cc3c0 0x7f50cc159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d1725640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:45842/0 (socket says 172.21.15.91:45842) 2023-12-13T22:26:59.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.452+0000 7f50d1725640 1 -- 172.21.15.91:0/878792014 learned_addr learned my addr 172.21.15.91:0/878792014 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1725640 1 -- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 msgr2=0x7f50cc15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1725640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 0x7f50cc15a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1725640 1 -- 172.21.15.91:0/878792014 >> v2:172.21.15.91:3300/0 conn(0x7f50cc0cc3c0 msgr2=0x7f50cc159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1725640 1 --2- 172.21.15.91:0/878792014 >> v2:172.21.15.91:3300/0 conn(0x7f50cc0cc3c0 0x7f50cc159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1725640 1 -- 172.21.15.91:0/878792014 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc1596c0 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.460+0000 7f50d1f26640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 0x7f50cc15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T22:26:59.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.472+0000 7f50d1725640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50cc06b830 tx=0x7f50c801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bca2a8f9c4cf02 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:59.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50c3fff640 1 -- 172.21.15.91:0/878792014 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80a5870 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50c3fff640 1 -- 172.21.15.91:0/878792014 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c80a59d0 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.489 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50c3fff640 1 -- 172.21.15.91:0/878792014 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80a5d60 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0ce0c0 msgr2=0x7f50cc0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:59.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50cc06b830 tx=0x7f50c801c9d0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- 172.21.15.91:0/878792014 shutdown_connections 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0cdb70 0x7f50cc15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 --2- 172.21.15.91:0/878792014 >> v2:172.21.15.91:3300/0 conn(0x7f50cc0cc3c0 0x7f50cc159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 --2- 172.21.15.91:0/878792014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0ce0c0 0x7f50cc0ce4a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- 172.21.15.91:0/878792014 >> 172.21.15.91:0/878792014 conn(0x7f50cc0b07c0 msgr2=0x7f50cc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- 172.21.15.91:0/878792014 shutdown_connections 2023-12-13T22:26:59.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- 172.21.15.91:0/878792014 wait complete. 2023-12-13T22:26:59.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 Processor -- start 2023-12-13T22:26:59.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.492+0000 7f50d3989640 1 -- start start 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50cc0cdb70 0x7f50cc14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0ce0c0 0x7f50cc0bd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc158790 con 0x7f50cc0cdb70 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0bd0e0 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.494 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d3989640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc14ba90 con 0x7f50cc0ce0c0 2023-12-13T22:26:59.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d1725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d1f26640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0ce0c0 0x7f50cc0bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d1725640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:45854/0 (socket says 172.21.15.91:45854) 2023-12-13T22:26:59.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.496+0000 7f50d1725640 1 -- 172.21.15.91:0/3321754161 learned_addr learned my addr 172.21.15.91:0/3321754161 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:26:59.505 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.508+0000 7f50d1725640 1 -- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0ce0c0 msgr2=0x7f50cc0bd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:59.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.508+0000 7f50d1725640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0ce0c0 0x7f50cc0bd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.508+0000 7f50d1725640 1 -- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50cc0cdb70 msgr2=0x7f50cc14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:26:59.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.508+0000 7f50d1725640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50cc0cdb70 0x7f50cc14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:26:59.506 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.508+0000 7f50d1725640 1 -- 172.21.15.91:0/3321754161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009420 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.512+0000 7f50d1725640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50c80af040 tx=0x7f50c8019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:59.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.520+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80b8670 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.524+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c80b87d0 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.524+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c80b8b80 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.524+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8009b30 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.524+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc157b40 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.522 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.524+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc067520 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.848+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f50c80b8ce0 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.848+0000 7f50c1ffb640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 0x7f50b0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:26:59.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.848+0000 7f50d0f24640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 0x7f50b0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:26:59.848 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.852+0000 7f50d0f24640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 0x7f50b0068d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f50cc151c00 tx=0x7f50bc009520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:26:59.851 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.852+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50c80f0d60 con 0x7f50cc0cc3c0 2023-12-13T22:26:59.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:26:59.944+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f50c80ec9a0 con 0x7f50cc0cc3c0 2023-12-13T22:27:00.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.216+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50cc157b40 con 0x7f50cc0cc3c0 2023-12-13T22:27:00.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.288+0000 7f50c1ffb640 1 -- 172.21.15.91:0/3321754161 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6527 (secure 0 0 0) 0x7f50cc157b40 con 0x7f50cc0cc3c0 2023-12-13T22:27:00.287 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:27:00.287 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:41.869732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:27:00.287 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 15 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 msgr2=0x7f50b0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 0x7f50b0068d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f50cc151c00 tx=0x7f50bc009520 comp rx=0 tx=0).stop 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 msgr2=0x7f50cc14c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50c80af040 tx=0x7f50c8019770 comp rx=0 tx=0).stop 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 shutdown_connections 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50b0066840 0x7f50b0068d00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50cc0ce0c0 0x7f50cc0bd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f50cc0cdb70 0x7f50cc14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 --2- 172.21.15.91:0/3321754161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50cc0cc3c0 0x7f50cc14c4f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 >> 172.21.15.91:0/3321754161 conn(0x7f50cc0b07c0 msgr2=0x7f50cc0c1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:00.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 shutdown_connections 2023-12-13T22:27:00.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.292+0000 7f50d3989640 1 -- 172.21.15.91:0/3321754161 wait complete. 2023-12-13T22:27:00.309 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:27:00.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 Processor -- start 2023-12-13T22:27:00.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 -- start start 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f99641533e0 0x7f99640cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9964072780 0x7f99640cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996415cbf0 0x7f996415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996415a300 con 0x7f9964072780 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996415d5c0 con 0x7f99641533e0 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f996b512640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99641537c0 con 0x7f996415cbf0 2023-12-13T22:27:00.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f9968aad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9964072780 0x7f99640cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f9968aad640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9964072780 0x7f99640cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41178/0 (socket says 172.21.15.91:41178) 2023-12-13T22:27:00.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f9968aad640 1 -- 172.21.15.91:0/1305690564 learned_addr learned my addr 172.21.15.91:0/1305690564 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:00.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f99692ae640 1 --2- 172.21.15.91:0/1305690564 >> v2:172.21.15.152:3300/0 conn(0x7f99641533e0 0x7f99640cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.440+0000 7f9969aaf640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996415cbf0 0x7f996415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.444+0000 7f9968aad640 1 -- 172.21.15.91:0/1305690564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996415cbf0 msgr2=0x7f996415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:00.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.444+0000 7f9968aad640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996415cbf0 0x7f996415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.444+0000 7f9968aad640 1 -- 172.21.15.91:0/1305690564 >> v2:172.21.15.152:3300/0 conn(0x7f99641533e0 msgr2=0x7f99640cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:00.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.444+0000 7f9968aad640 1 --2- 172.21.15.91:0/1305690564 >> v2:172.21.15.152:3300/0 conn(0x7f99641533e0 0x7f99640cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.444+0000 7f9968aad640 1 -- 172.21.15.91:0/1305690564 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964159430 con 0x7f9964072780 2023-12-13T22:27:00.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.448+0000 7f9968aad640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9964072780 0x7f99640cc540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f996406c520 tx=0x7f995401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28462336084b7c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:00.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f995bfff640 1 -- 172.21.15.91:0/1305690564 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540ac410 con 0x7f9964072780 2023-12-13T22:27:00.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f995bfff640 1 -- 172.21.15.91:0/1305690564 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99540ac570 con 0x7f9964072780 2023-12-13T22:27:00.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f995bfff640 1 -- 172.21.15.91:0/1305690564 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540ac900 con 0x7f9964072780 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 -- 172.21.15.91:0/1305690564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9964072780 msgr2=0x7f99640cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9964072780 0x7f99640cc540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f996406c520 tx=0x7f995401c500 comp rx=0 tx=0).stop 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 -- 172.21.15.91:0/1305690564 shutdown_connections 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996415cbf0 0x7f996415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 --2- 172.21.15.91:0/1305690564 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9964072780 0x7f99640cc540 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 --2- 172.21.15.91:0/1305690564 >> v2:172.21.15.152:3300/0 conn(0x7f99641533e0 0x7f99640cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 -- 172.21.15.91:0/1305690564 >> 172.21.15.91:0/1305690564 conn(0x7f996406b670 msgr2=0x7f996406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 -- 172.21.15.91:0/1305690564 shutdown_connections 2023-12-13T22:27:00.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.452+0000 7f996b512640 1 -- 172.21.15.91:0/1305690564 wait complete. 2023-12-13T22:27:00.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 Processor -- start 2023-12-13T22:27:00.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 -- start start 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964072780 0x7f996415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99641533e0 0x7f9964148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99641505a0 con 0x7f996415cbf0 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640c8d40 con 0x7f9964072780 2023-12-13T22:27:00.455 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f996b512640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9964147ea0 con 0x7f99641533e0 2023-12-13T22:27:00.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f9969aaf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f9969aaf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41184/0 (socket says 172.21.15.91:41184) 2023-12-13T22:27:00.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f9969aaf640 1 -- 172.21.15.91:0/4266139714 learned_addr learned my addr 172.21.15.91:0/4266139714 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:00.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f99692ae640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964072780 0x7f996415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.456+0000 7f9968aad640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99641533e0 0x7f9964148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 -- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99641533e0 msgr2=0x7f9964148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:00.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99641533e0 0x7f9964148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 -- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964072780 msgr2=0x7f996415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:00.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964072780 0x7f996415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:00.461 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 -- 172.21.15.91:0/4266139714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540094d0 con 0x7f996415cbf0 2023-12-13T22:27:00.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.464+0000 7f9969aaf640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f995c007e60 tx=0x7f995c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:00.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.468+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c014420 con 0x7f996415cbf0 2023-12-13T22:27:00.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.468+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c0145a0 con 0x7f996415cbf0 2023-12-13T22:27:00.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.468+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99641f5a00 con 0x7f996415cbf0 2023-12-13T22:27:00.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.468+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c014950 con 0x7f996415cbf0 2023-12-13T22:27:00.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.468+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9964147850 con 0x7f996415cbf0 2023-12-13T22:27:00.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.472+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9964073e70 con 0x7f996415cbf0 2023-12-13T22:27:00.750 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.752+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f995c014ab0 con 0x7f996415cbf0 2023-12-13T22:27:00.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.752+0000 7f9959ffb640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 0x7f9948068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:00.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.752+0000 7f99692ae640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 0x7f9948068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:00.751 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.752+0000 7f99692ae640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 0x7f9948068d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9960009b60 tx=0x7f9960009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:00.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.780+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f995c0567a0 con 0x7f996415cbf0 2023-12-13T22:27:00.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.780+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f995c052ae0 con 0x7f996415cbf0 2023-12-13T22:27:00.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:00.960+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9964071d50 con 0x7f996415cbf0 2023-12-13T22:27:01.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.008+0000 7f9959ffb640 1 -- 172.21.15.91:0/4266139714 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18323 (secure 0 0 0) 0x7f995c056100 con 0x7f996415cbf0 2023-12-13T22:27:01.009 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:27:01.009 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":29,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:26:07.812669+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:27:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 msgr2=0x7f9948068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 0x7f9948068d00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9960009b60 tx=0x7f9960009190 comp rx=0 tx=0).stop 2023-12-13T22:27:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 msgr2=0x7f9964149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f995c007e60 tx=0x7f995c00e4b0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.011 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 shutdown_connections 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9948066840 0x7f9948068d00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f996415cbf0 0x7f9964149200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99641533e0 0x7f9964148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 --2- 172.21.15.91:0/4266139714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964072780 0x7f996415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 >> 172.21.15.91:0/4266139714 conn(0x7f996406b670 msgr2=0x7f99640c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 shutdown_connections 2023-12-13T22:27:01.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.012+0000 7f996b512640 1 -- 172.21.15.91:0/4266139714 wait complete. 2023-12-13T22:27:01.029 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:27:01.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.148+0000 7fec02eb1640 1 Processor -- start 2023-12-13T22:27:01.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec02eb1640 1 -- start start 2023-12-13T22:27:01.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec02eb1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7febfc06b2e0 0x7febfc0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:01.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec02eb1640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0c6860 con 0x7febfc15d690 2023-12-13T22:27:01.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec02eb1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc0616b0 con 0x7febfc1535c0 2023-12-13T22:27:01.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec02eb1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc1539a0 con 0x7febfc06b2e0 2023-12-13T22:27:01.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec00c4d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7febfc1535c0 0x7febfc159420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:56748/0 (socket says 172.21.15.91:56748) 2023-12-13T22:27:01.151 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.152+0000 7fec00c4d640 1 -- 172.21.15.91:0/713099549 learned_addr learned my addr 172.21.15.91:0/713099549 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:27:01.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.228+0000 7fec0144e640 1 --2- 172.21.15.91:0/713099549 >> v2:172.21.15.91:3300/0 conn(0x7febfc06b2e0 0x7febfc0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:01.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.252+0000 7fec0144e640 1 -- 172.21.15.91:0/713099549 >> v1:172.21.15.152:6789/0 conn(0x7febfc1535c0 legacy=0x7febfc159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.252+0000 7fec0144e640 1 -- 172.21.15.91:0/713099549 >> v1:172.21.15.91:6789/0 conn(0x7febfc15d690 legacy=0x7febfc0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.252+0000 7fec0144e640 1 -- 172.21.15.91:0/713099549 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc159eb0 con 0x7febfc06b2e0 2023-12-13T22:27:01.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.292+0000 7fec0144e640 1 --2- 172.21.15.91:0/713099549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc06b2e0 0x7febfc0c6320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e74a7a644bfa server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:01.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7febfb7fe640 1 -- 172.21.15.91:0/713099549 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40a59e0 con 0x7febfc06b2e0 2023-12-13T22:27:01.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7febfb7fe640 1 -- 172.21.15.91:0/713099549 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40a5b40 con 0x7febfc06b2e0 2023-12-13T22:27:01.302 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7febfb7fe640 1 -- 172.21.15.91:0/713099549 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40ad440 con 0x7febfc06b2e0 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 -- 172.21.15.91:0/713099549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc06b2e0 msgr2=0x7febfc0c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 --2- 172.21.15.91:0/713099549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc06b2e0 0x7febfc0c6320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7febf4009d90 tx=0x7febf401c920 comp rx=0 tx=0).stop 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 -- 172.21.15.91:0/713099549 shutdown_connections 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 --2- 172.21.15.91:0/713099549 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc06b2e0 0x7febfc0c6320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 -- 172.21.15.91:0/713099549 >> 172.21.15.91:0/713099549 conn(0x7febfc06d220 msgr2=0x7febfc06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 -- 172.21.15.91:0/713099549 shutdown_connections 2023-12-13T22:27:01.303 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.304+0000 7fec02eb1640 1 -- 172.21.15.91:0/713099549 wait complete. 2023-12-13T22:27:01.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 Processor -- start 2023-12-13T22:27:01.304 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 -- start start 2023-12-13T22:27:01.305 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febfc06b2e0 0x7febfc155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febfc1535c0 0x7febfc1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc15a450 con 0x7febfc15d690 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc14c4a0 con 0x7febfc06b2e0 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec02eb1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1f2220 con 0x7febfc1535c0 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec0144e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:01.306 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec0144e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41200/0 (socket says 172.21.15.91:41200) 2023-12-13T22:27:01.307 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.308+0000 7fec0144e640 1 -- 172.21.15.91:0/1409626953 learned_addr learned my addr 172.21.15.91:0/1409626953 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:01.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.312+0000 7fec0144e640 1 -- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febfc1535c0 msgr2=0x7febfc1f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.312+0000 7fec0144e640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febfc1535c0 0x7febfc1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.312+0000 7fec0144e640 1 -- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febfc06b2e0 msgr2=0x7febfc155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.312+0000 7fec0144e640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febfc06b2e0 0x7febfc155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.312+0000 7fec0144e640 1 -- 172.21.15.91:0/1409626953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009a70 con 0x7febfc15d690 2023-12-13T22:27:01.315 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.316+0000 7fec0144e640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7febf401a550 tx=0x7febf40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:01.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40aed90 con 0x7febfc15d690 2023-12-13T22:27:01.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40b7410 con 0x7febfc15d690 2023-12-13T22:27:01.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc153d10 con 0x7febfc15d690 2023-12-13T22:27:01.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40b77c0 con 0x7febfc15d690 2023-12-13T22:27:01.319 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc153f60 con 0x7febfc15d690 2023-12-13T22:27:01.320 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.320+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc073e70 con 0x7febfc15d690 2023-12-13T22:27:01.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.340+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7febf40b4050 con 0x7febfc15d690 2023-12-13T22:27:01.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.344+0000 7febf97fa640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 0x7febe0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:01.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.344+0000 7fec00c4d640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 0x7febe0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:01.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.344+0000 7fec00c4d640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 0x7febe0068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febf0001560 tx=0x7febf0007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:01.342 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.344+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febf40f0f50 con 0x7febfc15d690 2023-12-13T22:27:01.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.620+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7febf40ecbd0 con 0x7febfc15d690 2023-12-13T22:27:01.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.828+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febfc06b0c0 con 0x7febfc15d690 2023-12-13T22:27:01.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.952+0000 7febf97fa640 1 -- 172.21.15.91:0/1409626953 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6527 (secure 0 0 0) 0x7febf40c7090 con 0x7febfc15d690 2023-12-13T22:27:01.953 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:27:01.953 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:26:41.869732+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:27:01.953 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 15 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 msgr2=0x7febe0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 0x7febe0068d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febf0001560 tx=0x7febf0007a50 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 msgr2=0x7febfc1f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7febf401a550 tx=0x7febf40196c0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 shutdown_connections 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7febe0066840 0x7febe0068d00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7febfc15d690 0x7febfc1f2640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febfc1535c0 0x7febfc1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 --2- 172.21.15.91:0/1409626953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febfc06b2e0 0x7febfc155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:01.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 >> 172.21.15.91:0/1409626953 conn(0x7febfc06d220 msgr2=0x7febfc150160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:01.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 shutdown_connections 2023-12-13T22:27:01.958 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:01.960+0000 7fec02eb1640 1 -- 172.21.15.91:0/1409626953 wait complete. 2023-12-13T22:27:02.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-13T22:25:58.517400+0000', 'modified': '2023-12-13T22:26:41.869732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4258, 'mds_1': 4255, 'mds_2': 4226}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4226': {'gid': 4226, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.91:6837/757899957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.91:6836', 'nonce': 757899957}, {'type': 'v1', 'addr': '172.21.15.91:6837', 'nonce': 757899957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4255': {'gid': 4255, 'name': 'b', 'rank': 1, 'incarnation': 11, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.152:6833/1277096500', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 1277096500}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 1277096500}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4258': {'gid': 4258, 'name': 'f', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.152:6835/3409704443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 3409704443}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 3409704443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-13T22:27:02.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-13T22:27:02.584 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-12-13T22:27:02.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 Processor -- start 2023-12-13T22:27:02.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 -- start start 2023-12-13T22:27:02.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4e0c1513c0 0x7f4e0c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e0c06ad60 0x7f4e0c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c072400 con 0x7f4e0c072890 2023-12-13T22:27:02.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c157cc0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.715 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.716+0000 7f4e114d1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c157fa0 con 0x7f4e0c1513c0 2023-12-13T22:27:02.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.720+0000 7f4e0b7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4e0c072890 0x7f4e0c0c5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:56756/0 (socket says 172.21.15.91:56756) 2023-12-13T22:27:02.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.720+0000 7f4e0b7fe640 1 -- 172.21.15.91:0/2907151302 learned_addr learned my addr 172.21.15.91:0/2907151302 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:27:02.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.720+0000 7f4e0affd640 1 --2- 172.21.15.91:0/2907151302 >> v2:172.21.15.152:3300/0 conn(0x7f4e0c1513c0 0x7f4e0c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.732+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/2907151302 >> v2:172.21.15.91:3300/0 conn(0x7f4e0c06ad60 0x7f4e0c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.740+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/2907151302 >> v2:172.21.15.152:3300/0 conn(0x7f4e0c1513c0 msgr2=0x7f4e0c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:02.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.740+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/2907151302 >> v2:172.21.15.152:3300/0 conn(0x7f4e0c1513c0 0x7f4e0c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.740+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/2907151302 >> v1:172.21.15.152:6789/0 conn(0x7f4e0c072890 legacy=0x7f4e0c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:02.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.740+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/2907151302 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c071db0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.828+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/2907151302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1571c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c06b640 tx=0x7f4dfc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7239836a764fca server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:02.836 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.836+0000 7f4e09ffb640 1 -- 172.21.15.91:0/2907151302 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0a8950 con 0x7f4e0c06ad60 2023-12-13T22:27:02.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e09ffb640 1 -- 172.21.15.91:0/2907151302 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0a8ab0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e09ffb640 1 -- 172.21.15.91:0/2907151302 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0a8e40 con 0x7f4e0c06ad60 2023-12-13T22:27:02.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 -- 172.21.15.91:0/2907151302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 msgr2=0x7f4e0c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:02.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 --2- 172.21.15.91:0/2907151302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1571c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c06b640 tx=0x7f4dfc01ec50 comp rx=0 tx=0).stop 2023-12-13T22:27:02.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 -- 172.21.15.91:0/2907151302 shutdown_connections 2023-12-13T22:27:02.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 --2- 172.21.15.91:0/2907151302 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1571c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 --2- 172.21.15.91:0/2907151302 >> v2:172.21.15.152:3300/0 conn(0x7f4e0c1513c0 0x7f4e0c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 -- 172.21.15.91:0/2907151302 >> 172.21.15.91:0/2907151302 conn(0x7f4e0c06b670 msgr2=0x7f4e0c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:02.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 -- 172.21.15.91:0/2907151302 shutdown_connections 2023-12-13T22:27:02.839 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.840+0000 7f4e114d1640 1 -- 172.21.15.91:0/2907151302 wait complete. 2023-12-13T22:27:02.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.844+0000 7f4e114d1640 1 Processor -- start 2023-12-13T22:27:02.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.844+0000 7f4e114d1640 1 -- start start 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e0c072890 0x7f4e0c1ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e0c1513c0 0x7f4e0c1462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c14c6b0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c1ecad0 con 0x7f4e0c1513c0 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e114d1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c1f0b80 con 0x7f4e0c072890 2023-12-13T22:27:02.845 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e0affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e0affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41222/0 (socket says 172.21.15.91:41222) 2023-12-13T22:27:02.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.848+0000 7f4e0affd640 1 -- 172.21.15.91:0/3615908094 learned_addr learned my addr 172.21.15.91:0/3615908094 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.856+0000 7f4e0affd640 1 -- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e0c072890 msgr2=0x7f4e0c1ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.856+0000 7f4e0affd640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e0c072890 0x7f4e0c1ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.856+0000 7f4e0affd640 1 -- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e0c1513c0 msgr2=0x7f4e0c1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.856+0000 7f4e0affd640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e0c1513c0 0x7f4e0c1462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.855 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.856+0000 7f4e0affd640 1 -- 172.21.15.91:0/3615908094 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009420 con 0x7f4e0c06ad60 2023-12-13T22:27:02.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.864+0000 7f4e0affd640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400efc0 tx=0x7f4e0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:02.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.868+0000 7f4df37fe640 1 -- 172.21.15.91:0/3615908094 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04014480 con 0x7f4e0c06ad60 2023-12-13T22:27:02.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.868+0000 7f4df37fe640 1 -- 172.21.15.91:0/3615908094 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400f040 con 0x7f4e0c06ad60 2023-12-13T22:27:02.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.868+0000 7f4df37fe640 1 -- 172.21.15.91:0/3615908094 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04014800 con 0x7f4e0c06ad60 2023-12-13T22:27:02.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.868+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c158420 con 0x7f4e0c06ad60 2023-12-13T22:27:02.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.868+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c1589e0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 Processor -- start 2023-12-13T22:27:02.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 -- start start 2023-12-13T22:27:02.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f250a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f250ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f234c250 con 0x5609f250a920 2023-12-13T22:27:02.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2339d60 con 0x5609f250a000 2023-12-13T22:27:02.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.872+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f2337290 con 0x5609f250b240 2023-12-13T22:27:02.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.880+0000 7f4e0a7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.888+0000 7f4e0a7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:44902/0 (socket says 172.21.15.91:44902) 2023-12-13T22:27:02.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.888+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4029978884 learned_addr learned my addr 172.21.15.91:0/4029978884 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:02.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.888+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f250a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.892+0000 7f4df37fe640 1 -- 172.21.15.91:0/3615908094 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4e04014960 con 0x7f4e0c06ad60 2023-12-13T22:27:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.892+0000 7f4df37fe640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 0x7f4df8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.892+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 0x7f4df8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.891 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.892+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 0x7f4df8068d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001960 tx=0x7f4e00007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:02.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.896+0000 7f4df37fe640 1 -- 172.21.15.91:0/3615908094 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e040583e0 con 0x7f4e0c06ad60 2023-12-13T22:27:02.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.896+0000 7f4e0affd640 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f250ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.900+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 msgr2=0x5609f250a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:02.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.900+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f250a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.900+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4029978884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 msgr2=0x5609f250ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:02.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.900+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f250ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.900+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4029978884 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f202a890 con 0x5609f250b240 2023-12-13T22:27:02.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.908+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc01c880 tx=0x7f4dfc0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cada4820d6051d1b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:02.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4df0ff9640 1 -- 172.21.15.91:0/4029978884 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b0440 con 0x5609f250b240 2023-12-13T22:27:02.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4df0ff9640 1 -- 172.21.15.91:0/4029978884 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0b05a0 con 0x5609f250b240 2023-12-13T22:27:02.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4df0ff9640 1 -- 172.21.15.91:0/4029978884 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b0930 con 0x5609f250b240 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 msgr2=0x5609f250b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc01c880 tx=0x7f4dfc0046d0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- 172.21.15.91:0/4029978884 shutdown_connections 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f250b620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f250ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.923 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 --2- 172.21.15.91:0/4029978884 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f250a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- 172.21.15.91:0/4029978884 >> 172.21.15.91:0/4029978884 conn(0x5609f251f1c0 msgr2=0x5609f25215b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:02.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- 172.21.15.91:0/4029978884 shutdown_connections 2023-12-13T22:27:02.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- 172.21.15.91:0/4029978884 wait complete. 2023-12-13T22:27:02.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 -- start start 2023-12-13T22:27:02.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.924+0000 7f4e14601000 1 Processor -- start 2023-12-13T22:27:02.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f24e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250b240 0x5609f24e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2332b80 con 0x5609f250a000 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f22eabf0 con 0x5609f250b240 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f22f0a90 con 0x5609f250a920 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e14601000 10 client.0 _ll_register_callbacks cb 0x5609f24cd970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e0affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e0affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41250/0 (socket says 172.21.15.91:41250) 2023-12-13T22:27:02.926 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e0affd640 1 -- 172.21.15.91:0/857523379 learned_addr learned my addr 172.21.15.91:0/857523379 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:02.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.928+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f24e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:02.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 -- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 msgr2=0x5609f24e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:02.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f24e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 -- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250b240 msgr2=0x5609f24e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:02.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250b240 0x5609f24e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:02.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 -- 172.21.15.91:0/857523379 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c071db0 con 0x5609f250a000 2023-12-13T22:27:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4e0affd640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e0405e0b0 tx=0x7f4e0405bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227ed0c8dd82efa server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:02.934 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.932+0000 7f4de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:27:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.936+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04014dd0 con 0x5609f250a000 2023-12-13T22:27:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.936+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e0405cb70 con 0x5609f250a000 2023-12-13T22:27:02.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.936+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609f22f0420 con 0x5609f250a000 2023-12-13T22:27:02.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.940+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0405cd30 con 0x5609f250a000 2023-12-13T22:27:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.940+0000 7f4e14601000 10 client.4647 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:02.940 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:02.940+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5609f22f3190 con 0x5609f250a000 2023-12-13T22:27:03.082 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5609f22f0420 con 0x5609f250a000 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f4e04005d20 con 0x5609f250a000 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 10 client.4647 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 10 client.4647 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 20 client.4647 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f2541a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 4 client.4647 mds_command: new command op to 4226 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 --> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609f23314d0 con 0x5609f253f650 2023-12-13T22:27:03.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.084+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f2541a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.164+0000 7f4de9ffb640 10 client.4647 ms_handle_connect on v2:172.21.15.91:6836/757899957 2023-12-13T22:27:03.164 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.164+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f2541a40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=927afe5447b523b9 server_cookie=6dccc40a058381c3 in_seq=0 out_seq=0 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4de9ffb640 1 -- 172.21.15.91:0/857523379 <== mds.2 v2:172.21.15.91:6836/757899957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5609f23314d0 con 0x5609f253f650 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4de9ffb640 10 client.4647 handle_command_reply: tid=0 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 client.4647 shutdown 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 msgr2=0x5609f24e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4e0405e0b0 tx=0x7f4e0405bf80 comp rx=0 tx=0).stop 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 shutdown_connections 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f2541a40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250b240 0x5609f24e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f24e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4de9ffb640 0 client.4647 ms_handle_reset on v2:172.21.15.91:6836/757899957 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 --2- 172.21.15.91:0/857523379 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a000 0x5609f24e3190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 >> 172.21.15.91:0/857523379 conn(0x5609f251f1c0 msgr2=0x5609f25215b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 shutdown_connections 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 1 -- 172.21.15.91:0/857523379 wait complete. 2023-12-13T22:27:03.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.384+0000 7f4e14601000 20 client.4647 trim_cache size 0 max 16384 2023-12-13T22:27:03.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 Processor -- start 2023-12-13T22:27:03.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 -- start start 2023-12-13T22:27:03.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f253c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f253cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f1feb940 con 0x5609f250b240 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f232ff80 con 0x5609f250a000 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f232a380 con 0x5609f250a920 2023-12-13T22:27:03.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e0b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e0affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f253c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e0b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41254/0 (socket says 172.21.15.91:41254) 2023-12-13T22:27:03.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e0b7fe640 1 -- 172.21.15.91:0/1219465666 learned_addr learned my addr 172.21.15.91:0/1219465666 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.424+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f253cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.428+0000 7f4e0b7fe640 1 -- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 msgr2=0x5609f253cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.428+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f253cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.428+0000 7f4e0b7fe640 1 -- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 msgr2=0x5609f253c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.428+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f253c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.428+0000 7f4e0b7fe640 1 -- 172.21.15.91:0/1219465666 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f22d9490 con 0x5609f250b240 2023-12-13T22:27:03.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.432+0000 7f4e0b7fe640 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001170 tx=0x7f4e00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d85e03d4a741347 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.448+0000 7f4df17fa640 1 -- 172.21.15.91:0/1219465666 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0001d040 con 0x5609f250b240 2023-12-13T22:27:03.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.448+0000 7f4df17fa640 1 -- 172.21.15.91:0/1219465666 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e00005d90 con 0x5609f250b240 2023-12-13T22:27:03.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.448+0000 7f4df17fa640 1 -- 172.21.15.91:0/1219465666 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00007310 con 0x5609f250b240 2023-12-13T22:27:03.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- 172.21.15.91:0/1219465666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 msgr2=0x5609f2508f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001170 tx=0x7f4e00009040 comp rx=0 tx=0).stop 2023-12-13T22:27:03.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- 172.21.15.91:0/1219465666 shutdown_connections 2023-12-13T22:27:03.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250b240 0x5609f2508f10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250a920 0x5609f253cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- 172.21.15.91:0/1219465666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f253c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- 172.21.15.91:0/1219465666 >> 172.21.15.91:0/1219465666 conn(0x5609f251f1c0 msgr2=0x5609f2543c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- 172.21.15.91:0/1219465666 shutdown_connections 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- 172.21.15.91:0/1219465666 wait complete. 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- start start 2023-12-13T22:27:03.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 Processor -- start 2023-12-13T22:27:03.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f2542e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f258f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f22ebd60 con 0x5609f250a920 2023-12-13T22:27:03.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f232bde0 con 0x5609f250a000 2023-12-13T22:27:03.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f232ce80 con 0x5609f250b240 2023-12-13T22:27:03.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.452+0000 7f4e14601000 10 client.0 _ll_register_callbacks cb 0x5609f2380ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:03.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.456+0000 7f4e0a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.456+0000 7f4e0b7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f258f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.456+0000 7f4e0a7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41266/0 (socket says 172.21.15.91:41266) 2023-12-13T22:27:03.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.456+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4048514058 learned_addr learned my addr 172.21.15.91:0/4048514058 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.456+0000 7f4e0affd640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f2542e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.460+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 msgr2=0x5609f258f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.460+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f258f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.460+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 msgr2=0x5609f2542e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.460+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f2542e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.460 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.460+0000 7f4e0a7fc640 1 -- 172.21.15.91:0/4048514058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c072400 con 0x5609f250a920 2023-12-13T22:27:03.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.464+0000 7f4e0a7fc640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006cf0 tx=0x7f4dfc0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc8355c9b307fa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.464+0000 7f4de9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:27:03.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.468+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0c8040 con 0x5609f250a920 2023-12-13T22:27:03.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.468+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4dfc0cbd80 con 0x5609f250a920 2023-12-13T22:27:03.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.468+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609f22cdf90 con 0x5609f250a920 2023-12-13T22:27:03.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.472+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dfc0a84b0 con 0x5609f250a920 2023-12-13T22:27:03.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.472+0000 7f4e14601000 10 client.4653 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:03.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.472+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5609f202acc0 con 0x5609f250a920 2023-12-13T22:27:03.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.476+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5609f22cdf90 con 0x5609f250a920 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f4dfc0cb070 con 0x5609f250a920 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 10 client.4653 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 10 client.4653 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 20 client.4653 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f258d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.477 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 4 client.4653 mds_command: new command op to 4226 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T22:27:03.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 --> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5609f2360ac0 con 0x5609f253f650 2023-12-13T22:27:03.478 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.480+0000 7f4e0affd640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f258d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.484+0000 7f4e0affd640 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f258d8b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d96621de9ade56f3 server_cookie=35046bcc167146a6 in_seq=0 out_seq=0 2023-12-13T22:27:03.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.484+0000 7f4de9ffb640 10 client.4653 ms_handle_connect on v2:172.21.15.91:6836/757899957 2023-12-13T22:27:03.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4de9ffb640 1 -- 172.21.15.91:0/4048514058 <== mds.2 v2:172.21.15.91:6836/757899957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5609f2360ac0 con 0x5609f253f650 2023-12-13T22:27:03.508 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4de9ffb640 10 client.4653 handle_command_reply: tid=0 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 client.4653 shutdown 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 msgr2=0x5609f258ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006cf0 tx=0x7f4dfc0aa000 comp rx=0 tx=0).stop 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 shutdown_connections 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:6836/757899957,v1:172.21.15.91:6837/757899957] conn(0x5609f253f650 0x5609f258d8b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5609f250b240 0x5609f258f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x5609f250a920 0x5609f258ead0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 --2- 172.21.15.91:0/4048514058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5609f250a000 0x5609f2542e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4de9ffb640 0 client.4653 ms_handle_reset on v2:172.21.15.91:6836/757899957 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 >> 172.21.15.91:0/4048514058 conn(0x5609f251f1c0 msgr2=0x5609f253b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 shutdown_connections 2023-12-13T22:27:03.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.508+0000 7f4e14601000 1 -- 172.21.15.91:0/4048514058 wait complete. 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e14601000 20 client.4653 trim_cache size 0 max 16384 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "94ef47bf-5c6b-4a6a-817c-50fb411636d9", 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 2, 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4226, 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-12-13T22:27:03.510 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 22.908055127000001, 2023-12-13T22:27:03.511 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 15, 2023-12-13T22:27:03.511 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 31, 2023-12-13T22:27:03.511 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 29, 2023-12-13T22:27:03.511 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 79.216997961999994 2023-12-13T22:27:03.511 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 msgr2=0x7f4df8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 0x7f4df8068d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e00001960 tx=0x7f4e00007d10 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 msgr2=0x7f4e0c1ecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400efc0 tx=0x7f4e0400c490 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 shutdown_connections 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4df8066840 0x7f4df8068d00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e0c1513c0 0x7f4e0c1462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e0c072890 0x7f4e0c1ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 --2- 172.21.15.91:0/3615908094 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e0c06ad60 0x7f4e0c1ecfb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 >> 172.21.15.91:0/3615908094 conn(0x7f4e0c06b670 msgr2=0x7f4e0c0c82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 shutdown_connections 2023-12-13T22:27:03.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.512+0000 7f4e114d1640 1 -- 172.21.15.91:0/3615908094 wait complete. 2023-12-13T22:27:03.532 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-13T22:27:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 Processor -- start 2023-12-13T22:27:03.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 -- start start 2023-12-13T22:27:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf240cbd50 0x7faf240c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faf240cc130 0x7faf24156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240c1330 con 0x7faf240c0ee0 2023-12-13T22:27:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240c1570 con 0x7faf240cbd50 2023-12-13T22:27:03.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.660+0000 7faf29b06640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240c1810 con 0x7faf240cc130 2023-12-13T22:27:03.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.664+0000 7faf237fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf240cbd50 0x7faf240c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.664+0000 7faf237fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7faf240cbd50 0x7faf240c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41268/0 (socket says 172.21.15.91:41268) 2023-12-13T22:27:03.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.664+0000 7faf237fe640 1 -- 172.21.15.91:0/753779823 learned_addr learned my addr 172.21.15.91:0/753779823 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.662 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.664+0000 7faf1bfff640 1 --2- 172.21.15.91:0/753779823 >> v2:172.21.15.152:3300/0 conn(0x7faf240cc130 0x7faf24156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.668+0000 7faf237fe640 1 -- 172.21.15.91:0/753779823 >> v2:172.21.15.152:3300/0 conn(0x7faf240cc130 msgr2=0x7faf24156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.668+0000 7faf237fe640 1 --2- 172.21.15.91:0/753779823 >> v2:172.21.15.152:3300/0 conn(0x7faf240cc130 0x7faf24156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.668+0000 7faf237fe640 1 -- 172.21.15.91:0/753779823 >> v1:172.21.15.91:6789/0 conn(0x7faf240c0ee0 legacy=0x7faf240c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.665 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.668+0000 7faf237fe640 1 -- 172.21.15.91:0/753779823 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240c1af0 con 0x7faf240cbd50 2023-12-13T22:27:03.673 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.676+0000 7faf237fe640 1 --2- 172.21.15.91:0/753779823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf240c8490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf24072ce0 tx=0x7faf1401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3169242d1615542 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf22ffd640 1 -- 172.21.15.91:0/753779823 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140ab600 con 0x7faf240cbd50 2023-12-13T22:27:03.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf22ffd640 1 -- 172.21.15.91:0/753779823 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf140a7050 con 0x7faf240cbd50 2023-12-13T22:27:03.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf22ffd640 1 -- 172.21.15.91:0/753779823 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140ab980 con 0x7faf240cbd50 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- 172.21.15.91:0/753779823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 msgr2=0x7faf240c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- 172.21.15.91:0/753779823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf240c8490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faf24072ce0 tx=0x7faf1401c470 comp rx=0 tx=0).stop 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- 172.21.15.91:0/753779823 shutdown_connections 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- 172.21.15.91:0/753779823 >> v2:172.21.15.152:3300/0 conn(0x7faf240cc130 0x7faf24156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- 172.21.15.91:0/753779823 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf240c8490 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- 172.21.15.91:0/753779823 >> 172.21.15.91:0/753779823 conn(0x7faf24070160 msgr2=0x7faf2406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- 172.21.15.91:0/753779823 shutdown_connections 2023-12-13T22:27:03.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- 172.21.15.91:0/753779823 wait complete. 2023-12-13T22:27:03.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 Processor -- start 2023-12-13T22:27:03.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- start start 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faf240c0ee0 0x7faf24147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf240cc130 0x7faf24152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24148170 con 0x7faf240cbd50 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24152390 con 0x7faf240cc130 2023-12-13T22:27:03.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.680+0000 7faf29b06640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf24148c10 con 0x7faf240c0ee0 2023-12-13T22:27:03.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.684+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.684+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41278/0 (socket says 172.21.15.91:41278) 2023-12-13T22:27:03.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.684+0000 7faf1bfff640 1 -- 172.21.15.91:0/1048827125 learned_addr learned my addr 172.21.15.91:0/1048827125 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.684+0000 7faf237fe640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faf240c0ee0 0x7faf24147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.684+0000 7faf23fff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf240cc130 0x7faf24152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 -- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faf240c0ee0 msgr2=0x7faf24147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faf240c0ee0 0x7faf24147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 -- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf240cc130 msgr2=0x7faf24152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf240cc130 0x7faf24152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 -- 172.21.15.91:0/1048827125 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140094d0 con 0x7faf240cbd50 2023-12-13T22:27:03.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.688+0000 7faf1bfff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e870 tx=0x7faf0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.692+0000 7faf20ff9640 1 -- 172.21.15.91:0/1048827125 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c009510 con 0x7faf240cbd50 2023-12-13T22:27:03.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.692+0000 7faf20ff9640 1 -- 172.21.15.91:0/1048827125 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00eec0 con 0x7faf240cbd50 2023-12-13T22:27:03.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.692+0000 7faf20ff9640 1 -- 172.21.15.91:0/1048827125 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00cb40 con 0x7faf240cbd50 2023-12-13T22:27:03.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.692+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24151810 con 0x7faf240cbd50 2023-12-13T22:27:03.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.692+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf24148370 con 0x7faf240cbd50 2023-12-13T22:27:03.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 Processor -- start 2023-12-13T22:27:03.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 -- start start 2023-12-13T22:27:03.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6e4b0 0x55c55eca8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55ead2250 con 0x55c55ec6db90 2023-12-13T22:27:03.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55eabfd60 con 0x55c55ec6e4b0 2023-12-13T22:27:03.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.696+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c55eabd290 con 0x55c55eca8940 2023-12-13T22:27:03.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.700+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.700+0000 7faf237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6e4b0 0x55c55eca8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.700+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:44938/0 (socket says 172.21.15.91:44938) 2023-12-13T22:27:03.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.700+0000 7faf1bfff640 1 -- 172.21.15.91:0/4272397730 learned_addr learned my addr 172.21.15.91:0/4272397730 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.708+0000 7faf1bfff640 1 -- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6e4b0 msgr2=0x55c55eca8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.708+0000 7faf1bfff640 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6e4b0 0x55c55eca8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.708+0000 7faf1bfff640 1 -- 172.21.15.91:0/4272397730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 msgr2=0x55c55ec6df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.708+0000 7faf1bfff640 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.708+0000 7faf1bfff640 1 -- 172.21.15.91:0/4272397730 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c55e7b0890 con 0x55c55eca8940 2023-12-13T22:27:03.711 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.712+0000 7faf1bfff640 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faf0c016000 tx=0x7faf0c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729e286d10693452 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.716+0000 7faf20ff9640 1 -- 172.21.15.91:0/1048827125 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7faf0c026480 con 0x7faf240cbd50 2023-12-13T22:27:03.713 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.716+0000 7faf20ff9640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 0x7faf04068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.716+0000 7faf23fff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 0x7faf04068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.716+0000 7faf23fff640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 0x7faf04068d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0012f0 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.720+0000 7faf20ff9640 1 -- 172.21.15.91:0/1048827125 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf0c00ce40 con 0x7faf240cbd50 2023-12-13T22:27:03.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf197fa640 1 -- 172.21.15.91:0/4272397730 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c02b070 con 0x55c55eca8940 2023-12-13T22:27:03.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf197fa640 1 -- 172.21.15.91:0/4272397730 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c053fd0 con 0x55c55eca8940 2023-12-13T22:27:03.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf197fa640 1 -- 172.21.15.91:0/4272397730 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c057a60 con 0x55c55eca8940 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 msgr2=0x55c55eca8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faf0c016000 tx=0x7faf0c013000 comp rx=0 tx=0).stop 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- 172.21.15.91:0/4272397730 shutdown_connections 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55eca8940 0x55c55eca8d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6e4b0 0x55c55eca8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- 172.21.15.91:0/4272397730 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- 172.21.15.91:0/4272397730 >> 172.21.15.91:0/4272397730 conn(0x55c55eca51c0 msgr2=0x55c55eca75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- 172.21.15.91:0/4272397730 shutdown_connections 2023-12-13T22:27:03.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- 172.21.15.91:0/4272397730 wait complete. 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- start start 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 Processor -- start 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ec6a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55ec6ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.724 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55eab8b80 con 0x55c55ec6db90 2023-12-13T22:27:03.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55ea70bf0 con 0x55c55eca8940 2023-12-13T22:27:03.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c55ea76a90 con 0x55c55ec6e4b0 2023-12-13T22:27:03.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.724+0000 7faf2cc36000 10 client.0 _ll_register_callbacks cb 0x55c55ec53970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:03.725 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.728+0000 7faf23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55ec6ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.728+0000 7faf237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.728+0000 7faf237fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41292/0 (socket says 172.21.15.91:41292) 2023-12-13T22:27:03.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.728+0000 7faf237fe640 1 -- 172.21.15.91:0/2217795103 learned_addr learned my addr 172.21.15.91:0/2217795103 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:03.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf1bfff640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ec6a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 -- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 msgr2=0x55c55ec6a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ec6a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 -- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 msgr2=0x55c55ec6ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:03.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55ec6ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:03.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 -- 172.21.15.91:0/2217795103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf24148370 con 0x55c55ec6db90 2023-12-13T22:27:03.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf237fe640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf1401c4b0 tx=0x7faf1401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c630ab4131b71f92 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:03.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.732+0000 7faf027fc640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:27:03.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.736+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140abd40 con 0x55c55ec6db90 2023-12-13T22:27:03.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.736+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf140b6420 con 0x55c55ec6db90 2023-12-13T22:27:03.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.736+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c55ea76420 con 0x55c55ec6db90 2023-12-13T22:27:03.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.740+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf140abea0 con 0x55c55ec6db90 2023-12-13T22:27:03.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.740+0000 7faf2cc36000 10 client.4665 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:03.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.740+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c55ea79190 con 0x55c55ec6db90 2023-12-13T22:27:03.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.740+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c55ea76420 con 0x55c55ec6db90 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7faf140b65e0 con 0x55c55ec6db90 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 10 client.4665 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 20 client.4665 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ecbd110 0x55c55ecbf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 4 client.4665 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T22:27:03.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 --> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c55eab74d0 con 0x55c55ecbd110 2023-12-13T22:27:03.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.744+0000 7faf1bfff640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ecbd110 0x55c55ecbf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:03.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.856+0000 7faf1bfff640 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ecbd110 0x55c55ecbf500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=798ac7b8a6532b65 server_cookie=91f8b65af737a894 in_seq=0 out_seq=0 2023-12-13T22:27:03.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:03.856+0000 7faf027fc640 10 client.4665 ms_handle_connect on v2:172.21.15.152:6832/1277096500 2023-12-13T22:27:04.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf027fc640 1 -- 172.21.15.91:0/2217795103 <== mds.1 v2:172.21.15.152:6832/1277096500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c55eab74d0 con 0x55c55ecbd110 2023-12-13T22:27:04.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf027fc640 10 client.4665 handle_command_reply: tid=0 2023-12-13T22:27:04.060 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 client.4665 shutdown 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 msgr2=0x55c55ec6a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faf1401c4b0 tx=0x7faf1401acb0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 shutdown_connections 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ecbd110 0x55c55ecbf500 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55ec6ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ec6a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf027fc640 0 client.4665 ms_handle_reset on v2:172.21.15.152:6832/1277096500 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 --2- 172.21.15.91:0/2217795103 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6db90 0x55c55ec6a0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.060+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 >> 172.21.15.91:0/2217795103 conn(0x55c55eca51c0 msgr2=0x55c55eca6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.064+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 shutdown_connections 2023-12-13T22:27:04.061 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.064+0000 7faf2cc36000 1 -- 172.21.15.91:0/2217795103 wait complete. 2023-12-13T22:27:04.062 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.064+0000 7faf2cc36000 20 client.4665 trim_cache size 0 max 16384 2023-12-13T22:27:04.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 Processor -- start 2023-12-13T22:27:04.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 -- start start 2023-12-13T22:27:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6db90 0x55c55ecc0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 0x55c55ecc0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55eccaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55e771940 con 0x55c55ec6e4b0 2023-12-13T22:27:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55eac2fb0 con 0x55c55eca8940 2023-12-13T22:27:04.107 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c55e7b11b0 con 0x55c55ec6db90 2023-12-13T22:27:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 0x55c55ecc0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf237fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6db90 0x55c55ecc0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.108 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.108+0000 7faf23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55eccaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.112+0000 7faf23fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55eccaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:45988/0 (socket says 172.21.15.91:45988) 2023-12-13T22:27:04.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.112+0000 7faf23fff640 1 -- 172.21.15.91:0/210595006 learned_addr learned my addr 172.21.15.91:0/210595006 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.116+0000 7faf1bfff640 1 -- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6db90 msgr2=0x55c55ecc0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.116+0000 7faf1bfff640 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6db90 0x55c55ecc0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.116+0000 7faf1bfff640 1 -- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 msgr2=0x55c55eccaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.116+0000 7faf1bfff640 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55eccaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.114 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.116+0000 7faf1bfff640 1 -- 172.21.15.91:0/210595006 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c55ea5f490 con 0x55c55ec6e4b0 2023-12-13T22:27:04.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.120+0000 7faf1bfff640 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 0x55c55ecc0a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e840 tx=0x7faf0c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f3fd7e9540c039 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf19ffb640 1 -- 172.21.15.91:0/210595006 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c02b030 con 0x55c55ec6e4b0 2023-12-13T22:27:04.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf19ffb640 1 -- 172.21.15.91:0/210595006 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c05bd90 con 0x55c55ec6e4b0 2023-12-13T22:27:04.125 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf19ffb640 1 -- 172.21.15.91:0/210595006 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0850b0 con 0x55c55ec6e4b0 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- 172.21.15.91:0/210595006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 msgr2=0x55c55ecc0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 0x55c55ecc0a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e840 tx=0x7faf0c008030 comp rx=0 tx=0).stop 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- 172.21.15.91:0/210595006 shutdown_connections 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55eca8940 0x55c55eccaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55ec6e4b0 0x55c55ecc0a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 --2- 172.21.15.91:0/210595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6db90 0x55c55ecc0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- 172.21.15.91:0/210595006 >> 172.21.15.91:0/210595006 conn(0x55c55eca51c0 msgr2=0x55c55eca3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- 172.21.15.91:0/210595006 shutdown_connections 2023-12-13T22:27:04.127 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- 172.21.15.91:0/210595006 wait complete. 2023-12-13T22:27:04.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 -- start start 2023-12-13T22:27:04.128 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.128+0000 7faf2cc36000 1 Processor -- start 2023-12-13T22:27:04.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 0x55c55ed07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ed08130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 0x55c55ed08aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55ea8eab0 con 0x55c55eca8940 2023-12-13T22:27:04.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55eab44f0 con 0x55c55ec6db90 2023-12-13T22:27:04.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c55eac2fb0 con 0x55c55ec6e4b0 2023-12-13T22:27:04.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf2cc36000 10 client.0 _ll_register_callbacks cb 0x55c55eb06ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:04.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 0x55c55ed07bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ed08130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf237fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 0x55c55ed07bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:45992/0 (socket says 172.21.15.91:45992) 2023-12-13T22:27:04.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf237fe640 1 -- 172.21.15.91:0/1156260532 learned_addr learned my addr 172.21.15.91:0/1156260532 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.132+0000 7faf23fff640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 0x55c55ed08aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.136+0000 7faf23fff640 1 -- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 msgr2=0x55c55ed08130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.136+0000 7faf23fff640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ed08130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.136+0000 7faf23fff640 1 -- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 msgr2=0x55c55ed07bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.136+0000 7faf23fff640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 0x55c55ed07bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.136+0000 7faf23fff640 1 -- 172.21.15.91:0/1156260532 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c55e7b0890 con 0x55c55eca8940 2023-12-13T22:27:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.140+0000 7faf23fff640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 0x55c55ed08aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf1c014a00 tx=0x7faf1c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc98ce24b5c1622 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.138 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.140+0000 7faf027fc640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:27:04.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c013b40 con 0x55c55eca8940 2023-12-13T22:27:04.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c55eca78a0 con 0x55c55eca8940 2023-12-13T22:27:04.141 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf1c01c040 con 0x55c55eca8940 2023-12-13T22:27:04.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf1c013ca0 con 0x55c55eca8940 2023-12-13T22:27:04.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf2cc36000 10 client.4671 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:04.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.144+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55c55e7b0cc0 con 0x55c55eca8940 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.148+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c55eca78a0 con 0x55c55eca8940 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7faf1c012070 con 0x55c55eca8940 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 10 client.4671 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 20 client.4671 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ed091f0 0x55c55ed095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 4 client.4671 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T22:27:04.149 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 --> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c55ea53f90 con 0x55c55ed091f0 2023-12-13T22:27:04.150 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.152+0000 7faf237fe640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ed091f0 0x55c55ed095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.160+0000 7faf237fe640 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ed091f0 0x55c55ed095d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a7c7002e54a05095 server_cookie=d233938e276db926 in_seq=0 out_seq=0 2023-12-13T22:27:04.157 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.160+0000 7faf027fc640 10 client.4671 ms_handle_connect on v2:172.21.15.152:6832/1277096500 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf027fc640 1 -- 172.21.15.91:0/1156260532 <== mds.1 v2:172.21.15.152:6832/1277096500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c55ea53f90 con 0x55c55ed091f0 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf027fc640 10 client.4671 handle_command_reply: tid=0 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 client.4671 shutdown 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 msgr2=0x55c55ed08aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 0x55c55ed08aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf1c014a00 tx=0x7faf1c001260 comp rx=0 tx=0).stop 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 shutdown_connections 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55c55eca8940 0x55c55ed08aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55c55ec6e4b0 0x55c55ed08130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:6832/1277096500,v1:172.21.15.152:6833/1277096500] conn(0x55c55ed091f0 0x55c55ed095d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 --2- 172.21.15.91:0/1156260532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c55ec6db90 0x55c55ed07bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 >> 172.21.15.91:0/1156260532 conn(0x55c55eca51c0 msgr2=0x55c55eca43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf027fc640 0 client.4671 ms_handle_reset on v2:172.21.15.152:6832/1277096500 2023-12-13T22:27:04.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 shutdown_connections 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 1 -- 172.21.15.91:0/1156260532 wait complete. 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf2cc36000 20 client.4671 trim_cache size 0 max 16384 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "94ef47bf-5c6b-4a6a-817c-50fb411636d9", 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 1, 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4255, 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 26.608868273999999, 2023-12-13T22:27:04.184 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 15, 2023-12-13T22:27:04.185 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 31, 2023-12-13T22:27:04.185 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 29, 2023-12-13T22:27:04.185 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 82.276610000999995 2023-12-13T22:27:04.185 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 msgr2=0x7faf04068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 0x7faf04068d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0012f0 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 msgr2=0x7faf2406da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e870 tx=0x7faf0c00ec70 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 shutdown_connections 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7faf04066840 0x7faf04068d00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf240cc130 0x7faf24152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7faf240cbd50 0x7faf2406da30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 --2- 172.21.15.91:0/1048827125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faf240c0ee0 0x7faf24147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 >> 172.21.15.91:0/1048827125 conn(0x7faf24070160 msgr2=0x7faf240c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 shutdown_connections 2023-12-13T22:27:04.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.184+0000 7faf29b06640 1 -- 172.21.15.91:0/1048827125 wait complete. 2023-12-13T22:27:04.208 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-13T22:27:04.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 Processor -- start 2023-12-13T22:27:04.334 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 -- start start 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f56e006b750 0x7f56e00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56e00c4540 0x7f56e0153130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00cbb50 con 0x7f56e006bb30 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00c3aa0 con 0x7f56e00c4540 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56e4d80640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e01599a0 con 0x7f56e006b750 2023-12-13T22:27:04.335 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56ded9d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f56e00c4540 0x7f56e0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56ddd9b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f56e006bb30 0x7f56e00c3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46236/0 (socket says 172.21.15.91:46236) 2023-12-13T22:27:04.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56ddd9b640 1 -- 172.21.15.91:0/1990130997 learned_addr learned my addr 172.21.15.91:0/1990130997 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:27:04.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.336+0000 7f56de59c640 1 --2- 172.21.15.91:0/1990130997 >> v2:172.21.15.152:3300/0 conn(0x7f56e006b750 0x7f56e00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.344+0000 7f56ded9d640 1 -- 172.21.15.91:0/1990130997 >> v2:172.21.15.152:3300/0 conn(0x7f56e006b750 msgr2=0x7f56e00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.344+0000 7f56ded9d640 1 --2- 172.21.15.91:0/1990130997 >> v2:172.21.15.152:3300/0 conn(0x7f56e006b750 0x7f56e00cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.344+0000 7f56ded9d640 1 -- 172.21.15.91:0/1990130997 >> v1:172.21.15.91:6789/0 conn(0x7f56e006bb30 legacy=0x7f56e00c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.341 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.344+0000 7f56ded9d640 1 -- 172.21.15.91:0/1990130997 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0159c40 con 0x7f56e00c4540 2023-12-13T22:27:04.345 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.348+0000 7f56ded9d640 1 --2- 172.21.15.91:0/1990130997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e0153130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097c0 tx=0x7f56d801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b0db628566a020 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56dd59a640 1 -- 172.21.15.91:0/1990130997 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80a8930 con 0x7f56e00c4540 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56dd59a640 1 -- 172.21.15.91:0/1990130997 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d80a8a90 con 0x7f56e00c4540 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56dd59a640 1 -- 172.21.15.91:0/1990130997 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80a8e20 con 0x7f56e00c4540 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- 172.21.15.91:0/1990130997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 msgr2=0x7f56e0153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 --2- 172.21.15.91:0/1990130997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e0153130 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097c0 tx=0x7f56d801ec30 comp rx=0 tx=0).stop 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- 172.21.15.91:0/1990130997 shutdown_connections 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 --2- 172.21.15.91:0/1990130997 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e0153130 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 --2- 172.21.15.91:0/1990130997 >> v2:172.21.15.152:3300/0 conn(0x7f56e006b750 0x7f56e00cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- 172.21.15.91:0/1990130997 >> 172.21.15.91:0/1990130997 conn(0x7f56e006d220 msgr2=0x7f56e006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- 172.21.15.91:0/1990130997 shutdown_connections 2023-12-13T22:27:04.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- 172.21.15.91:0/1990130997 wait complete. 2023-12-13T22:27:04.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 Processor -- start 2023-12-13T22:27:04.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.352+0000 7f56e4d80640 1 -- start start 2023-12-13T22:27:04.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e006b750 0x7f56e01563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56e006bb30 0x7f56e01513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e015db30 con 0x7f56e00c4540 2023-12-13T22:27:04.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01ef170 con 0x7f56e006b750 2023-12-13T22:27:04.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56e4d80640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01f0140 con 0x7f56e006bb30 2023-12-13T22:27:04.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.353 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41330/0 (socket says 172.21.15.91:41330) 2023-12-13T22:27:04.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56ded9d640 1 -- 172.21.15.91:0/4003828382 learned_addr learned my addr 172.21.15.91:0/4003828382 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56de59c640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e006b750 0x7f56e01563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.356+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56e006bb30 0x7f56e01513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 -- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56e006bb30 msgr2=0x7f56e01513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56e006bb30 0x7f56e01513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 -- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e006b750 msgr2=0x7f56e01563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e006b750 0x7f56e01563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 -- 172.21.15.91:0/4003828382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009420 con 0x7f56e00c4540 2023-12-13T22:27:04.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.360+0000 7f56ded9d640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097c0 tx=0x7f56d801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.364+0000 7f56ceffd640 1 -- 172.21.15.91:0/4003828382 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80b1c60 con 0x7f56e00c4540 2023-12-13T22:27:04.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.364+0000 7f56ceffd640 1 -- 172.21.15.91:0/4003828382 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d80b1dc0 con 0x7f56e00c4540 2023-12-13T22:27:04.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.364+0000 7f56ceffd640 1 -- 172.21.15.91:0/4003828382 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80b9610 con 0x7f56e00c4540 2023-12-13T22:27:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.364+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e015d850 con 0x7f56e00c4540 2023-12-13T22:27:04.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.364+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01ef660 con 0x7f56e00c4540 2023-12-13T22:27:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 Processor -- start 2023-12-13T22:27:04.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 -- start start 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30eb90 0x55f1be30ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30f4b0 0x55f1be349400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be173250 con 0x55f1be30eb90 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be160d60 con 0x55f1be30f4b0 2023-12-13T22:27:04.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.368+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1be15e290 con 0x55f1be349940 2023-12-13T22:27:04.368 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.372+0000 7f56ddd9b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.372+0000 7f56ddd9b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:44966/0 (socket says 172.21.15.91:44966) 2023-12-13T22:27:04.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.372+0000 7f56ddd9b640 1 -- 172.21.15.91:0/1843021420 learned_addr learned my addr 172.21.15.91:0/1843021420 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.376+0000 7f56de59c640 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30f4b0 0x55f1be349400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.380+0000 7f56ddd9b640 1 -- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30f4b0 msgr2=0x55f1be349400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.380+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30f4b0 0x55f1be349400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.380+0000 7f56ddd9b640 1 -- 172.21.15.91:0/1843021420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30eb90 msgr2=0x55f1be30ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.380+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30eb90 0x55f1be30ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.377 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.380+0000 7f56ddd9b640 1 -- 172.21.15.91:0/1843021420 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1bde51890 con 0x55f1be349940 2023-12-13T22:27:04.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.384+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56d00020f0 tx=0x7f56d00105b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eff0921ef653e237 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.384+0000 7f56ceffd640 1 -- 172.21.15.91:0/4003828382 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f56d80b7040 con 0x7f56e00c4540 2023-12-13T22:27:04.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.388+0000 7f56ceffd640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 0x7f56c0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.388+0000 7f56de59c640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 0x7f56c0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.388+0000 7f56de59c640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 0x7f56c0068d30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009d30 tx=0x7f56d4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.388+0000 7f56ceffd640 1 -- 172.21.15.91:0/4003828382 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56d80f2f30 con 0x7f56e00c4540 2023-12-13T22:27:04.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56bffff640 1 -- 172.21.15.91:0/1843021420 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0004b70 con 0x55f1be349940 2023-12-13T22:27:04.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56bffff640 1 -- 172.21.15.91:0/1843021420 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000d050 con 0x55f1be349940 2023-12-13T22:27:04.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56bffff640 1 -- 172.21.15.91:0/1843021420 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0007170 con 0x55f1be349940 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 msgr2=0x55f1be349d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56d00020f0 tx=0x7f56d00105b0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- 172.21.15.91:0/1843021420 shutdown_connections 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be349940 0x55f1be349d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30f4b0 0x55f1be349400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/1843021420 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30eb90 0x55f1be30ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- 172.21.15.91:0/1843021420 >> 172.21.15.91:0/1843021420 conn(0x55f1be3461c0 msgr2=0x55f1be3485b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- 172.21.15.91:0/1843021420 shutdown_connections 2023-12-13T22:27:04.394 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- 172.21.15.91:0/1843021420 wait complete. 2023-12-13T22:27:04.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- start start 2023-12-13T22:27:04.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 Processor -- start 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be30b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be30b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be159b80 con 0x55f1be349940 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be111bf0 con 0x55f1be30eb90 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1be117a90 con 0x55f1be30f4b0 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56e7eb0000 10 client.0 _ll_register_callbacks cb 0x55f1be2f4970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:04.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41350/0 (socket says 172.21.15.91:41350) 2023-12-13T22:27:04.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.396+0000 7f56ded9d640 1 -- 172.21.15.91:0/3397770976 learned_addr learned my addr 172.21.15.91:0/3397770976 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56de59c640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be30b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be30b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ded9d640 1 -- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 msgr2=0x55f1be30b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ded9d640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be30b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ded9d640 1 -- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 msgr2=0x55f1be30b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ded9d640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be30b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.400+0000 7f56ded9d640 1 -- 172.21.15.91:0/3397770976 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d000f040 con 0x55f1be349940 2023-12-13T22:27:04.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.404+0000 7f56ded9d640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56d80fa600 tx=0x7f56d80f6980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602f20186b0d39d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.404+0000 7f56bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.91:3300/0 2023-12-13T22:27:04.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80f1ff0 con 0x55f1be349940 2023-12-13T22:27:04.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mon.0 v2:172.21.15.91:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56d80fa8a0 con 0x55f1be349940 2023-12-13T22:27:04.406 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1be117420 con 0x55f1be349940 2023-12-13T22:27:04.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56d810a160 con 0x55f1be349940 2023-12-13T22:27:04.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56e7eb0000 10 client.4683 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:04.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.408+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f1be11a190 con 0x55f1be349940 2023-12-13T22:27:04.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.412+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mon.0 v2:172.21.15.91:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d811e020 con 0x55f1be349940 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mon.0 v2:172.21.15.91:3300/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f56d80f3b60 con 0x55f1be349940 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 10 client.4683 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 10 client.4683 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 20 client.4683 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be35e110 0x55f1be360500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 4 client.4683 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-13T22:27:04.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.416+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 --> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1be1584d0 con 0x55f1be35e110 2023-12-13T22:27:04.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.420+0000 7f56de59c640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be35e110 0x55f1be360500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.432+0000 7f56de59c640 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be35e110 0x55f1be360500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5da17d60b401d2c server_cookie=f6f2f89937763851 in_seq=0 out_seq=0 2023-12-13T22:27:04.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.432+0000 7f56bd7fa640 10 client.4683 ms_handle_connect on v2:172.21.15.152:6834/3409704443 2023-12-13T22:27:04.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.468+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3397770976 <== mds.0 v2:172.21.15.152:6834/3409704443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f1be1584d0 con 0x55f1be35e110 2023-12-13T22:27:04.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.468+0000 7f56bd7fa640 10 client.4683 handle_command_reply: tid=0 2023-12-13T22:27:04.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.468+0000 7f56e7eb0000 1 client.4683 shutdown 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 msgr2=0x55f1be30bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56d80fa600 tx=0x7f56d80f6980 comp rx=0 tx=0).stop 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 shutdown_connections 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be30bb80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be35e110 0x55f1be360500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be30b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3397770976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be30b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56bd7fa640 0 client.4683 ms_handle_reset on v2:172.21.15.152:6834/3409704443 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 >> 172.21.15.91:0/3397770976 conn(0x55f1be3461c0 msgr2=0x55f1be347530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 shutdown_connections 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3397770976 wait complete. 2023-12-13T22:27:04.470 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.472+0000 7f56e7eb0000 20 client.4683 trim_cache size 0 max 16384 2023-12-13T22:27:04.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 Processor -- start 2023-12-13T22:27:04.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 -- start start 2023-12-13T22:27:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be3a5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be3a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1bde12940 con 0x55f1be349940 2023-12-13T22:27:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be118e20 con 0x55f1be30eb90 2023-12-13T22:27:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.516+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1be10c260 con 0x55f1be30f4b0 2023-12-13T22:27:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.520+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.520+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41362/0 (socket says 172.21.15.91:41362) 2023-12-13T22:27:04.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.520+0000 7f56ded9d640 1 -- 172.21.15.91:0/2095358551 learned_addr learned my addr 172.21.15.91:0/2095358551 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 -- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 msgr2=0x55f1be3a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be3a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 -- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 msgr2=0x55f1be3a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be3a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 -- 172.21.15.91:0/2095358551 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1be100490 con 0x55f1be349940 2023-12-13T22:27:04.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.524+0000 7f56ded9d640 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f56d80f0b80 tx=0x7f56d80c6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d61b4f97e0eacc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.532+0000 7f56ccff9640 1 -- 172.21.15.91:0/2095358551 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80f1ff0 con 0x55f1be349940 2023-12-13T22:27:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.532+0000 7f56ccff9640 1 -- 172.21.15.91:0/2095358551 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d811e070 con 0x55f1be349940 2023-12-13T22:27:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.532+0000 7f56ccff9640 1 -- 172.21.15.91:0/2095358551 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d810a160 con 0x55f1be349940 2023-12-13T22:27:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- 172.21.15.91:0/2095358551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 msgr2=0x55f1be3a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.533 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f56d80f0b80 tx=0x7f56d80c6000 comp rx=0 tx=0).stop 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- 172.21.15.91:0/2095358551 shutdown_connections 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be349940 0x55f1be3a61c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30f4b0 0x55f1be3a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/2095358551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be30eb90 0x55f1be3a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- 172.21.15.91:0/2095358551 >> 172.21.15.91:0/2095358551 conn(0x55f1be3461c0 msgr2=0x55f1be344e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- 172.21.15.91:0/2095358551 shutdown_connections 2023-12-13T22:27:04.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- 172.21.15.91:0/2095358551 wait complete. 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- start start 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 Processor -- start 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 0x55f1be3af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30f4b0 0x55f1be3af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be12fab0 con 0x55f1be30f4b0 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1be112d60 con 0x55f1be349940 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1be0dc6f0 con 0x55f1be30eb90 2023-12-13T22:27:04.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56e7eb0000 10 client.0 _ll_register_callbacks cb 0x55f1be1a7ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-13T22:27:04.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56de59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 0x55f1be3af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.536+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.540+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:46034/0 (socket says 172.21.15.91:46034) 2023-12-13T22:27:04.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.540+0000 7f56ded9d640 1 -- 172.21.15.91:0/3716895661 learned_addr learned my addr 172.21.15.91:0/3716895661 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:04.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56de59c640 1 -- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 msgr2=0x55f1be36e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56de59c640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56de59c640 1 -- 172.21.15.91:0/3716895661 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30f4b0 msgr2=0x55f1be3af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:04.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56de59c640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30f4b0 0x55f1be3af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56de59c640 1 -- 172.21.15.91:0/3716895661 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d000f040 con 0x55f1be30eb90 2023-12-13T22:27:04.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.552+0000 7f56ded9d640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-13T22:27:04.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.560+0000 7f56de59c640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 0x55f1be3af360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ef250 tx=0x7f56d4004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61edd34b0217c72 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:04.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.560+0000 7f56bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3301/0 2023-12-13T22:27:04.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.572+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4026040 con 0x55f1be30eb90 2023-12-13T22:27:04.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.572+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mon.2 v2:172.21.15.152:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56d4003c80 con 0x55f1be30eb90 2023-12-13T22:27:04.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.572+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1be3488a0 con 0x55f1be30eb90 2023-12-13T22:27:04.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.716+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56d4003e40 con 0x55f1be30eb90 2023-12-13T22:27:04.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.716+0000 7f56e7eb0000 10 client.4550 fetch_fsmap learned FSMap version 15 2023-12-13T22:27:04.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.716+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f1bde51cc0 con 0x55f1be30eb90 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mon.2 v2:172.21.15.152:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f1be3488a0 con 0x55f1be30eb90 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mon.2 v2:172.21.15.152:3301/0 5 ==== fsmap(e 15) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f56d401d040 con 0x55f1be30eb90 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 10 client.4550 fetch_fsmap finished waiting for FSMap version 15 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 10 client.4550 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 20 client.4550 populate_metadata read hostname 'smithi091' 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be3b61c0 0x55f1be36efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 4 client.4550 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-13T22:27:04.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 --> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f1be0f4f90 con 0x55f1be3b61c0 2023-12-13T22:27:04.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.744+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be3b61c0 0x55f1be36efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:04.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.752+0000 7f56ddd9b640 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be3b61c0 0x55f1be36efd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb73cdbb71c43ec3 server_cookie=e7412a1131609b42 in_seq=0 out_seq=0 2023-12-13T22:27:04.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.752+0000 7f56bd7fa640 10 client.4550 ms_handle_connect on v2:172.21.15.152:6834/3409704443 2023-12-13T22:27:04.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56bd7fa640 1 -- 172.21.15.91:0/3716895661 <== mds.0 v2:172.21.15.152:6834/3409704443 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f1be0f4f90 con 0x55f1be3b61c0 2023-12-13T22:27:04.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56bd7fa640 10 client.4550 handle_command_reply: tid=0 2023-12-13T22:27:04.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 client.4550 shutdown 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 msgr2=0x55f1be3af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 0x55f1be3af360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56d80ef250 tx=0x7f56d4004740 comp rx=0 tx=0).stop 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 shutdown_connections 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f1be349940 0x55f1be36e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x55f1be30f4b0 0x55f1be3af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:6834/3409704443,v1:172.21.15.152:6835/3409704443] conn(0x55f1be3b61c0 0x55f1be36efd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 --2- 172.21.15.91:0/3716895661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55f1be30eb90 0x55f1be3af360 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56bd7fa640 0 client.4550 ms_handle_reset on v2:172.21.15.152:6834/3409704443 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 >> 172.21.15.91:0/3716895661 conn(0x55f1be3461c0 msgr2=0x55f1be360500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 shutdown_connections 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 1 -- 172.21.15.91:0/3716895661 wait complete. 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.760+0000 7f56e7eb0000 20 client.4550 trim_cache size 0 max 16384 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stdout: "cluster_fsid": "94ef47bf-5c6b-4a6a-817c-50fb411636d9", 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stdout: "whoami": 0, 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4258, 2023-12-13T22:27:04.761 INFO:teuthology.orchestra.run.smithi091.stdout: "want_state": "up:active", 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "state": "up:active", 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs", 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "rank_uptime": 64.411304482999995, 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "mdsmap_epoch": 15, 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch": 31, 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "osdmap_epoch_barrier": 29, 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout: "uptime": 80.548132404 2023-12-13T22:27:04.762 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 msgr2=0x7f56c0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 0x7f56c0068d30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009d30 tx=0x7f56d4009190 comp rx=0 tx=0).stop 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 msgr2=0x7f56e015c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097c0 tx=0x7f56d801b9d0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 shutdown_connections 2023-12-13T22:27:04.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f56c0066870 0x7f56c0068d30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f56e00c4540 0x7f56e015c2b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56e006bb30 0x7f56e01513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 --2- 172.21.15.91:0/4003828382 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e006b750 0x7f56e01563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 >> 172.21.15.91:0/4003828382 conn(0x7f56e006d220 msgr2=0x7f56e01572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 shutdown_connections 2023-12-13T22:27:04.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:04.764+0000 7f56e4d80640 1 -- 172.21.15.91:0/4003828382 wait complete. 2023-12-13T22:27:04.786 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-13T22:27:04.797 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-13T22:27:04.797 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-13T22:27:04.797 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-13T22:27:04.797 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-13T22:27:04.798 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:04.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:04.798 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-12-13T22:27:04.805 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-13T22:27:04.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:04.806 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-13T22:27:04.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:04.862 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-12-13T22:27:05.087 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-13T22:27:05.087 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-13T22:27:05.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 Processor -- start 2023-12-13T22:27:05.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 -- start start 2023-12-13T22:27:05.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680cb270 0x7f08680cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08680c4350 0x7f08680c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0868159620 con 0x7f086814ff30 2023-12-13T22:27:05.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680cbb90 con 0x7f08680c4350 2023-12-13T22:27:05.214 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f0870368640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0868159850 con 0x7f08680cb270 2023-12-13T22:27:05.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f086d903640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680cb270 0x7f08680cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.216+0000 7f086e905640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08680c4350 0x7f08680c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e104640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f086814ff30 0x7f086806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:46244/0 (socket says 172.21.15.91:46244) 2023-12-13T22:27:05.217 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e104640 1 -- 172.21.15.91:0/4163781142 learned_addr learned my addr 172.21.15.91:0/4163781142 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:27:05.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e905640 1 -- 172.21.15.91:0/4163781142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680cb270 msgr2=0x7f08680cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:27:05.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e905640 1 --2- 172.21.15.91:0/4163781142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680cb270 0x7f08680cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e905640 1 -- 172.21.15.91:0/4163781142 >> v1:172.21.15.91:6789/0 conn(0x7f086814ff30 legacy=0x7f086806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.220+0000 7f086e905640 1 -- 172.21.15.91:0/4163781142 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868159af0 con 0x7f08680c4350 2023-12-13T22:27:05.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.224+0000 7f086e905640 1 --2- 172.21.15.91:0/4163781142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08680c4350 0x7f08680c47a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f08680cbcd0 tx=0x7f086001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2952fea96b8dc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:05.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.244+0000 7f086d102640 1 -- 172.21.15.91:0/4163781142 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5900 con 0x7f08680c4350 2023-12-13T22:27:05.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.244+0000 7f086d102640 1 -- 172.21.15.91:0/4163781142 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600a5a60 con 0x7f08680c4350 2023-12-13T22:27:05.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.244+0000 7f086d102640 1 -- 172.21.15.91:0/4163781142 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5df0 con 0x7f08680c4350 2023-12-13T22:27:05.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- 172.21.15.91:0/4163781142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08680c4350 msgr2=0x7f08680c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- 172.21.15.91:0/4163781142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08680c4350 0x7f08680c47a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f08680cbcd0 tx=0x7f086001c930 comp rx=0 tx=0).stop 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- 172.21.15.91:0/4163781142 shutdown_connections 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- 172.21.15.91:0/4163781142 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08680c4350 0x7f08680c47a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- 172.21.15.91:0/4163781142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680cb270 0x7f08680cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- 172.21.15.91:0/4163781142 >> 172.21.15.91:0/4163781142 conn(0x7f086806d220 msgr2=0x7f086806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- 172.21.15.91:0/4163781142 shutdown_connections 2023-12-13T22:27:05.245 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- 172.21.15.91:0/4163781142 wait complete. 2023-12-13T22:27:05.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 Processor -- start 2023-12-13T22:27:05.246 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- start start 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680c4350 0x7f0868148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08680cb270 0x7f086814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868158e10 con 0x7f086814ff30 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868147c40 con 0x7f08680cb270 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f0870368640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0868148660 con 0x7f08680c4350 2023-12-13T22:27:05.247 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f086e905640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f086e905640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:41398/0 (socket says 172.21.15.91:41398) 2023-12-13T22:27:05.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f086e905640 1 -- 172.21.15.91:0/560124399 learned_addr learned my addr 172.21.15.91:0/560124399 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:27:05.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f086d903640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08680cb270 0x7f086814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.248 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.248+0000 7f086e104640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680c4350 0x7f0868148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.252+0000 7f086e905640 1 -- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680c4350 msgr2=0x7f0868148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.252+0000 7f086e905640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680c4350 0x7f0868148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.252+0000 7f086e905640 1 -- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08680cb270 msgr2=0x7f086814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.252+0000 7f086e905640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08680cb270 0x7f086814e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.252+0000 7f086e905640 1 -- 172.21.15.91:0/560124399 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009a70 con 0x7f086814ff30 2023-12-13T22:27:05.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.256+0000 7f086e905640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f086001a560 tx=0x7f08600196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:05.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600adb80 con 0x7f086814ff30 2023-12-13T22:27:05.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600adce0 con 0x7f086814ff30 2023-12-13T22:27:05.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600b9690 con 0x7f086814ff30 2023-12-13T22:27:05.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08681579c0 con 0x7f086814ff30 2023-12-13T22:27:05.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868158960 con 0x7f086814ff30 2023-12-13T22:27:05.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.260+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868147e00 con 0x7f086814ff30 2023-12-13T22:27:05.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.280+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f08600b97f0 con 0x7f086814ff30 2023-12-13T22:27:05.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.280+0000 7f085effd640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 0x7f084c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:27:05.279 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.280+0000 7f086e104640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 0x7f084c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:27:05.280 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.280+0000 7f086e104640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 0x7f084c068ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0864005890 tx=0x7f0864009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:27:05.282 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.284+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08600f1890 con 0x7f086814ff30 2023-12-13T22:27:05.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.548+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f08600ed4d0 con 0x7f086814ff30 2023-12-13T22:27:05.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.752+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0868073e70 con 0x7f086814ff30 2023-12-13T22:27:05.759 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.760+0000 7f085effd640 1 -- 172.21.15.91:0/560124399 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7f08600a58c0 con 0x7f086814ff30 2023-12-13T22:27:05.759 INFO:teuthology.orchestra.run.smithi091.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 msgr2=0x7f084c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 0x7f084c068ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0864005890 tx=0x7f0864009040 comp rx=0 tx=0).stop 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 msgr2=0x7f0868143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f086001a560 tx=0x7f08600196d0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 shutdown_connections 2023-12-13T22:27:05.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f084c066820 0x7f084c068ce0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f086814ff30 0x7f0868143c10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08680cb270 0x7f086814e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 --2- 172.21.15.91:0/560124399 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08680c4350 0x7f0868148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 >> 172.21.15.91:0/560124399 conn(0x7f086806d220 msgr2=0x7f086806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 shutdown_connections 2023-12-13T22:27:05.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:05.764+0000 7f0870368640 1 -- 172.21.15.91:0/560124399 wait complete. 2023-12-13T22:27:05.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-13T22:27:05.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-13T22:27:05.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi091.front.sepia.ceph.com 2023-12-13T22:27:05.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-13T22:27:05.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:05.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-13T22:27:05.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-13T22:27:05.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-13T22:27:05.780 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-13T22:27:05.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:05.780 DEBUG:teuthology.orchestra.run.smithi091:> ip addr 2023-12-13T22:27:05.785 INFO:teuthology.orchestra.run.smithi091.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-13T22:27:05.785 INFO:teuthology.orchestra.run.smithi091.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-13T22:27:05.785 INFO:teuthology.orchestra.run.smithi091.stdout: inet 127.0.0.1/8 scope host lo 2023-12-13T22:27:05.785 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 ::1/128 scope host 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c4 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f0 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:d8:d9:c5 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: altname enp7s0f1 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-13T22:27:05.786 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d4 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 0c:c4:7a:8f:d3:d5 brd ff:ff:ff:ff:ff:ff 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.21.15.91/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft 41959sec preferred_lft 41959sec 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: inet6 fe80::ec4:7aff:fe8f:d3d5/64 scope link 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: link/ether 02:42:8c:74:89:3e brd ff:ff:ff:ff:ff:ff 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-13T22:27:05.787 INFO:teuthology.orchestra.run.smithi091.stdout: valid_lft forever preferred_lft forever 2023-12-13T22:27:05.787 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-13T22:27:05.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add name ceph-brx type bridge 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr flush dev ceph-brx 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set ceph-brx up 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-13T22:27:05.788 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:27:05.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:05.868 DEBUG:teuthology.orchestra.run.smithi091:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-13T22:27:05.925 INFO:teuthology.orchestra.run.smithi091.stdout:1 2023-12-13T22:27:05.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:05.926 DEBUG:teuthology.orchestra.run.smithi091:> route 2023-12-13T22:27:05.981 INFO:teuthology.orchestra.run.smithi091.stdout:Kernel IP routing table 2023-12-13T22:27:05.981 INFO:teuthology.orchestra.run.smithi091.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-13T22:27:05.981 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-13T22:27:05.981 INFO:teuthology.orchestra.run.smithi091.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-13T22:27:05.981 INFO:teuthology.orchestra.run.smithi091.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run.smithi091.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run.smithi091.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run.smithi091.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run.smithi091.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-13T22:27:05.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:05.982 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:27:05.982 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:27:05.982 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-13T22:27:05.982 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-13T22:27:05.983 DEBUG:teuthology.orchestra.run.smithi091:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-13T22:27:05.983 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:27:06.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.059 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-12-13T22:27:06.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.105 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list-id 2023-12-13T22:27:06.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.153 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:27:06.153 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:27:06.153 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:06.153 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-13T22:27:06.153 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:27:06.222 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-13T22:27:06.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-13T22:27:06.223 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-13T22:27:06.224 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-13T22:27:06.224 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:27:06.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.316 DEBUG:teuthology.orchestra.run.smithi091:> (cd / && exec bash -c ' 2023-12-13T22:27:06.316 DEBUG:teuthology.orchestra.run.smithi091:> set -e 2023-12-13T22:27:06.316 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set brx.0 up 2023-12-13T22:27:06.316 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link set dev brx.0 master ceph-brx 2023-12-13T22:27:06.316 DEBUG:teuthology.orchestra.run.smithi091:> ') 2023-12-13T22:27:06.335 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-13T22:27:06.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T22:27:06.335 DEBUG:teuthology.orchestra.run.smithi091:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:06.381 INFO:teuthology.orchestra.run.smithi091.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-13T22:27:06.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-13T22:27:06.382 DEBUG:teuthology.orchestra.run.smithi091:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:06.428 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-13T22:27:06.428 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:06.486 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:06.533 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:06.533 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:06.533 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:06.533 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:06.534 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:06.535 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:06.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.536 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:06.586 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-13T22:27:06.586 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-13T22:27:06.634 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:06.648 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:06.698 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:06.698 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:06.698 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:06.698 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:06.699 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:06.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:06.700 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:07.846 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:07.861 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:07.911 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:07.912 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:07.913 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:07.914 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:07.914 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:07.914 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:07.914 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:07.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:07.915 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:09.062 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:09.078 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:09.126 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:09.127 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:09.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:09.129 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:10.273 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:10.309 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:10.358 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:10.359 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:10.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:10.360 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:11.506 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:11.519 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:11.565 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:11.565 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:11.565 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:11.566 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:11.567 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:11.568 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:11.568 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:11.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:11.569 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:12.718 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:12.733 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:12.781 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:12.781 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:12.782 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:12.783 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:12.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:12.784 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:13.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[46534]: starting ceph client 2023-12-13T22:27:13.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:2023-12-13T22:27:13.356+0000 68d1100 -1 init, newargv = 0x7e6f620 newargc=15 2023-12-13T22:27:13.934 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:13.949 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:13.999 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:14.000 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:14.001 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:14.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:14.002 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:14.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[46534]: starting fuse 2023-12-13T22:27:15.154 DEBUG:teuthology.orchestra.run.smithi091:> sudo modprobe fuse 2023-12-13T22:27:15.170 DEBUG:teuthology.orchestra.run.smithi091:> cat /proc/self/mounts | awk '{print $2}' 2023-12-13T22:27:15.221 INFO:teuthology.orchestra.run.smithi091.stdout:/sys 2023-12-13T22:27:15.221 INFO:teuthology.orchestra.run.smithi091.stdout:/proc 2023-12-13T22:27:15.221 INFO:teuthology.orchestra.run.smithi091.stdout:/dev 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/pts 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/run 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/ 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/security 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/shm 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/run/lock 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/cgroup 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/pstore 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/bpf 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/sys/fs/binfmt_misc 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/hugepages 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/dev/mqueue 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/debug 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/tracing 2023-12-13T22:27:15.222 INFO:teuthology.orchestra.run.smithi091.stdout:/proc/fs/nfsd 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/fs/fuse/connections 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/sys/kernel/config 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/credentials/systemd-sysusers.service 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/rpc_pipefs 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/user/1000 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-0 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-1 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-2 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/var/lib/ceph/osd/ceph-3 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:27:15.223 INFO:teuthology.orchestra.run.smithi091.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:15.224 DEBUG:teuthology.orchestra.run.smithi091:> ls /sys/fs/fuse/connections 2023-12-13T22:27:15.269 INFO:teuthology.orchestra.run.smithi091.stdout:45 2023-12-13T22:27:15.269 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> sudo stdin-killer -- python3 -c ' 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> import glob 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> import re 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> import os 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> import subprocess 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> def _find_admin_socket(client_name): 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> files = glob.glob(asok_path) 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:27:15.270 DEBUG:teuthology.orchestra.run.smithi091:> # Given a non-glob path, it better be there 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> if "*" not in asok_path: 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> assert(len(files) == 1) 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> return files[0] 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> for f in files: 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> contents = proc_f.read() 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> if mountpoint in contents: 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> return f 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> print(_find_admin_socket("client.0")) 2023-12-13T22:27:15.271 DEBUG:teuthology.orchestra.run.smithi091:> ' 2023-12-13T22:27:15.391 INFO:teuthology.orchestra.run.smithi091.stdout:/var/run/ceph/ceph-client.0.46534.asok 2023-12-13T22:27:15.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:27:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-13T22:27:15.403 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46534.asok 2023-12-13T22:27:15.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:15.403 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46534.asok status 2023-12-13T22:27:15.692 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:27:15.692 INFO:teuthology.orchestra.run.smithi091.stdout: "metadata": { 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_sha1": "021ac1670a21c19759080c6da90baaeb42e7d175", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "ceph_version": "ceph version 19.0.0-157-g021ac167 (021ac1670a21c19759080c6da90baaeb42e7d175) squid (dev)", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "entity_id": "0", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "hostname": "smithi091", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "pid": "46534", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "root": "/" 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_count": 0, 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "dentry_pinned_count": 0, 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "id": 4609, 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "inst": { 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "name": { 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "client", 2023-12-13T22:27:15.693 INFO:teuthology.orchestra.run.smithi091.stdout: "num": 4609 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 3808548952 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: } 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": { 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "type": "v1", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "addr": "192.168.0.1:0", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "nonce": 3808548952 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: }, 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "inst_str": "client.4609 192.168.0.1:0/3808548952", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "addr_str": "192.168.0.1:0/3808548952", 2023-12-13T22:27:15.694 INFO:teuthology.orchestra.run.smithi091.stdout: "inode_count": 1, 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout: "mds_epoch": 15, 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch": 31, 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout: "osd_epoch_barrier": 0, 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout: "blocklisted": false, 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout: "fs_name": "cephfs" 2023-12-13T22:27:15.695 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:27:15.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:15.710 DEBUG:teuthology.orchestra.run.smithi091:> stat --file-system '--printf=%T 2023-12-13T22:27:15.710 DEBUG:teuthology.orchestra.run.smithi091:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.799 INFO:teuthology.orchestra.run.smithi091.stdout:fuseblk 2023-12-13T22:27:15.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:27:15.800 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.870 INFO:teuthology.run_tasks:Running task workunit... 2023-12-13T22:27:15.886 INFO:tasks.workunit:Pulling workunits from ref 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:27:15.886 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-13T22:27:15.886 INFO:tasks.workunit:timeout=3h 2023-12-13T22:27:15.886 INFO:tasks.workunit:cleanup=True 2023-12-13T22:27:15.887 DEBUG:teuthology.orchestra.run.smithi091:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout:Device: 2dh/45d Inode: 1 Links: 2 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout:Modify: 2023-12-13 22:26:00.669208203 +0000 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout:Change: 2023-12-13 22:26:16.494821315 +0000 2023-12-13T22:27:15.894 INFO:teuthology.orchestra.run.smithi091.stdout: Birth: - 2023-12-13T22:27:15.895 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-13T22:27:15.895 DEBUG:teuthology.orchestra.run.smithi091:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-13T22:27:17.215 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 021ac1670a21c19759080c6da90baaeb42e7d175 2023-12-13T22:27:17.223 INFO:tasks.workunit.client.0.smithi091.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-13T22:27:29.327 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:27:29.330 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:27:59.577 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:27:59.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:28:10.924 INFO:tasks.workunit.client.0.smithi091.stderr:Note: switching to '021ac1670a21c19759080c6da90baaeb42e7d175'. 2023-12-13T22:28:10.924 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.924 INFO:tasks.workunit.client.0.smithi091.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-13T22:28:10.924 INFO:tasks.workunit.client.0.smithi091.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:state without impacting any branches by switching back to a branch. 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: git switch -c 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:Or undo this operation with: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: git switch - 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr: 2023-12-13T22:28:10.925 INFO:tasks.workunit.client.0.smithi091.stderr:HEAD is now at 021ac1670a2 Merge branch 'wip-63713' of https://github.com/vshankar/ceph into wip-yuri10-testing-2023-12-12-1229 2023-12-13T22:28:10.929 DEBUG:teuthology.orchestra.run.smithi091:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-13T22:28:10.936 INFO:tasks.workunit.client.0.smithi091.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-13T22:28:10.940 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-13T22:28:10.940 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-13T22:28:11.810 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-13T22:28:11.896 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-13T22:28:11.952 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-13T22:28:11.953 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-13T22:28:11.953 INFO:tasks.workunit.client.0.smithi091.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-13T22:28:12.001 INFO:tasks.workunit.client.0.smithi091.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-13T22:28:12.004 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:28:12.004 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-13T22:28:12.052 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-13T22:28:12.053 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-13T22:28:12.054 DEBUG:teuthology.orchestra.run.smithi091:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=021ac1670a21c19759080c6da90baaeb42e7d175 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-13T22:28:12.573 INFO:tasks.workunit.client.0.smithi091.stderr:+ dbench 1 2023-12-13T22:28:12.581 INFO:tasks.workunit.client.0.smithi091.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-13T22:28:12.581 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:28:12.582 INFO:tasks.workunit.client.0.smithi091.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-13T22:28:12.584 INFO:tasks.workunit.client.0.smithi091.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-13T22:28:12.684 INFO:tasks.workunit.client.0.smithi091.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-13T22:28:12.684 INFO:tasks.workunit.client.0.smithi091.stdout:releasing clients 2023-12-13T22:28:13.684 INFO:tasks.workunit.client.0.smithi091.stdout: 0 8 0.00 MB/sec warmup 1 sec latency 115.983 ms 2023-12-13T22:28:14.684 INFO:tasks.workunit.client.0.smithi091.stdout: 0 12 0.00 MB/sec warmup 2 sec latency 168.138 ms 2023-12-13T22:28:15.684 INFO:tasks.workunit.client.0.smithi091.stdout: 1 51 0.70 MB/sec warmup 3 sec latency 447.190 ms 2023-12-13T22:28:16.684 INFO:tasks.workunit.client.0.smithi091.stdout: 1 74 0.79 MB/sec warmup 4 sec latency 431.176 ms 2023-12-13T22:28:17.684 INFO:tasks.workunit.client.0.smithi091.stdout: 1 111 1.05 MB/sec warmup 5 sec latency 414.502 ms 2023-12-13T22:28:18.684 INFO:tasks.workunit.client.0.smithi091.stdout: 1 129 0.96 MB/sec warmup 6 sec latency 468.558 ms 2023-12-13T22:28:19.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 139 0.86 MB/sec warmup 7 sec latency 401.960 ms 2023-12-13T22:28:20.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 155 0.82 MB/sec warmup 8 sec latency 524.215 ms 2023-12-13T22:28:21.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 165 0.76 MB/sec warmup 9 sec latency 631.539 ms 2023-12-13T22:28:22.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 181 0.73 MB/sec warmup 10 sec latency 925.715 ms 2023-12-13T22:28:23.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 197 0.71 MB/sec warmup 11 sec latency 506.676 ms 2023-12-13T22:28:24.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 207 0.68 MB/sec warmup 12 sec latency 518.549 ms 2023-12-13T22:28:25.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 223 0.66 MB/sec warmup 13 sec latency 564.743 ms 2023-12-13T22:28:26.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 231 0.63 MB/sec warmup 14 sec latency 504.025 ms 2023-12-13T22:28:27.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 247 0.63 MB/sec warmup 15 sec latency 627.925 ms 2023-12-13T22:28:28.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 255 0.60 MB/sec warmup 16 sec latency 630.070 ms 2023-12-13T22:28:29.620 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:28:29.623 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:28:29.685 INFO:tasks.workunit.client.0.smithi091.stdout: 1 271 0.60 MB/sec warmup 17 sec latency 821.896 ms 2023-12-13T22:28:30.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 287 0.59 MB/sec warmup 18 sec latency 472.550 ms 2023-12-13T22:28:31.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 297 0.58 MB/sec warmup 19 sec latency 428.726 ms 2023-12-13T22:28:32.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 310 0.57 MB/sec warmup 20 sec latency 910.635 ms 2023-12-13T22:28:33.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 323 0.56 MB/sec warmup 21 sec latency 525.902 ms 2023-12-13T22:28:34.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 339 0.56 MB/sec warmup 22 sec latency 594.063 ms 2023-12-13T22:28:35.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 349 0.54 MB/sec warmup 23 sec latency 514.060 ms 2023-12-13T22:28:36.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 365 0.54 MB/sec warmup 24 sec latency 546.103 ms 2023-12-13T22:28:37.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 380 0.54 MB/sec warmup 25 sec latency 500.091 ms 2023-12-13T22:28:38.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 389 0.53 MB/sec warmup 26 sec latency 601.570 ms 2023-12-13T22:28:39.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 405 0.53 MB/sec warmup 27 sec latency 604.363 ms 2023-12-13T22:28:40.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 413 0.52 MB/sec warmup 28 sec latency 568.841 ms 2023-12-13T22:28:41.686 INFO:tasks.workunit.client.0.smithi091.stdout: 1 429 0.52 MB/sec warmup 29 sec latency 656.093 ms 2023-12-13T22:28:42.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 437 0.51 MB/sec warmup 30 sec latency 539.459 ms 2023-12-13T22:28:43.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 445 0.50 MB/sec warmup 31 sec latency 784.442 ms 2023-12-13T22:28:44.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 451 0.50 MB/sec warmup 32 sec latency 1712.810 ms 2023-12-13T22:28:45.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 461 0.49 MB/sec warmup 33 sec latency 913.606 ms 2023-12-13T22:28:46.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 469 0.48 MB/sec warmup 34 sec latency 699.147 ms 2023-12-13T22:28:47.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 477 0.48 MB/sec warmup 35 sec latency 857.056 ms 2023-12-13T22:28:48.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 486 0.47 MB/sec warmup 36 sec latency 660.761 ms 2023-12-13T22:28:49.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 501 0.47 MB/sec warmup 37 sec latency 667.360 ms 2023-12-13T22:28:50.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 511 0.47 MB/sec warmup 38 sec latency 613.435 ms 2023-12-13T22:28:51.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 533 0.48 MB/sec warmup 39 sec latency 532.411 ms 2023-12-13T22:28:52.687 INFO:tasks.workunit.client.0.smithi091.stdout: 1 603 0.52 MB/sec warmup 40 sec latency 390.190 ms 2023-12-13T22:28:53.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 606 0.51 MB/sec warmup 41 sec latency 918.304 ms 2023-12-13T22:28:54.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 609 0.50 MB/sec warmup 42 sec latency 737.860 ms 2023-12-13T22:28:55.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 614 0.49 MB/sec warmup 43 sec latency 966.848 ms 2023-12-13T22:28:56.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 614 0.48 MB/sec warmup 44 sec latency 1016.746 ms 2023-12-13T22:28:57.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 642 0.47 MB/sec warmup 45 sec latency 1719.139 ms 2023-12-13T22:28:58.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 644 0.46 MB/sec warmup 46 sec latency 859.582 ms 2023-12-13T22:28:59.679 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:28:59.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:28:59.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 645 0.45 MB/sec warmup 47 sec latency 1024.565 ms 2023-12-13T22:29:00.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 649 0.44 MB/sec warmup 48 sec latency 973.187 ms 2023-12-13T22:29:01.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 653 0.43 MB/sec warmup 49 sec latency 1004.030 ms 2023-12-13T22:29:02.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 653 0.42 MB/sec warmup 50 sec latency 1066.473 ms 2023-12-13T22:29:03.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 661 0.41 MB/sec warmup 51 sec latency 1097.193 ms 2023-12-13T22:29:04.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 680 0.41 MB/sec warmup 52 sec latency 285.869 ms 2023-12-13T22:29:05.688 INFO:tasks.workunit.client.0.smithi091.stdout: 1 681 0.40 MB/sec warmup 53 sec latency 1037.843 ms 2023-12-13T22:29:06.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 682 0.39 MB/sec warmup 54 sec latency 931.696 ms 2023-12-13T22:29:07.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 699 0.39 MB/sec warmup 55 sec latency 1088.658 ms 2023-12-13T22:29:08.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 706 0.38 MB/sec warmup 56 sec latency 483.065 ms 2023-12-13T22:29:09.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 711 0.37 MB/sec warmup 57 sec latency 592.765 ms 2023-12-13T22:29:10.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 718 0.37 MB/sec warmup 58 sec latency 626.045 ms 2023-12-13T22:29:11.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 740 0.36 MB/sec warmup 59 sec latency 488.319 ms 2023-12-13T22:29:12.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 744 0.36 MB/sec warmup 60 sec latency 599.133 ms 2023-12-13T22:29:13.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 746 0.35 MB/sec warmup 61 sec latency 918.302 ms 2023-12-13T22:29:14.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 747 0.34 MB/sec warmup 62 sec latency 976.246 ms 2023-12-13T22:29:15.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 771 0.34 MB/sec warmup 63 sec latency 543.444 ms 2023-12-13T22:29:16.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 778 0.33 MB/sec warmup 64 sec latency 277.646 ms 2023-12-13T22:29:17.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 780 0.33 MB/sec warmup 65 sec latency 652.145 ms 2023-12-13T22:29:18.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 798 0.33 MB/sec warmup 66 sec latency 321.330 ms 2023-12-13T22:29:19.689 INFO:tasks.workunit.client.0.smithi091.stdout: 1 812 0.32 MB/sec warmup 67 sec latency 287.268 ms 2023-12-13T22:29:20.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 813 0.32 MB/sec warmup 68 sec latency 903.540 ms 2023-12-13T22:29:21.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 815 0.31 MB/sec warmup 69 sec latency 1024.644 ms 2023-12-13T22:29:22.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 818 0.31 MB/sec warmup 70 sec latency 544.807 ms 2023-12-13T22:29:23.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 823 0.30 MB/sec warmup 71 sec latency 891.007 ms 2023-12-13T22:29:24.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 853 0.30 MB/sec warmup 72 sec latency 960.790 ms 2023-12-13T22:29:25.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 854 0.30 MB/sec warmup 73 sec latency 971.033 ms 2023-12-13T22:29:26.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 857 0.29 MB/sec warmup 74 sec latency 984.469 ms 2023-12-13T22:29:27.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 862 0.29 MB/sec warmup 75 sec latency 534.350 ms 2023-12-13T22:29:28.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 863 0.28 MB/sec warmup 76 sec latency 963.017 ms 2023-12-13T22:29:29.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 870 0.28 MB/sec warmup 77 sec latency 560.560 ms 2023-12-13T22:29:29.801 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:29:29.804 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:29:30.690 INFO:tasks.workunit.client.0.smithi091.stdout: 1 880 0.28 MB/sec warmup 78 sec latency 676.528 ms 2023-12-13T22:29:31.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 894 0.27 MB/sec warmup 79 sec latency 951.061 ms 2023-12-13T22:29:32.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 902 0.27 MB/sec warmup 80 sec latency 320.852 ms 2023-12-13T22:29:33.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 903 0.27 MB/sec warmup 81 sec latency 618.473 ms 2023-12-13T22:29:34.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 916 0.27 MB/sec warmup 82 sec latency 610.301 ms 2023-12-13T22:29:35.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 927 0.26 MB/sec warmup 83 sec latency 328.417 ms 2023-12-13T22:29:36.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 928 0.26 MB/sec warmup 84 sec latency 915.606 ms 2023-12-13T22:29:37.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 929 0.26 MB/sec warmup 85 sec latency 1278.562 ms 2023-12-13T22:29:38.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 931 0.25 MB/sec warmup 86 sec latency 519.697 ms 2023-12-13T22:29:39.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 933 0.25 MB/sec warmup 87 sec latency 1009.304 ms 2023-12-13T22:29:40.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 937 0.25 MB/sec warmup 88 sec latency 513.755 ms 2023-12-13T22:29:41.691 INFO:tasks.workunit.client.0.smithi091.stdout: 1 942 0.24 MB/sec warmup 89 sec latency 1029.444 ms 2023-12-13T22:29:42.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 955 0.24 MB/sec warmup 90 sec latency 988.875 ms 2023-12-13T22:29:43.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 965 0.24 MB/sec warmup 91 sec latency 319.361 ms 2023-12-13T22:29:44.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 970 0.24 MB/sec warmup 92 sec latency 546.779 ms 2023-12-13T22:29:45.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 977 0.24 MB/sec warmup 93 sec latency 607.111 ms 2023-12-13T22:29:46.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 994 0.23 MB/sec warmup 94 sec latency 248.234 ms 2023-12-13T22:29:47.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 995 0.23 MB/sec warmup 95 sec latency 1119.630 ms 2023-12-13T22:29:48.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1023 0.24 MB/sec warmup 96 sec latency 436.839 ms 2023-12-13T22:29:49.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1028 0.24 MB/sec warmup 97 sec latency 916.653 ms 2023-12-13T22:29:50.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1033 0.23 MB/sec warmup 98 sec latency 489.350 ms 2023-12-13T22:29:51.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1037 0.23 MB/sec warmup 99 sec latency 1070.263 ms 2023-12-13T22:29:52.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1046 0.23 MB/sec warmup 100 sec latency 465.568 ms 2023-12-13T22:29:53.692 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1047 0.23 MB/sec warmup 101 sec latency 1004.855 ms 2023-12-13T22:29:54.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1048 0.22 MB/sec warmup 102 sec latency 965.674 ms 2023-12-13T22:29:55.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1050 0.22 MB/sec warmup 103 sec latency 1017.607 ms 2023-12-13T22:29:56.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1053 0.22 MB/sec warmup 104 sec latency 664.474 ms 2023-12-13T22:29:57.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1061 0.22 MB/sec warmup 105 sec latency 484.762 ms 2023-12-13T22:29:58.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1071 0.22 MB/sec warmup 106 sec latency 526.925 ms 2023-12-13T22:29:59.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1085 0.21 MB/sec warmup 107 sec latency 433.473 ms 2023-12-13T22:30:00.151 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:30:00.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:30:00.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1088 0.21 MB/sec warmup 108 sec latency 720.668 ms 2023-12-13T22:30:01.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1099 0.21 MB/sec warmup 109 sec latency 1006.325 ms 2023-12-13T22:30:02.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1100 0.21 MB/sec warmup 110 sec latency 655.959 ms 2023-12-13T22:30:03.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1113 0.21 MB/sec warmup 111 sec latency 987.414 ms 2023-12-13T22:30:04.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1116 0.21 MB/sec warmup 112 sec latency 964.951 ms 2023-12-13T22:30:05.693 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1126 0.20 MB/sec warmup 113 sec latency 332.517 ms 2023-12-13T22:30:06.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1135 0.20 MB/sec warmup 114 sec latency 470.992 ms 2023-12-13T22:30:07.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1147 0.20 MB/sec warmup 115 sec latency 440.031 ms 2023-12-13T22:30:08.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1156 0.20 MB/sec warmup 116 sec latency 576.824 ms 2023-12-13T22:30:09.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1157 0.20 MB/sec warmup 117 sec latency 882.837 ms 2023-12-13T22:30:10.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1168 0.20 MB/sec warmup 118 sec latency 971.571 ms 2023-12-13T22:30:11.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1169 0.19 MB/sec warmup 119 sec latency 1199.287 ms 2023-12-13T22:30:13.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1171 0.00 MB/sec execute 1 sec latency 992.355 ms 2023-12-13T22:30:14.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1175 0.00 MB/sec execute 2 sec latency 534.628 ms 2023-12-13T22:30:15.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1179 0.00 MB/sec execute 3 sec latency 499.182 ms 2023-12-13T22:30:16.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1189 0.01 MB/sec execute 4 sec latency 522.973 ms 2023-12-13T22:30:17.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1201 0.01 MB/sec execute 5 sec latency 437.984 ms 2023-12-13T22:30:18.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1204 0.01 MB/sec execute 6 sec latency 806.317 ms 2023-12-13T22:30:19.694 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1214 0.01 MB/sec execute 7 sec latency 975.512 ms 2023-12-13T22:30:20.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1225 0.01 MB/sec execute 8 sec latency 557.263 ms 2023-12-13T22:30:21.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1232 0.01 MB/sec execute 9 sec latency 459.933 ms 2023-12-13T22:30:22.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1244 0.01 MB/sec execute 10 sec latency 426.043 ms 2023-12-13T22:30:23.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1248 0.01 MB/sec execute 11 sec latency 585.600 ms 2023-12-13T22:30:24.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1252 0.01 MB/sec execute 12 sec latency 982.611 ms 2023-12-13T22:30:25.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1257 0.01 MB/sec execute 13 sec latency 342.215 ms 2023-12-13T22:30:26.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1274 0.01 MB/sec execute 14 sec latency 283.282 ms 2023-12-13T22:30:27.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1278 0.01 MB/sec execute 15 sec latency 538.037 ms 2023-12-13T22:30:28.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1280 0.01 MB/sec execute 16 sec latency 1010.064 ms 2023-12-13T22:30:29.695 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1281 0.01 MB/sec execute 17 sec latency 902.745 ms 2023-12-13T22:30:30.195 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:30:30.199 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:30:30.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1284 0.01 MB/sec execute 18 sec latency 894.972 ms 2023-12-13T22:30:31.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1376 0.16 MB/sec execute 19 sec latency 985.646 ms 2023-12-13T22:30:32.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1377 0.15 MB/sec execute 20 sec latency 986.198 ms 2023-12-13T22:30:33.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1378 0.14 MB/sec execute 21 sec latency 982.816 ms 2023-12-13T22:30:34.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1381 0.14 MB/sec execute 22 sec latency 606.415 ms 2023-12-13T22:30:35.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1385 0.13 MB/sec execute 23 sec latency 936.286 ms 2023-12-13T22:30:36.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1387 0.12 MB/sec execute 24 sec latency 1030.691 ms 2023-12-13T22:30:37.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1396 0.12 MB/sec execute 25 sec latency 287.256 ms 2023-12-13T22:30:38.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1397 0.12 MB/sec execute 26 sec latency 674.129 ms 2023-12-13T22:30:39.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1403 0.11 MB/sec execute 27 sec latency 924.542 ms 2023-12-13T22:30:40.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1417 0.11 MB/sec execute 28 sec latency 560.469 ms 2023-12-13T22:30:41.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1419 0.10 MB/sec execute 29 sec latency 1014.553 ms 2023-12-13T22:30:42.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1428 0.10 MB/sec execute 30 sec latency 374.969 ms 2023-12-13T22:30:43.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1443 0.10 MB/sec execute 31 sec latency 348.259 ms 2023-12-13T22:30:44.696 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1446 0.09 MB/sec execute 32 sec latency 541.627 ms 2023-12-13T22:30:45.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1448 0.09 MB/sec execute 33 sec latency 913.368 ms 2023-12-13T22:30:46.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1463 0.09 MB/sec execute 34 sec latency 1006.659 ms 2023-12-13T22:30:47.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1466 0.09 MB/sec execute 35 sec latency 389.250 ms 2023-12-13T22:30:48.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1474 0.08 MB/sec execute 36 sec latency 966.795 ms 2023-12-13T22:30:49.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1485 0.08 MB/sec execute 37 sec latency 675.626 ms 2023-12-13T22:30:50.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1488 0.08 MB/sec execute 38 sec latency 980.688 ms 2023-12-13T22:30:51.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1490 0.08 MB/sec execute 39 sec latency 527.190 ms 2023-12-13T22:30:52.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1499 0.08 MB/sec execute 40 sec latency 947.982 ms 2023-12-13T22:30:53.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1504 0.07 MB/sec execute 41 sec latency 413.491 ms 2023-12-13T22:30:54.697 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1516 0.07 MB/sec execute 42 sec latency 388.325 ms 2023-12-13T22:30:55.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1524 0.07 MB/sec execute 43 sec latency 371.649 ms 2023-12-13T22:30:56.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1526 0.07 MB/sec execute 44 sec latency 815.756 ms 2023-12-13T22:30:57.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1530 0.07 MB/sec execute 45 sec latency 1074.181 ms 2023-12-13T22:30:58.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1551 0.07 MB/sec execute 46 sec latency 933.988 ms 2023-12-13T22:30:59.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1555 0.07 MB/sec execute 47 sec latency 683.850 ms 2023-12-13T22:31:00.297 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:31:00.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:31:00.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1556 0.06 MB/sec execute 48 sec latency 964.844 ms 2023-12-13T22:31:01.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1572 0.06 MB/sec execute 49 sec latency 149.357 ms 2023-12-13T22:31:02.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1586 0.06 MB/sec execute 50 sec latency 173.512 ms 2023-12-13T22:31:03.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1589 0.06 MB/sec execute 51 sec latency 374.168 ms 2023-12-13T22:31:04.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1591 0.06 MB/sec execute 52 sec latency 995.913 ms 2023-12-13T22:31:05.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1606 0.06 MB/sec execute 53 sec latency 405.014 ms 2023-12-13T22:31:06.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1610 0.06 MB/sec execute 54 sec latency 994.981 ms 2023-12-13T22:31:07.698 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1612 0.06 MB/sec execute 55 sec latency 977.047 ms 2023-12-13T22:31:08.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1617 0.06 MB/sec execute 56 sec latency 366.497 ms 2023-12-13T22:31:09.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1619 0.06 MB/sec execute 57 sec latency 1011.101 ms 2023-12-13T22:31:10.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1641 0.05 MB/sec execute 58 sec latency 336.555 ms 2023-12-13T22:31:11.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1643 0.05 MB/sec execute 59 sec latency 1067.835 ms 2023-12-13T22:31:12.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1644 0.05 MB/sec execute 60 sec latency 601.675 ms 2023-12-13T22:31:13.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1653 0.05 MB/sec execute 61 sec latency 965.853 ms 2023-12-13T22:31:14.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1662 0.05 MB/sec execute 62 sec latency 572.922 ms 2023-12-13T22:31:15.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1683 0.05 MB/sec execute 63 sec latency 406.613 ms 2023-12-13T22:31:16.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1687 0.05 MB/sec execute 64 sec latency 793.101 ms 2023-12-13T22:31:17.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1691 0.05 MB/sec execute 65 sec latency 561.326 ms 2023-12-13T22:31:18.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1701 0.05 MB/sec execute 66 sec latency 389.221 ms 2023-12-13T22:31:19.699 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1703 0.05 MB/sec execute 67 sec latency 996.524 ms 2023-12-13T22:31:20.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1707 0.05 MB/sec execute 68 sec latency 866.942 ms 2023-12-13T22:31:21.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1721 0.05 MB/sec execute 69 sec latency 987.485 ms 2023-12-13T22:31:22.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1749 0.05 MB/sec execute 70 sec latency 134.207 ms 2023-12-13T22:31:23.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1769 0.05 MB/sec execute 71 sec latency 353.715 ms 2023-12-13T22:31:24.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1772 0.05 MB/sec execute 72 sec latency 609.796 ms 2023-12-13T22:31:25.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1775 0.04 MB/sec execute 73 sec latency 931.477 ms 2023-12-13T22:31:26.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1802 0.04 MB/sec execute 74 sec latency 167.550 ms 2023-12-13T22:31:27.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1806 0.04 MB/sec execute 75 sec latency 330.839 ms 2023-12-13T22:31:28.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1808 0.04 MB/sec execute 76 sec latency 939.867 ms 2023-12-13T22:31:29.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1822 0.04 MB/sec execute 77 sec latency 429.893 ms 2023-12-13T22:31:30.584 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:31:30.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:31:30.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1823 0.04 MB/sec execute 78 sec latency 1017.081 ms 2023-12-13T22:31:31.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1826 0.04 MB/sec execute 79 sec latency 953.348 ms 2023-12-13T22:31:32.700 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1838 0.04 MB/sec execute 80 sec latency 1072.964 ms 2023-12-13T22:31:33.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1841 0.04 MB/sec execute 81 sec latency 406.905 ms 2023-12-13T22:31:34.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1849 0.04 MB/sec execute 82 sec latency 947.041 ms 2023-12-13T22:31:35.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1858 0.04 MB/sec execute 83 sec latency 430.208 ms 2023-12-13T22:31:36.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1862 0.04 MB/sec execute 84 sec latency 935.585 ms 2023-12-13T22:31:37.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1866 0.04 MB/sec execute 85 sec latency 934.204 ms 2023-12-13T22:31:38.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1869 0.04 MB/sec execute 86 sec latency 331.994 ms 2023-12-13T22:31:39.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1877 0.04 MB/sec execute 87 sec latency 968.490 ms 2023-12-13T22:31:40.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1898 0.04 MB/sec execute 88 sec latency 401.819 ms 2023-12-13T22:31:41.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1903 0.04 MB/sec execute 89 sec latency 1018.341 ms 2023-12-13T22:31:42.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1909 0.04 MB/sec execute 90 sec latency 935.913 ms 2023-12-13T22:31:43.701 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1912 0.04 MB/sec execute 91 sec latency 532.127 ms 2023-12-13T22:31:44.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1920 0.04 MB/sec execute 92 sec latency 1011.585 ms 2023-12-13T22:31:45.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1934 0.04 MB/sec execute 93 sec latency 941.180 ms 2023-12-13T22:31:46.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1961 0.04 MB/sec execute 94 sec latency 349.609 ms 2023-12-13T22:31:47.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1973 0.04 MB/sec execute 95 sec latency 296.073 ms 2023-12-13T22:31:48.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1975 0.04 MB/sec execute 96 sec latency 720.734 ms 2023-12-13T22:31:49.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1978 0.04 MB/sec execute 97 sec latency 1018.642 ms 2023-12-13T22:31:50.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1997 0.04 MB/sec execute 98 sec latency 196.148 ms 2023-12-13T22:31:51.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 1998 0.04 MB/sec execute 99 sec latency 1053.775 ms 2023-12-13T22:31:52.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2014 0.04 MB/sec execute 100 sec latency 177.767 ms 2023-12-13T22:31:53.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2031 0.04 MB/sec execute 101 sec latency 154.486 ms 2023-12-13T22:31:54.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2034 0.03 MB/sec execute 102 sec latency 719.469 ms 2023-12-13T22:31:55.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2043 0.03 MB/sec execute 103 sec latency 954.794 ms 2023-12-13T22:31:56.702 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2051 0.03 MB/sec execute 104 sec latency 1007.987 ms 2023-12-13T22:31:57.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2053 0.03 MB/sec execute 105 sec latency 1067.083 ms 2023-12-13T22:31:58.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2056 0.03 MB/sec execute 106 sec latency 978.442 ms 2023-12-13T22:31:59.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2061 0.03 MB/sec execute 107 sec latency 345.998 ms 2023-12-13T22:32:00.696 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:32:00.700 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:32:00.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2063 0.03 MB/sec execute 108 sec latency 984.987 ms 2023-12-13T22:32:01.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2079 0.03 MB/sec execute 109 sec latency 398.254 ms 2023-12-13T22:32:02.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2081 0.03 MB/sec execute 110 sec latency 1035.316 ms 2023-12-13T22:32:03.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2088 0.03 MB/sec execute 111 sec latency 973.017 ms 2023-12-13T22:32:04.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2093 0.03 MB/sec execute 112 sec latency 470.478 ms 2023-12-13T22:32:05.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2096 0.03 MB/sec execute 113 sec latency 1007.227 ms 2023-12-13T22:32:06.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2104 0.03 MB/sec execute 114 sec latency 947.415 ms 2023-12-13T22:32:07.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2138 0.03 MB/sec execute 115 sec latency 345.336 ms 2023-12-13T22:32:08.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2140 0.03 MB/sec execute 116 sec latency 640.949 ms 2023-12-13T22:32:09.703 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2146 0.03 MB/sec execute 117 sec latency 976.568 ms 2023-12-13T22:32:10.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2166 0.03 MB/sec execute 118 sec latency 890.182 ms 2023-12-13T22:32:11.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2173 0.03 MB/sec execute 119 sec latency 843.626 ms 2023-12-13T22:32:12.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2175 0.03 MB/sec execute 120 sec latency 1132.437 ms 2023-12-13T22:32:13.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2179 0.03 MB/sec execute 121 sec latency 960.524 ms 2023-12-13T22:32:14.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2183 0.03 MB/sec execute 122 sec latency 388.903 ms 2023-12-13T22:32:15.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2191 0.03 MB/sec execute 123 sec latency 985.614 ms 2023-12-13T22:32:16.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2201 0.03 MB/sec execute 124 sec latency 358.816 ms 2023-12-13T22:32:17.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2216 0.03 MB/sec execute 125 sec latency 340.463 ms 2023-12-13T22:32:18.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2221 0.03 MB/sec execute 126 sec latency 879.877 ms 2023-12-13T22:32:19.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2248 0.03 MB/sec execute 127 sec latency 980.669 ms 2023-12-13T22:32:20.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2273 0.03 MB/sec execute 128 sec latency 334.303 ms 2023-12-13T22:32:21.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2292 0.04 MB/sec execute 129 sec latency 479.407 ms 2023-12-13T22:32:22.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2294 0.04 MB/sec execute 130 sec latency 971.504 ms 2023-12-13T22:32:23.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2303 0.04 MB/sec execute 131 sec latency 292.795 ms 2023-12-13T22:32:24.704 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2306 0.04 MB/sec execute 132 sec latency 1001.979 ms 2023-12-13T22:32:25.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2306 0.04 MB/sec execute 133 sec latency 1022.968 ms 2023-12-13T22:32:26.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2307 0.04 MB/sec execute 134 sec latency 1123.472 ms 2023-12-13T22:32:27.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2321 0.04 MB/sec execute 135 sec latency 1097.176 ms 2023-12-13T22:32:28.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2324 0.04 MB/sec execute 136 sec latency 963.999 ms 2023-12-13T22:32:29.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2330 0.04 MB/sec execute 137 sec latency 992.103 ms 2023-12-13T22:32:30.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2335 0.03 MB/sec execute 138 sec latency 499.902 ms 2023-12-13T22:32:30.785 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:32:30.788 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:32:31.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2337 0.03 MB/sec execute 139 sec latency 1068.377 ms 2023-12-13T22:32:32.705 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2340 0.03 MB/sec execute 140 sec latency 687.294 ms 2023-12-13T22:32:33.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2353 0.03 MB/sec execute 141 sec latency 981.950 ms 2023-12-13T22:32:34.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2359 0.03 MB/sec execute 142 sec latency 431.416 ms 2023-12-13T22:32:35.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2361 0.03 MB/sec execute 143 sec latency 827.390 ms 2023-12-13T22:32:36.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2362 0.03 MB/sec execute 144 sec latency 1003.781 ms 2023-12-13T22:32:37.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2364 0.03 MB/sec execute 145 sec latency 1012.177 ms 2023-12-13T22:32:38.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2366 0.03 MB/sec execute 146 sec latency 995.276 ms 2023-12-13T22:32:39.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2371 0.03 MB/sec execute 147 sec latency 962.924 ms 2023-12-13T22:32:40.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2373 0.03 MB/sec execute 148 sec latency 905.201 ms 2023-12-13T22:32:41.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2388 0.03 MB/sec execute 149 sec latency 316.058 ms 2023-12-13T22:32:42.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2389 0.03 MB/sec execute 150 sec latency 578.585 ms 2023-12-13T22:32:43.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2393 0.03 MB/sec execute 151 sec latency 973.862 ms 2023-12-13T22:32:44.706 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2398 0.03 MB/sec execute 152 sec latency 313.693 ms 2023-12-13T22:32:45.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2401 0.03 MB/sec execute 153 sec latency 457.860 ms 2023-12-13T22:32:46.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2407 0.03 MB/sec execute 154 sec latency 553.875 ms 2023-12-13T22:32:47.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2410 0.03 MB/sec execute 155 sec latency 965.458 ms 2023-12-13T22:32:48.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2424 0.03 MB/sec execute 156 sec latency 1054.748 ms 2023-12-13T22:32:49.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2429 0.03 MB/sec execute 157 sec latency 540.705 ms 2023-12-13T22:32:50.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2431 0.03 MB/sec execute 158 sec latency 671.555 ms 2023-12-13T22:32:51.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2432 0.03 MB/sec execute 159 sec latency 932.556 ms 2023-12-13T22:32:52.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2438 0.03 MB/sec execute 160 sec latency 915.303 ms 2023-12-13T22:32:53.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2440 0.03 MB/sec execute 161 sec latency 449.959 ms 2023-12-13T22:32:54.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2448 0.03 MB/sec execute 162 sec latency 555.230 ms 2023-12-13T22:32:55.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2452 0.03 MB/sec execute 163 sec latency 315.666 ms 2023-12-13T22:32:56.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2463 0.03 MB/sec execute 164 sec latency 511.713 ms 2023-12-13T22:32:57.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2470 0.03 MB/sec execute 165 sec latency 574.412 ms 2023-12-13T22:32:58.707 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2473 0.03 MB/sec execute 166 sec latency 843.897 ms 2023-12-13T22:32:59.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2489 0.03 MB/sec execute 167 sec latency 294.877 ms 2023-12-13T22:33:00.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2490 0.03 MB/sec execute 168 sec latency 551.968 ms 2023-12-13T22:33:01.024 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:33:01.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:33:01.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2494 0.03 MB/sec execute 169 sec latency 972.457 ms 2023-12-13T22:33:02.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2495 0.03 MB/sec execute 170 sec latency 1016.852 ms 2023-12-13T22:33:03.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2503 0.03 MB/sec execute 171 sec latency 294.846 ms 2023-12-13T22:33:04.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2506 0.03 MB/sec execute 172 sec latency 838.480 ms 2023-12-13T22:33:05.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2549 0.03 MB/sec execute 173 sec latency 931.724 ms 2023-12-13T22:33:06.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2553 0.03 MB/sec execute 174 sec latency 936.728 ms 2023-12-13T22:33:07.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2558 0.03 MB/sec execute 175 sec latency 476.631 ms 2023-12-13T22:33:08.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2560 0.03 MB/sec execute 176 sec latency 478.881 ms 2023-12-13T22:33:09.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2563 0.03 MB/sec execute 177 sec latency 986.431 ms 2023-12-13T22:33:10.708 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2576 0.03 MB/sec execute 178 sec latency 370.845 ms 2023-12-13T22:33:11.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2580 0.03 MB/sec execute 179 sec latency 520.956 ms 2023-12-13T22:33:12.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2581 0.03 MB/sec execute 180 sec latency 983.087 ms 2023-12-13T22:33:13.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2583 0.03 MB/sec execute 181 sec latency 879.318 ms 2023-12-13T22:33:14.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2592 0.03 MB/sec execute 182 sec latency 355.476 ms 2023-12-13T22:33:15.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2597 0.03 MB/sec execute 183 sec latency 533.143 ms 2023-12-13T22:33:16.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2600 0.03 MB/sec execute 184 sec latency 605.962 ms 2023-12-13T22:33:17.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2603 0.03 MB/sec execute 185 sec latency 1148.361 ms 2023-12-13T22:33:18.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2608 0.03 MB/sec execute 186 sec latency 317.469 ms 2023-12-13T22:33:19.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2615 0.03 MB/sec execute 187 sec latency 513.652 ms 2023-12-13T22:33:20.709 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2617 0.03 MB/sec execute 188 sec latency 983.077 ms 2023-12-13T22:33:21.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2618 0.03 MB/sec execute 189 sec latency 1111.603 ms 2023-12-13T22:33:22.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2621 0.03 MB/sec execute 190 sec latency 925.680 ms 2023-12-13T22:33:23.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2633 0.03 MB/sec execute 191 sec latency 1008.130 ms 2023-12-13T22:33:24.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2718 0.05 MB/sec execute 192 sec latency 247.610 ms 2023-12-13T22:33:25.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2719 0.05 MB/sec execute 193 sec latency 878.669 ms 2023-12-13T22:33:26.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2745 0.05 MB/sec execute 194 sec latency 896.514 ms 2023-12-13T22:33:27.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2752 0.05 MB/sec execute 195 sec latency 959.761 ms 2023-12-13T22:33:28.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2760 0.05 MB/sec execute 196 sec latency 374.099 ms 2023-12-13T22:33:29.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2761 0.05 MB/sec execute 197 sec latency 957.485 ms 2023-12-13T22:33:30.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2770 0.05 MB/sec execute 198 sec latency 471.330 ms 2023-12-13T22:33:31.120 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:33:31.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:33:31.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2776 0.04 MB/sec execute 199 sec latency 595.922 ms 2023-12-13T22:33:32.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2780 0.04 MB/sec execute 200 sec latency 496.351 ms 2023-12-13T22:33:33.710 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2796 0.04 MB/sec execute 201 sec latency 964.746 ms 2023-12-13T22:33:34.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2872 0.05 MB/sec execute 202 sec latency 832.054 ms 2023-12-13T22:33:35.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2878 0.05 MB/sec execute 203 sec latency 936.030 ms 2023-12-13T22:33:36.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2881 0.05 MB/sec execute 204 sec latency 510.445 ms 2023-12-13T22:33:37.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2897 0.05 MB/sec execute 205 sec latency 577.880 ms 2023-12-13T22:33:38.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2902 0.05 MB/sec execute 206 sec latency 310.906 ms 2023-12-13T22:33:39.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2917 0.05 MB/sec execute 207 sec latency 591.788 ms 2023-12-13T22:33:40.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2925 0.05 MB/sec execute 208 sec latency 587.985 ms 2023-12-13T22:33:41.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2929 0.05 MB/sec execute 209 sec latency 460.355 ms 2023-12-13T22:33:42.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2932 0.05 MB/sec execute 210 sec latency 537.685 ms 2023-12-13T22:33:43.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2938 0.05 MB/sec execute 211 sec latency 507.366 ms 2023-12-13T22:33:44.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2966 0.05 MB/sec execute 212 sec latency 939.264 ms 2023-12-13T22:33:45.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2969 0.05 MB/sec execute 213 sec latency 940.927 ms 2023-12-13T22:33:46.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2974 0.05 MB/sec execute 214 sec latency 315.562 ms 2023-12-13T22:33:47.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2974 0.05 MB/sec execute 215 sec latency 1125.346 ms 2023-12-13T22:33:48.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2978 0.05 MB/sec execute 216 sec latency 1140.813 ms 2023-12-13T22:33:49.711 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2989 0.05 MB/sec execute 217 sec latency 469.323 ms 2023-12-13T22:33:50.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2993 0.05 MB/sec execute 218 sec latency 484.645 ms 2023-12-13T22:33:51.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 2994 0.05 MB/sec execute 219 sec latency 865.761 ms 2023-12-13T22:33:52.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3005 0.05 MB/sec execute 220 sec latency 912.527 ms 2023-12-13T22:33:53.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3012 0.05 MB/sec execute 221 sec latency 302.482 ms 2023-12-13T22:33:54.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3015 0.05 MB/sec execute 222 sec latency 546.642 ms 2023-12-13T22:33:55.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3022 0.05 MB/sec execute 223 sec latency 307.205 ms 2023-12-13T22:33:56.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3025 0.05 MB/sec execute 224 sec latency 500.429 ms 2023-12-13T22:33:57.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3031 0.05 MB/sec execute 225 sec latency 892.024 ms 2023-12-13T22:33:58.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3167 0.05 MB/sec execute 226 sec latency 1199.188 ms 2023-12-13T22:33:59.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3169 0.05 MB/sec execute 227 sec latency 916.870 ms 2023-12-13T22:34:00.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3175 0.05 MB/sec execute 228 sec latency 531.624 ms 2023-12-13T22:34:01.178 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:34:01.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:34:01.712 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3177 0.05 MB/sec execute 229 sec latency 486.696 ms 2023-12-13T22:34:02.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3188 0.05 MB/sec execute 230 sec latency 909.271 ms 2023-12-13T22:34:03.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3197 0.05 MB/sec execute 231 sec latency 978.376 ms 2023-12-13T22:34:04.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3205 0.05 MB/sec execute 232 sec latency 290.828 ms 2023-12-13T22:34:05.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3210 0.05 MB/sec execute 233 sec latency 584.400 ms 2023-12-13T22:34:06.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3246 0.05 MB/sec execute 234 sec latency 397.430 ms 2023-12-13T22:34:07.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3266 0.05 MB/sec execute 235 sec latency 498.378 ms 2023-12-13T22:34:08.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3268 0.05 MB/sec execute 236 sec latency 1035.847 ms 2023-12-13T22:34:08.748 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:32.909 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.030 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:33.191 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.031 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:09:33.137 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.076 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:09:33.181 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.258 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:09:33.364 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.297 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:09:33.402 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:09.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3269 0.05 MB/sec execute 237 sec latency 863.694 ms 2023-12-13T22:34:10.266 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:09:34.426 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:10.466 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:09:34.571 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:10.482 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:09:34.588 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:10.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3269 0.05 MB/sec execute 238 sec latency 1389.951 ms 2023-12-13T22:34:11.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3269 0.05 MB/sec execute 239 sec latency 2390.041 ms 2023-12-13T22:34:12.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3271 0.05 MB/sec execute 240 sec latency 2629.132 ms 2023-12-13T22:34:13.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3277 0.05 MB/sec execute 241 sec latency 496.354 ms 2023-12-13T22:34:14.713 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3281 0.05 MB/sec execute 242 sec latency 927.678 ms 2023-12-13T22:34:15.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3282 0.05 MB/sec execute 243 sec latency 983.677 ms 2023-12-13T22:34:16.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3283 0.05 MB/sec execute 244 sec latency 1008.233 ms 2023-12-13T22:34:17.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3283 0.05 MB/sec execute 245 sec latency 1016.025 ms 2023-12-13T22:34:18.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3285 0.05 MB/sec execute 246 sec latency 1070.790 ms 2023-12-13T22:34:19.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3286 0.05 MB/sec execute 247 sec latency 986.703 ms 2023-12-13T22:34:20.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3287 0.05 MB/sec execute 248 sec latency 936.357 ms 2023-12-13T22:34:21.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3290 0.05 MB/sec execute 249 sec latency 1138.011 ms 2023-12-13T22:34:22.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3291 0.05 MB/sec execute 250 sec latency 985.603 ms 2023-12-13T22:34:23.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3292 0.05 MB/sec execute 251 sec latency 956.990 ms 2023-12-13T22:34:24.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3293 0.05 MB/sec execute 252 sec latency 936.351 ms 2023-12-13T22:34:25.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3294 0.05 MB/sec execute 253 sec latency 954.439 ms 2023-12-13T22:34:26.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3295 0.05 MB/sec execute 254 sec latency 939.809 ms 2023-12-13T22:34:27.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3298 0.05 MB/sec execute 255 sec latency 957.638 ms 2023-12-13T22:34:28.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3299 0.05 MB/sec execute 256 sec latency 991.730 ms 2023-12-13T22:34:29.714 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3303 0.05 MB/sec execute 257 sec latency 949.674 ms 2023-12-13T22:34:30.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3306 0.05 MB/sec execute 258 sec latency 1003.676 ms 2023-12-13T22:34:31.273 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:34:31.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:34:31.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3307 0.05 MB/sec execute 259 sec latency 979.525 ms 2023-12-13T22:34:32.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3308 0.05 MB/sec execute 260 sec latency 880.789 ms 2023-12-13T22:34:33.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3309 0.05 MB/sec execute 261 sec latency 987.221 ms 2023-12-13T22:34:34.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3310 0.05 MB/sec execute 262 sec latency 909.080 ms 2023-12-13T22:34:35.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3311 0.05 MB/sec execute 263 sec latency 942.226 ms 2023-12-13T22:34:36.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3312 0.05 MB/sec execute 264 sec latency 1016.186 ms 2023-12-13T22:34:37.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3313 0.05 MB/sec execute 265 sec latency 966.839 ms 2023-12-13T22:34:38.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3314 0.05 MB/sec execute 266 sec latency 1053.998 ms 2023-12-13T22:34:39.715 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3316 0.05 MB/sec execute 267 sec latency 928.077 ms 2023-12-13T22:34:40.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3317 0.05 MB/sec execute 268 sec latency 974.400 ms 2023-12-13T22:34:41.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3318 0.05 MB/sec execute 269 sec latency 953.335 ms 2023-12-13T22:34:42.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3319 0.05 MB/sec execute 270 sec latency 986.074 ms 2023-12-13T22:34:43.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3322 0.05 MB/sec execute 271 sec latency 987.678 ms 2023-12-13T22:34:44.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3323 0.05 MB/sec execute 272 sec latency 965.889 ms 2023-12-13T22:34:45.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3324 0.05 MB/sec execute 273 sec latency 990.907 ms 2023-12-13T22:34:46.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3325 0.05 MB/sec execute 274 sec latency 938.802 ms 2023-12-13T22:34:47.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3326 0.04 MB/sec execute 275 sec latency 1008.968 ms 2023-12-13T22:34:48.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3327 0.04 MB/sec execute 276 sec latency 908.486 ms 2023-12-13T22:34:49.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3330 0.04 MB/sec execute 277 sec latency 959.928 ms 2023-12-13T22:34:50.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3331 0.04 MB/sec execute 278 sec latency 957.966 ms 2023-12-13T22:34:51.691 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:15.852 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:51.716 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3332 0.04 MB/sec execute 279 sec latency 963.633 ms 2023-12-13T22:34:51.833 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:15.994 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:51.999 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:10:16.104 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.026 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:10:16.132 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.027 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:10:16.133 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.042 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:10:16.148 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.132 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:10:16.294 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.293 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:10:16.399 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.364 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:10:16.470 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:34:52.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3333 0.04 MB/sec execute 280 sec latency 857.106 ms 2023-12-13T22:34:53.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3334 0.04 MB/sec execute 281 sec latency 771.920 ms 2023-12-13T22:34:54.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3335 0.04 MB/sec execute 282 sec latency 926.879 ms 2023-12-13T22:34:55.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3337 0.04 MB/sec execute 283 sec latency 945.297 ms 2023-12-13T22:34:56.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3339 0.04 MB/sec execute 284 sec latency 1007.312 ms 2023-12-13T22:34:57.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3345 0.04 MB/sec execute 285 sec latency 319.219 ms 2023-12-13T22:34:58.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3353 0.04 MB/sec execute 286 sec latency 498.162 ms 2023-12-13T22:34:59.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3360 0.04 MB/sec execute 287 sec latency 540.159 ms 2023-12-13T22:35:00.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3364 0.04 MB/sec execute 288 sec latency 339.754 ms 2023-12-13T22:35:01.351 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:35:01.354 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:35:01.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3372 0.04 MB/sec execute 289 sec latency 479.767 ms 2023-12-13T22:35:02.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3374 0.04 MB/sec execute 290 sec latency 560.818 ms 2023-12-13T22:35:03.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3378 0.04 MB/sec execute 291 sec latency 449.812 ms 2023-12-13T22:35:04.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3390 0.04 MB/sec execute 292 sec latency 557.808 ms 2023-12-13T22:35:05.717 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3391 0.04 MB/sec execute 293 sec latency 747.148 ms 2023-12-13T22:35:06.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3393 0.04 MB/sec execute 294 sec latency 1146.039 ms 2023-12-13T22:35:07.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3395 0.04 MB/sec execute 295 sec latency 1102.288 ms 2023-12-13T22:35:08.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3398 0.04 MB/sec execute 296 sec latency 945.175 ms 2023-12-13T22:35:09.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3410 0.04 MB/sec execute 297 sec latency 1006.085 ms 2023-12-13T22:35:10.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3494 0.05 MB/sec execute 298 sec latency 303.058 ms 2023-12-13T22:35:11.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3503 0.05 MB/sec execute 299 sec latency 541.566 ms 2023-12-13T22:35:12.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3513 0.05 MB/sec execute 300 sec latency 389.210 ms 2023-12-13T22:35:13.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3523 0.05 MB/sec execute 301 sec latency 333.277 ms 2023-12-13T22:35:14.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3531 0.05 MB/sec execute 302 sec latency 332.337 ms 2023-12-13T22:35:15.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3533 0.05 MB/sec execute 303 sec latency 1007.751 ms 2023-12-13T22:35:16.718 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3540 0.05 MB/sec execute 304 sec latency 368.617 ms 2023-12-13T22:35:17.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3548 0.05 MB/sec execute 305 sec latency 464.600 ms 2023-12-13T22:35:18.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3553 0.05 MB/sec execute 306 sec latency 305.537 ms 2023-12-13T22:35:19.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3557 0.05 MB/sec execute 307 sec latency 613.989 ms 2023-12-13T22:35:20.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3559 0.05 MB/sec execute 308 sec latency 997.661 ms 2023-12-13T22:35:21.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3568 0.05 MB/sec execute 309 sec latency 306.992 ms 2023-12-13T22:35:22.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3573 0.05 MB/sec execute 310 sec latency 418.052 ms 2023-12-13T22:35:23.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3577 0.05 MB/sec execute 311 sec latency 989.131 ms 2023-12-13T22:35:24.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3588 0.05 MB/sec execute 312 sec latency 191.767 ms 2023-12-13T22:35:25.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3592 0.05 MB/sec execute 313 sec latency 967.353 ms 2023-12-13T22:35:26.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3627 0.05 MB/sec execute 314 sec latency 428.029 ms 2023-12-13T22:35:27.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3633 0.05 MB/sec execute 315 sec latency 609.321 ms 2023-12-13T22:35:28.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3638 0.05 MB/sec execute 316 sec latency 576.963 ms 2023-12-13T22:35:29.719 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3642 0.05 MB/sec execute 317 sec latency 482.940 ms 2023-12-13T22:35:30.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3645 0.05 MB/sec execute 318 sec latency 968.000 ms 2023-12-13T22:35:31.481 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:35:31.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:35:31.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3651 0.05 MB/sec execute 319 sec latency 323.840 ms 2023-12-13T22:35:32.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3666 0.05 MB/sec execute 320 sec latency 401.355 ms 2023-12-13T22:35:33.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3672 0.05 MB/sec execute 321 sec latency 372.065 ms 2023-12-13T22:35:34.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3673 0.05 MB/sec execute 322 sec latency 1013.364 ms 2023-12-13T22:35:35.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3677 0.05 MB/sec execute 323 sec latency 553.877 ms 2023-12-13T22:35:36.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3686 0.05 MB/sec execute 324 sec latency 318.754 ms 2023-12-13T22:35:37.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3686 0.05 MB/sec execute 325 sec latency 1084.477 ms 2023-12-13T22:35:38.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3695 0.05 MB/sec execute 326 sec latency 1183.586 ms 2023-12-13T22:35:39.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3697 0.05 MB/sec execute 327 sec latency 675.366 ms 2023-12-13T22:35:40.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3707 0.05 MB/sec execute 328 sec latency 561.007 ms 2023-12-13T22:35:41.720 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3715 0.05 MB/sec execute 329 sec latency 503.300 ms 2023-12-13T22:35:42.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3720 0.05 MB/sec execute 330 sec latency 330.065 ms 2023-12-13T22:35:43.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3738 0.05 MB/sec execute 331 sec latency 429.500 ms 2023-12-13T22:35:44.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3758 0.05 MB/sec execute 332 sec latency 550.025 ms 2023-12-13T22:35:45.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3762 0.05 MB/sec execute 333 sec latency 916.619 ms 2023-12-13T22:35:46.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3768 0.05 MB/sec execute 334 sec latency 428.463 ms 2023-12-13T22:35:47.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3772 0.05 MB/sec execute 335 sec latency 706.699 ms 2023-12-13T22:35:48.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3776 0.05 MB/sec execute 336 sec latency 494.114 ms 2023-12-13T22:35:49.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3780 0.05 MB/sec execute 337 sec latency 321.468 ms 2023-12-13T22:35:50.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3784 0.05 MB/sec execute 338 sec latency 498.683 ms 2023-12-13T22:35:51.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3785 0.05 MB/sec execute 339 sec latency 769.444 ms 2023-12-13T22:35:52.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3789 0.05 MB/sec execute 340 sec latency 813.180 ms 2023-12-13T22:35:53.721 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3791 0.05 MB/sec execute 341 sec latency 536.921 ms 2023-12-13T22:35:54.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3794 0.05 MB/sec execute 342 sec latency 760.800 ms 2023-12-13T22:35:55.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3797 0.05 MB/sec execute 343 sec latency 517.118 ms 2023-12-13T22:35:56.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3800 0.05 MB/sec execute 344 sec latency 762.354 ms 2023-12-13T22:35:57.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3803 0.05 MB/sec execute 345 sec latency 830.102 ms 2023-12-13T22:35:58.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3805 0.05 MB/sec execute 346 sec latency 559.294 ms 2023-12-13T22:35:59.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3811 0.05 MB/sec execute 347 sec latency 567.675 ms 2023-12-13T22:36:00.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3814 0.05 MB/sec execute 348 sec latency 535.798 ms 2023-12-13T22:36:01.632 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:36:01.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:36:01.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3818 0.05 MB/sec execute 349 sec latency 455.590 ms 2023-12-13T22:36:02.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3821 0.05 MB/sec execute 350 sec latency 599.394 ms 2023-12-13T22:36:03.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3827 0.05 MB/sec execute 351 sec latency 340.444 ms 2023-12-13T22:36:04.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3830 0.05 MB/sec execute 352 sec latency 489.808 ms 2023-12-13T22:36:05.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3835 0.05 MB/sec execute 353 sec latency 317.060 ms 2023-12-13T22:36:06.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3839 0.05 MB/sec execute 354 sec latency 537.588 ms 2023-12-13T22:36:07.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3843 0.05 MB/sec execute 355 sec latency 417.466 ms 2023-12-13T22:36:08.722 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3847 0.05 MB/sec execute 356 sec latency 555.171 ms 2023-12-13T22:36:09.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3852 0.05 MB/sec execute 357 sec latency 360.245 ms 2023-12-13T22:36:10.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3856 0.05 MB/sec execute 358 sec latency 551.560 ms 2023-12-13T22:36:11.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3860 0.05 MB/sec execute 359 sec latency 457.505 ms 2023-12-13T22:36:12.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3864 0.05 MB/sec execute 360 sec latency 611.558 ms 2023-12-13T22:36:13.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3868 0.05 MB/sec execute 361 sec latency 328.699 ms 2023-12-13T22:36:14.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3870 0.05 MB/sec execute 362 sec latency 498.463 ms 2023-12-13T22:36:15.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3873 0.05 MB/sec execute 363 sec latency 898.204 ms 2023-12-13T22:36:16.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3876 0.05 MB/sec execute 364 sec latency 637.063 ms 2023-12-13T22:36:17.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3878 0.05 MB/sec execute 365 sec latency 935.623 ms 2023-12-13T22:36:18.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3883 0.05 MB/sec execute 366 sec latency 662.198 ms 2023-12-13T22:36:19.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3885 0.05 MB/sec execute 367 sec latency 491.577 ms 2023-12-13T22:36:20.723 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3896 0.05 MB/sec execute 368 sec latency 816.845 ms 2023-12-13T22:36:21.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3898 0.05 MB/sec execute 369 sec latency 1062.415 ms 2023-12-13T22:36:22.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3901 0.05 MB/sec execute 370 sec latency 993.301 ms 2023-12-13T22:36:23.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3914 0.05 MB/sec execute 371 sec latency 226.006 ms 2023-12-13T22:36:24.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3915 0.05 MB/sec execute 372 sec latency 929.817 ms 2023-12-13T22:36:25.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3920 0.05 MB/sec execute 373 sec latency 409.463 ms 2023-12-13T22:36:26.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3926 0.05 MB/sec execute 374 sec latency 488.022 ms 2023-12-13T22:36:27.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3928 0.05 MB/sec execute 375 sec latency 717.202 ms 2023-12-13T22:36:28.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3932 0.05 MB/sec execute 376 sec latency 313.800 ms 2023-12-13T22:36:29.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3935 0.05 MB/sec execute 377 sec latency 676.290 ms 2023-12-13T22:36:30.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3937 0.05 MB/sec execute 378 sec latency 478.381 ms 2023-12-13T22:36:31.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:36:31.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:36:31.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3939 0.04 MB/sec execute 379 sec latency 651.499 ms 2023-12-13T22:36:32.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3943 0.04 MB/sec execute 380 sec latency 592.111 ms 2023-12-13T22:36:33.724 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3946 0.04 MB/sec execute 381 sec latency 694.581 ms 2023-12-13T22:36:34.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3948 0.04 MB/sec execute 382 sec latency 537.672 ms 2023-12-13T22:36:35.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3952 0.04 MB/sec execute 383 sec latency 745.564 ms 2023-12-13T22:36:36.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3957 0.04 MB/sec execute 384 sec latency 604.053 ms 2023-12-13T22:36:37.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3959 0.04 MB/sec execute 385 sec latency 485.590 ms 2023-12-13T22:36:38.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3963 0.04 MB/sec execute 386 sec latency 736.799 ms 2023-12-13T22:36:39.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3967 0.04 MB/sec execute 387 sec latency 408.086 ms 2023-12-13T22:36:40.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3973 0.04 MB/sec execute 388 sec latency 529.151 ms 2023-12-13T22:36:41.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3975 0.04 MB/sec execute 389 sec latency 464.699 ms 2023-12-13T22:36:42.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3981 0.04 MB/sec execute 390 sec latency 531.016 ms 2023-12-13T22:36:43.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3984 0.04 MB/sec execute 391 sec latency 547.715 ms 2023-12-13T22:36:44.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3989 0.04 MB/sec execute 392 sec latency 310.170 ms 2023-12-13T22:36:45.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3992 0.04 MB/sec execute 393 sec latency 509.712 ms 2023-12-13T22:36:46.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 3998 0.04 MB/sec execute 394 sec latency 321.903 ms 2023-12-13T22:36:47.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4000 0.04 MB/sec execute 395 sec latency 735.946 ms 2023-12-13T22:36:48.725 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4005 0.04 MB/sec execute 396 sec latency 326.566 ms 2023-12-13T22:36:49.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4009 0.04 MB/sec execute 397 sec latency 528.238 ms 2023-12-13T22:36:50.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4014 0.04 MB/sec execute 398 sec latency 345.027 ms 2023-12-13T22:36:51.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4018 0.04 MB/sec execute 399 sec latency 578.695 ms 2023-12-13T22:36:52.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4022 0.04 MB/sec execute 400 sec latency 343.984 ms 2023-12-13T22:36:53.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4025 0.04 MB/sec execute 401 sec latency 552.837 ms 2023-12-13T22:36:54.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4027 0.04 MB/sec execute 402 sec latency 661.462 ms 2023-12-13T22:36:55.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4028 0.04 MB/sec execute 403 sec latency 947.047 ms 2023-12-13T22:36:56.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4032 0.04 MB/sec execute 404 sec latency 714.881 ms 2023-12-13T22:36:57.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4034 0.04 MB/sec execute 405 sec latency 986.067 ms 2023-12-13T22:36:58.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4035 0.04 MB/sec execute 406 sec latency 823.364 ms 2023-12-13T22:36:59.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4041 0.04 MB/sec execute 407 sec latency 928.824 ms 2023-12-13T22:37:00.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4047 0.04 MB/sec execute 408 sec latency 331.017 ms 2023-12-13T22:37:01.726 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4058 0.04 MB/sec execute 409 sec latency 1058.149 ms 2023-12-13T22:37:01.816 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:37:01.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:37:02.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4059 0.04 MB/sec execute 410 sec latency 949.678 ms 2023-12-13T22:37:03.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4063 0.04 MB/sec execute 411 sec latency 526.771 ms 2023-12-13T22:37:04.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4071 0.04 MB/sec execute 412 sec latency 162.909 ms 2023-12-13T22:37:05.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4076 0.04 MB/sec execute 413 sec latency 967.785 ms 2023-12-13T22:37:06.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4082 0.04 MB/sec execute 414 sec latency 888.417 ms 2023-12-13T22:37:07.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4091 0.04 MB/sec execute 415 sec latency 984.319 ms 2023-12-13T22:37:08.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4096 0.04 MB/sec execute 416 sec latency 401.818 ms 2023-12-13T22:37:09.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4100 0.04 MB/sec execute 417 sec latency 415.307 ms 2023-12-13T22:37:10.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4105 0.04 MB/sec execute 418 sec latency 362.624 ms 2023-12-13T22:37:11.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4109 0.04 MB/sec execute 419 sec latency 397.877 ms 2023-12-13T22:37:12.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4115 0.04 MB/sec execute 420 sec latency 394.374 ms 2023-12-13T22:37:13.727 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4118 0.04 MB/sec execute 421 sec latency 438.277 ms 2023-12-13T22:37:14.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4124 0.04 MB/sec execute 422 sec latency 383.628 ms 2023-12-13T22:37:15.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4129 0.04 MB/sec execute 423 sec latency 387.748 ms 2023-12-13T22:37:16.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4134 0.04 MB/sec execute 424 sec latency 320.004 ms 2023-12-13T22:37:17.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4138 0.04 MB/sec execute 425 sec latency 382.211 ms 2023-12-13T22:37:18.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4144 0.04 MB/sec execute 426 sec latency 328.232 ms 2023-12-13T22:37:19.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4148 0.04 MB/sec execute 427 sec latency 401.414 ms 2023-12-13T22:37:20.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4155 0.04 MB/sec execute 428 sec latency 495.267 ms 2023-12-13T22:37:21.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4157 0.04 MB/sec execute 429 sec latency 633.829 ms 2023-12-13T22:37:22.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4161 0.04 MB/sec execute 430 sec latency 389.574 ms 2023-12-13T22:37:23.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4166 0.04 MB/sec execute 431 sec latency 401.613 ms 2023-12-13T22:37:24.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4171 0.04 MB/sec execute 432 sec latency 402.235 ms 2023-12-13T22:37:25.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4173 0.04 MB/sec execute 433 sec latency 501.072 ms 2023-12-13T22:37:26.728 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4176 0.04 MB/sec execute 434 sec latency 1165.859 ms 2023-12-13T22:37:27.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4179 0.04 MB/sec execute 435 sec latency 978.971 ms 2023-12-13T22:37:28.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4181 0.04 MB/sec execute 436 sec latency 744.775 ms 2023-12-13T22:37:29.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4186 0.04 MB/sec execute 437 sec latency 1030.532 ms 2023-12-13T22:37:30.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4216 0.04 MB/sec execute 438 sec latency 1028.668 ms 2023-12-13T22:37:31.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4217 0.04 MB/sec execute 439 sec latency 1147.825 ms 2023-12-13T22:37:32.002 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:37:32.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:37:32.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4221 0.04 MB/sec execute 440 sec latency 975.091 ms 2023-12-13T22:37:33.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4225 0.04 MB/sec execute 441 sec latency 345.581 ms 2023-12-13T22:37:34.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4226 0.04 MB/sec execute 442 sec latency 972.914 ms 2023-12-13T22:37:35.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4233 0.04 MB/sec execute 443 sec latency 565.416 ms 2023-12-13T22:37:36.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4252 0.04 MB/sec execute 444 sec latency 374.932 ms 2023-12-13T22:37:37.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4254 0.04 MB/sec execute 445 sec latency 899.344 ms 2023-12-13T22:37:38.729 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4260 0.04 MB/sec execute 446 sec latency 1204.094 ms 2023-12-13T22:37:39.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4276 0.04 MB/sec execute 447 sec latency 480.884 ms 2023-12-13T22:37:40.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4281 0.04 MB/sec execute 448 sec latency 418.158 ms 2023-12-13T22:37:41.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4283 0.04 MB/sec execute 449 sec latency 580.935 ms 2023-12-13T22:37:42.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4306 0.04 MB/sec execute 450 sec latency 333.065 ms 2023-12-13T22:37:43.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4315 0.04 MB/sec execute 451 sec latency 364.390 ms 2023-12-13T22:37:44.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4317 0.04 MB/sec execute 452 sec latency 937.972 ms 2023-12-13T22:37:45.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4318 0.04 MB/sec execute 453 sec latency 950.181 ms 2023-12-13T22:37:46.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4342 0.04 MB/sec execute 454 sec latency 503.500 ms 2023-12-13T22:37:47.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4349 0.04 MB/sec execute 455 sec latency 330.367 ms 2023-12-13T22:37:48.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4351 0.04 MB/sec execute 456 sec latency 627.454 ms 2023-12-13T22:37:49.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4372 0.04 MB/sec execute 457 sec latency 318.690 ms 2023-12-13T22:37:50.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4383 0.04 MB/sec execute 458 sec latency 296.179 ms 2023-12-13T22:37:51.730 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4384 0.04 MB/sec execute 459 sec latency 876.192 ms 2023-12-13T22:37:52.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4386 0.04 MB/sec execute 460 sec latency 952.721 ms 2023-12-13T22:37:53.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4388 0.04 MB/sec execute 461 sec latency 733.788 ms 2023-12-13T22:37:54.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4393 0.04 MB/sec execute 462 sec latency 877.084 ms 2023-12-13T22:37:55.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4423 0.04 MB/sec execute 463 sec latency 938.402 ms 2023-12-13T22:37:56.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4424 0.04 MB/sec execute 464 sec latency 1139.500 ms 2023-12-13T22:37:57.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4427 0.04 MB/sec execute 465 sec latency 1002.843 ms 2023-12-13T22:37:58.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4432 0.04 MB/sec execute 466 sec latency 344.906 ms 2023-12-13T22:37:59.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4433 0.04 MB/sec execute 467 sec latency 979.085 ms 2023-12-13T22:38:00.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4440 0.04 MB/sec execute 468 sec latency 548.251 ms 2023-12-13T22:38:01.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4450 0.04 MB/sec execute 469 sec latency 669.531 ms 2023-12-13T22:38:02.091 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:38:02.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:38:02.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4462 0.04 MB/sec execute 470 sec latency 995.290 ms 2023-12-13T22:38:03.731 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4472 0.04 MB/sec execute 471 sec latency 497.565 ms 2023-12-13T22:38:04.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4473 0.04 MB/sec execute 472 sec latency 580.017 ms 2023-12-13T22:38:05.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4485 0.04 MB/sec execute 473 sec latency 656.066 ms 2023-12-13T22:38:06.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4497 0.04 MB/sec execute 474 sec latency 324.912 ms 2023-12-13T22:38:07.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4498 0.04 MB/sec execute 475 sec latency 1032.681 ms 2023-12-13T22:38:08.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4499 0.04 MB/sec execute 476 sec latency 1187.474 ms 2023-12-13T22:38:09.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4501 0.04 MB/sec execute 477 sec latency 544.143 ms 2023-12-13T22:38:10.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4502 0.04 MB/sec execute 478 sec latency 972.093 ms 2023-12-13T22:38:11.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4506 0.04 MB/sec execute 479 sec latency 574.037 ms 2023-12-13T22:38:12.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4511 0.04 MB/sec execute 480 sec latency 978.435 ms 2023-12-13T22:38:13.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4521 0.04 MB/sec execute 481 sec latency 969.056 ms 2023-12-13T22:38:14.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4533 0.04 MB/sec execute 482 sec latency 323.445 ms 2023-12-13T22:38:15.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4539 0.04 MB/sec execute 483 sec latency 559.982 ms 2023-12-13T22:38:16.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4546 0.04 MB/sec execute 484 sec latency 659.433 ms 2023-12-13T22:38:17.672 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:13:41.835 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:17.681 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:13:41.845 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:17.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4563 0.04 MB/sec execute 485 sec latency 289.625 ms 2023-12-13T22:38:17.849 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:13:41.954 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:17.854 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:13:41.959 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:17.857 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:13:41.963 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:17.870 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:13:41.976 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:18.018 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:13:42.181 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:18.240 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:13:42.345 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:18.292 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:13:42.397 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:38:18.732 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4569 0.04 MB/sec execute 486 sec latency 806.013 ms 2023-12-13T22:38:19.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4595 0.04 MB/sec execute 487 sec latency 589.164 ms 2023-12-13T22:38:20.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4597 0.04 MB/sec execute 488 sec latency 891.931 ms 2023-12-13T22:38:21.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4602 0.04 MB/sec execute 489 sec latency 450.639 ms 2023-12-13T22:38:22.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4609 0.04 MB/sec execute 490 sec latency 1005.901 ms 2023-12-13T22:38:23.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4614 0.04 MB/sec execute 491 sec latency 750.063 ms 2023-12-13T22:38:24.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4615 0.04 MB/sec execute 492 sec latency 1007.694 ms 2023-12-13T22:38:25.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4616 0.04 MB/sec execute 493 sec latency 1012.079 ms 2023-12-13T22:38:26.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4619 0.04 MB/sec execute 494 sec latency 1133.665 ms 2023-12-13T22:38:27.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4628 0.04 MB/sec execute 495 sec latency 357.678 ms 2023-12-13T22:38:28.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4632 0.04 MB/sec execute 496 sec latency 460.333 ms 2023-12-13T22:38:29.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4652 0.04 MB/sec execute 497 sec latency 481.675 ms 2023-12-13T22:38:30.733 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4656 0.04 MB/sec execute 498 sec latency 413.405 ms 2023-12-13T22:38:31.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4663 0.04 MB/sec execute 499 sec latency 940.065 ms 2023-12-13T22:38:32.205 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:38:32.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:38:32.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4668 0.04 MB/sec execute 500 sec latency 551.680 ms 2023-12-13T22:38:33.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4680 0.04 MB/sec execute 501 sec latency 995.152 ms 2023-12-13T22:38:34.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4681 0.04 MB/sec execute 502 sec latency 953.955 ms 2023-12-13T22:38:35.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4693 0.04 MB/sec execute 503 sec latency 982.003 ms 2023-12-13T22:38:36.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4702 0.04 MB/sec execute 504 sec latency 431.906 ms 2023-12-13T22:38:37.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4714 0.04 MB/sec execute 505 sec latency 400.606 ms 2023-12-13T22:38:38.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4723 0.04 MB/sec execute 506 sec latency 624.214 ms 2023-12-13T22:38:39.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4726 0.04 MB/sec execute 507 sec latency 875.415 ms 2023-12-13T22:38:40.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4734 0.04 MB/sec execute 508 sec latency 441.616 ms 2023-12-13T22:38:41.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4735 0.04 MB/sec execute 509 sec latency 1091.081 ms 2023-12-13T22:38:42.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4736 0.04 MB/sec execute 510 sec latency 952.412 ms 2023-12-13T22:38:43.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4738 0.04 MB/sec execute 511 sec latency 1069.900 ms 2023-12-13T22:38:44.734 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4741 0.04 MB/sec execute 512 sec latency 528.664 ms 2023-12-13T22:38:45.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4745 0.04 MB/sec execute 513 sec latency 514.410 ms 2023-12-13T22:38:46.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4756 0.04 MB/sec execute 514 sec latency 499.748 ms 2023-12-13T22:38:47.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4767 0.04 MB/sec execute 515 sec latency 407.240 ms 2023-12-13T22:38:48.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4770 0.04 MB/sec execute 516 sec latency 817.767 ms 2023-12-13T22:38:49.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4780 0.04 MB/sec execute 517 sec latency 976.641 ms 2023-12-13T22:38:50.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4791 0.04 MB/sec execute 518 sec latency 556.768 ms 2023-12-13T22:38:51.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4798 0.04 MB/sec execute 519 sec latency 431.269 ms 2023-12-13T22:38:52.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4811 0.04 MB/sec execute 520 sec latency 541.869 ms 2023-12-13T22:38:53.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4814 0.04 MB/sec execute 521 sec latency 497.637 ms 2023-12-13T22:38:54.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4818 0.04 MB/sec execute 522 sec latency 945.823 ms 2023-12-13T22:38:55.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4825 0.04 MB/sec execute 523 sec latency 355.933 ms 2023-12-13T22:38:56.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4842 0.04 MB/sec execute 524 sec latency 429.828 ms 2023-12-13T22:38:57.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4844 0.04 MB/sec execute 525 sec latency 684.531 ms 2023-12-13T22:38:58.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4846 0.04 MB/sec execute 526 sec latency 1043.112 ms 2023-12-13T22:38:59.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4847 0.04 MB/sec execute 527 sec latency 986.408 ms 2023-12-13T22:39:00.735 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4850 0.04 MB/sec execute 528 sec latency 981.970 ms 2023-12-13T22:39:01.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4942 0.04 MB/sec execute 529 sec latency 1166.633 ms 2023-12-13T22:39:02.298 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:39:02.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:39:02.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4943 0.04 MB/sec execute 530 sec latency 942.996 ms 2023-12-13T22:39:03.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4944 0.04 MB/sec execute 531 sec latency 993.601 ms 2023-12-13T22:39:04.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4947 0.04 MB/sec execute 532 sec latency 691.951 ms 2023-12-13T22:39:05.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4951 0.04 MB/sec execute 533 sec latency 992.573 ms 2023-12-13T22:39:06.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4957 0.04 MB/sec execute 534 sec latency 1085.582 ms 2023-12-13T22:39:07.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4963 0.04 MB/sec execute 535 sec latency 493.463 ms 2023-12-13T22:39:08.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4965 0.04 MB/sec execute 536 sec latency 1015.433 ms 2023-12-13T22:39:09.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4971 0.04 MB/sec execute 537 sec latency 540.871 ms 2023-12-13T22:39:10.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4983 0.04 MB/sec execute 538 sec latency 649.049 ms 2023-12-13T22:39:11.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4985 0.04 MB/sec execute 539 sec latency 1138.792 ms 2023-12-13T22:39:12.736 INFO:tasks.workunit.client.0.smithi091.stdout: 1 4994 0.04 MB/sec execute 540 sec latency 333.825 ms 2023-12-13T22:39:13.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5010 0.04 MB/sec execute 541 sec latency 383.315 ms 2023-12-13T22:39:14.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5014 0.04 MB/sec execute 542 sec latency 600.438 ms 2023-12-13T22:39:15.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5015 0.04 MB/sec execute 543 sec latency 961.582 ms 2023-12-13T22:39:16.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5031 0.04 MB/sec execute 544 sec latency 167.644 ms 2023-12-13T22:39:17.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5032 0.04 MB/sec execute 545 sec latency 691.012 ms 2023-12-13T22:39:18.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5048 0.04 MB/sec execute 546 sec latency 1099.513 ms 2023-12-13T22:39:19.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5052 0.04 MB/sec execute 547 sec latency 932.762 ms 2023-12-13T22:39:20.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5056 0.04 MB/sec execute 548 sec latency 337.002 ms 2023-12-13T22:39:21.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5058 0.04 MB/sec execute 549 sec latency 981.088 ms 2023-12-13T22:39:22.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5068 0.04 MB/sec execute 550 sec latency 381.469 ms 2023-12-13T22:39:23.737 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5078 0.04 MB/sec execute 551 sec latency 341.784 ms 2023-12-13T22:39:24.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5089 0.04 MB/sec execute 552 sec latency 372.823 ms 2023-12-13T22:39:25.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5092 0.04 MB/sec execute 553 sec latency 545.911 ms 2023-12-13T22:39:26.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5096 0.04 MB/sec execute 554 sec latency 1033.333 ms 2023-12-13T22:39:27.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5117 0.04 MB/sec execute 555 sec latency 922.228 ms 2023-12-13T22:39:28.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5119 0.04 MB/sec execute 556 sec latency 663.888 ms 2023-12-13T22:39:29.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5121 0.04 MB/sec execute 557 sec latency 976.172 ms 2023-12-13T22:39:30.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5137 0.04 MB/sec execute 558 sec latency 143.958 ms 2023-12-13T22:39:31.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5151 0.04 MB/sec execute 559 sec latency 171.095 ms 2023-12-13T22:39:32.366 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:39:32.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:39:32.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5154 0.04 MB/sec execute 560 sec latency 336.479 ms 2023-12-13T22:39:33.738 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5156 0.04 MB/sec execute 561 sec latency 981.817 ms 2023-12-13T22:39:34.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5171 0.04 MB/sec execute 562 sec latency 384.641 ms 2023-12-13T22:39:35.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5175 0.04 MB/sec execute 563 sec latency 1035.564 ms 2023-12-13T22:39:36.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5177 0.04 MB/sec execute 564 sec latency 935.418 ms 2023-12-13T22:39:37.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5181 0.04 MB/sec execute 565 sec latency 450.352 ms 2023-12-13T22:39:38.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5182 0.04 MB/sec execute 566 sec latency 901.751 ms 2023-12-13T22:39:39.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5206 0.04 MB/sec execute 567 sec latency 960.931 ms 2023-12-13T22:39:40.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5208 0.04 MB/sec execute 568 sec latency 979.513 ms 2023-12-13T22:39:41.739 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5209 0.04 MB/sec execute 569 sec latency 581.458 ms 2023-12-13T22:39:42.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5218 0.04 MB/sec execute 570 sec latency 1041.643 ms 2023-12-13T22:39:43.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5227 0.04 MB/sec execute 571 sec latency 563.384 ms 2023-12-13T22:39:44.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5247 0.04 MB/sec execute 572 sec latency 402.538 ms 2023-12-13T22:39:45.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5252 0.04 MB/sec execute 573 sec latency 758.793 ms 2023-12-13T22:39:46.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5256 0.04 MB/sec execute 574 sec latency 590.952 ms 2023-12-13T22:39:47.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5265 0.04 MB/sec execute 575 sec latency 402.976 ms 2023-12-13T22:39:48.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5268 0.04 MB/sec execute 576 sec latency 906.555 ms 2023-12-13T22:39:49.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5272 0.04 MB/sec execute 577 sec latency 881.700 ms 2023-12-13T22:39:50.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5286 0.04 MB/sec execute 578 sec latency 997.187 ms 2023-12-13T22:39:51.740 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5323 0.04 MB/sec execute 579 sec latency 132.682 ms 2023-12-13T22:39:52.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5334 0.04 MB/sec execute 580 sec latency 325.373 ms 2023-12-13T22:39:53.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5337 0.04 MB/sec execute 581 sec latency 592.951 ms 2023-12-13T22:39:54.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5344 0.04 MB/sec execute 582 sec latency 992.529 ms 2023-12-13T22:39:55.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5368 0.04 MB/sec execute 583 sec latency 161.332 ms 2023-12-13T22:39:56.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5371 0.04 MB/sec execute 584 sec latency 383.104 ms 2023-12-13T22:39:57.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5379 0.04 MB/sec execute 585 sec latency 988.355 ms 2023-12-13T22:39:58.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5387 0.04 MB/sec execute 586 sec latency 372.540 ms 2023-12-13T22:39:59.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5391 0.04 MB/sec execute 587 sec latency 967.821 ms 2023-12-13T22:40:00.741 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5395 0.04 MB/sec execute 588 sec latency 964.541 ms 2023-12-13T22:40:01.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5404 0.04 MB/sec execute 589 sec latency 252.837 ms 2023-12-13T22:40:02.498 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:40:02.501 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:40:02.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5406 0.04 MB/sec execute 590 sec latency 562.456 ms 2023-12-13T22:40:03.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5418 0.04 MB/sec execute 591 sec latency 1064.775 ms 2023-12-13T22:40:04.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5423 0.04 MB/sec execute 592 sec latency 521.065 ms 2023-12-13T22:40:05.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5427 0.04 MB/sec execute 593 sec latency 951.251 ms 2023-12-13T22:40:06.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5431 0.04 MB/sec execute 594 sec latency 972.747 ms 2023-12-13T22:40:07.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5434 0.04 MB/sec execute 595 sec latency 366.275 ms 2023-12-13T22:40:08.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5444 0.04 MB/sec execute 596 sec latency 922.631 ms 2023-12-13T22:40:09.742 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5463 0.04 MB/sec execute 597 sec latency 471.952 ms 2023-12-13T22:40:10.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5468 0.04 MB/sec execute 598 sec latency 954.580 ms 2023-12-13T22:40:11.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 5474 0.04 MB/sec execute 599 sec latency 1118.203 ms 2023-12-13T22:40:12.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 600 sec 2023-12-13T22:40:13.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 601 sec 2023-12-13T22:40:14.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 602 sec 2023-12-13T22:40:15.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 603 sec 2023-12-13T22:40:16.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 604 sec 2023-12-13T22:40:17.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 605 sec 2023-12-13T22:40:18.743 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 606 sec 2023-12-13T22:40:19.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 607 sec 2023-12-13T22:40:20.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 608 sec 2023-12-13T22:40:21.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 609 sec 2023-12-13T22:40:22.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 610 sec 2023-12-13T22:40:23.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 611 sec 2023-12-13T22:40:24.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 612 sec 2023-12-13T22:40:25.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 613 sec 2023-12-13T22:40:26.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 614 sec 2023-12-13T22:40:27.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 615 sec 2023-12-13T22:40:28.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 616 sec 2023-12-13T22:40:29.744 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 617 sec 2023-12-13T22:40:30.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 618 sec 2023-12-13T22:40:31.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 619 sec 2023-12-13T22:40:32.575 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:40:32.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:40:32.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 620 sec 2023-12-13T22:40:33.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 621 sec 2023-12-13T22:40:34.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 622 sec 2023-12-13T22:40:35.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 623 sec 2023-12-13T22:40:36.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 624 sec 2023-12-13T22:40:37.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 625 sec 2023-12-13T22:40:38.745 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 626 sec 2023-12-13T22:40:39.747 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 627 sec 2023-12-13T22:40:40.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 628 sec 2023-12-13T22:40:41.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 629 sec 2023-12-13T22:40:42.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 630 sec 2023-12-13T22:40:43.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 631 sec 2023-12-13T22:40:44.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 632 sec 2023-12-13T22:40:45.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 633 sec 2023-12-13T22:40:46.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 634 sec 2023-12-13T22:40:47.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 635 sec 2023-12-13T22:40:48.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 636 sec 2023-12-13T22:40:49.746 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 637 sec 2023-12-13T22:40:50.747 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 638 sec 2023-12-13T22:40:51.747 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 639 sec 2023-12-13T22:40:52.747 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 640 sec 2023-12-13T22:40:53.747 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 641 sec 2023-12-13T22:40:54.654 INFO:tasks.workunit.client.0.smithi091.stdout: 0 cleanup 642 sec 2023-12-13T22:40:54.654 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Operation Count AvgLat MaxLat 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: ---------------------------------------- 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: NTCreateX 770 216.383 830.092 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Close 561 3.476 30.584 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Rename 30 513.608 793.084 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Unlink 136 265.262 373.126 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Qpathinfo 715 161.016 729.336 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Qfileinfo 124 2.871 9.728 2023-12-13T22:40:54.655 INFO:tasks.workunit.client.0.smithi091.stdout: Qfsinfo 108 78.025 2629.119 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: Sfileinfo 59 67.602 355.920 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: Find 254 963.388 1204.081 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: WriteX 358 10.516 94.767 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: ReadX 1140 0.093 5.238 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: LockX 2 80.441 126.479 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: UnlockX 2 60.786 79.175 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: Flush 49 79.435 132.796 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stdout:Throughput 0.0376513 MB/sec 1 clients 1 procs max_latency=2629.132 ms 2023-12-13T22:40:54.656 INFO:tasks.workunit.client.0.smithi091.stderr:+ dbench 10 2023-12-13T22:40:54.657 INFO:tasks.workunit.client.0.smithi091.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-13T22:40:54.657 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:40:54.657 INFO:tasks.workunit.client.0.smithi091.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-13T22:40:54.657 INFO:tasks.workunit.client.0.smithi091.stdout:9 of 10 processes prepared for launch 0 sec 2023-12-13T22:40:54.757 INFO:tasks.workunit.client.0.smithi091.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-13T22:40:54.757 INFO:tasks.workunit.client.0.smithi091.stdout:releasing clients 2023-12-13T22:40:55.757 INFO:tasks.workunit.client.0.smithi091.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.884 ms 2023-12-13T22:40:56.757 INFO:tasks.workunit.client.0.smithi091.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.978 ms 2023-12-13T22:40:57.757 INFO:tasks.workunit.client.0.smithi091.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.040 ms 2023-12-13T22:40:58.757 INFO:tasks.workunit.client.0.smithi091.stdout: 0 3 0.00 MB/sec warmup 4 sec latency 4000.137 ms 2023-12-13T22:40:59.757 INFO:tasks.workunit.client.0.smithi091.stdout: 1 7 0.20 MB/sec warmup 5 sec latency 4316.088 ms 2023-12-13T22:41:00.757 INFO:tasks.workunit.client.0.smithi091.stdout: 1 8 0.17 MB/sec warmup 6 sec latency 963.229 ms 2023-12-13T22:41:01.758 INFO:tasks.workunit.client.0.smithi091.stdout: 1 12 0.30 MB/sec warmup 7 sec latency 1159.941 ms 2023-12-13T22:41:02.706 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:41:02.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:41:02.758 INFO:tasks.workunit.client.0.smithi091.stdout: 1 13 0.26 MB/sec warmup 8 sec latency 1040.171 ms 2023-12-13T22:41:03.758 INFO:tasks.workunit.client.0.smithi091.stdout: 2 18 0.47 MB/sec warmup 9 sec latency 1250.114 ms 2023-12-13T22:41:04.758 INFO:tasks.workunit.client.0.smithi091.stdout: 5 21 0.55 MB/sec warmup 10 sec latency 1580.452 ms 2023-12-13T22:41:05.758 INFO:tasks.workunit.client.0.smithi091.stdout: 8 28 0.80 MB/sec warmup 11 sec latency 1708.511 ms 2023-12-13T22:41:06.758 INFO:tasks.workunit.client.0.smithi091.stdout: 10 36 1.08 MB/sec warmup 12 sec latency 1692.018 ms 2023-12-13T22:41:07.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 41 1.21 MB/sec warmup 13 sec latency 1593.391 ms 2023-12-13T22:41:08.758 INFO:tasks.workunit.client.0.smithi091.stdout: 10 46 1.33 MB/sec warmup 14 sec latency 1991.261 ms 2023-12-13T22:41:09.758 INFO:tasks.workunit.client.0.smithi091.stdout: 10 51 1.38 MB/sec warmup 15 sec latency 2745.358 ms 2023-12-13T22:41:10.758 INFO:tasks.workunit.client.0.smithi091.stdout: 10 57 1.51 MB/sec warmup 16 sec latency 3745.434 ms 2023-12-13T22:41:11.758 INFO:tasks.workunit.client.0.smithi091.stdout: 10 61 1.54 MB/sec warmup 17 sec latency 4126.655 ms 2023-12-13T22:41:12.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 65 1.57 MB/sec warmup 18 sec latency 4035.688 ms 2023-12-13T22:41:13.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 71 1.67 MB/sec warmup 19 sec latency 3087.121 ms 2023-12-13T22:41:14.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 75 1.68 MB/sec warmup 20 sec latency 3583.944 ms 2023-12-13T22:41:15.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 79 1.68 MB/sec warmup 21 sec latency 3465.674 ms 2023-12-13T22:41:16.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 85 1.73 MB/sec warmup 22 sec latency 2772.811 ms 2023-12-13T22:41:17.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 92 1.84 MB/sec warmup 23 sec latency 2598.361 ms 2023-12-13T22:41:18.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 96 1.85 MB/sec warmup 24 sec latency 2196.935 ms 2023-12-13T22:41:19.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 98 1.82 MB/sec warmup 25 sec latency 3114.427 ms 2023-12-13T22:41:20.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 104 1.83 MB/sec warmup 26 sec latency 3464.546 ms 2023-12-13T22:41:21.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 110 1.91 MB/sec warmup 27 sec latency 2439.383 ms 2023-12-13T22:41:22.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 115 1.91 MB/sec warmup 28 sec latency 2542.253 ms 2023-12-13T22:41:23.759 INFO:tasks.workunit.client.0.smithi091.stdout: 10 115 1.84 MB/sec warmup 29 sec latency 2195.315 ms 2023-12-13T22:41:24.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 119 1.81 MB/sec warmup 30 sec latency 2068.943 ms 2023-12-13T22:41:25.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 122 1.78 MB/sec warmup 31 sec latency 1607.424 ms 2023-12-13T22:41:26.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 125 1.75 MB/sec warmup 32 sec latency 2137.616 ms 2023-12-13T22:41:27.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 129 1.75 MB/sec warmup 33 sec latency 2513.188 ms 2023-12-13T22:41:28.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 132 1.73 MB/sec warmup 34 sec latency 1892.475 ms 2023-12-13T22:41:29.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 135 1.70 MB/sec warmup 35 sec latency 1960.112 ms 2023-12-13T22:41:30.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 140 1.70 MB/sec warmup 36 sec latency 1870.298 ms 2023-12-13T22:41:31.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 141 1.66 MB/sec warmup 37 sec latency 1632.484 ms 2023-12-13T22:41:32.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 145 1.64 MB/sec warmup 38 sec latency 1828.816 ms 2023-12-13T22:41:32.839 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:41:32.842 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:41:33.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 148 1.62 MB/sec warmup 39 sec latency 1545.034 ms 2023-12-13T22:41:34.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 152 1.61 MB/sec warmup 40 sec latency 2001.265 ms 2023-12-13T22:41:35.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 156 1.60 MB/sec warmup 41 sec latency 2158.641 ms 2023-12-13T22:41:36.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 159 1.59 MB/sec warmup 42 sec latency 1891.993 ms 2023-12-13T22:41:37.760 INFO:tasks.workunit.client.0.smithi091.stdout: 10 161 1.56 MB/sec warmup 43 sec latency 1932.316 ms 2023-12-13T22:41:38.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 166 1.55 MB/sec warmup 44 sec latency 1639.804 ms 2023-12-13T22:41:39.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 169 1.54 MB/sec warmup 45 sec latency 1757.094 ms 2023-12-13T22:41:39.813 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:03.976 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:39.819 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:03.981 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.002 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:04.108 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.005 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:04.111 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.010 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:04.115 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.010 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:04.116 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.199 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:04.361 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.338 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:04.443 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.365 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:04.470 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:41:40.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 175 1.55 MB/sec warmup 46 sec latency 1835.101 ms 2023-12-13T22:41:41.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 182 1.56 MB/sec warmup 47 sec latency 1224.807 ms 2023-12-13T22:41:42.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 190 1.59 MB/sec warmup 48 sec latency 1425.770 ms 2023-12-13T22:41:43.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 192 1.57 MB/sec warmup 49 sec latency 1636.825 ms 2023-12-13T22:41:44.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 197 1.56 MB/sec warmup 50 sec latency 2248.492 ms 2023-12-13T22:41:45.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 199 1.55 MB/sec warmup 51 sec latency 2922.873 ms 2023-12-13T22:41:46.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 203 1.54 MB/sec warmup 52 sec latency 3280.964 ms 2023-12-13T22:41:47.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 208 1.53 MB/sec warmup 53 sec latency 1761.497 ms 2023-12-13T22:41:48.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 210 1.52 MB/sec warmup 54 sec latency 1694.140 ms 2023-12-13T22:41:49.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 214 1.52 MB/sec warmup 55 sec latency 2076.170 ms 2023-12-13T22:41:50.761 INFO:tasks.workunit.client.0.smithi091.stdout: 10 218 1.51 MB/sec warmup 56 sec latency 1798.685 ms 2023-12-13T22:41:51.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 220 1.50 MB/sec warmup 57 sec latency 2167.041 ms 2023-12-13T22:41:52.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 224 1.50 MB/sec warmup 58 sec latency 2307.972 ms 2023-12-13T22:41:53.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 226 1.48 MB/sec warmup 59 sec latency 2064.813 ms 2023-12-13T22:41:54.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 232 1.48 MB/sec warmup 60 sec latency 2660.950 ms 2023-12-13T22:41:55.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 235 1.48 MB/sec warmup 61 sec latency 3188.336 ms 2023-12-13T22:41:56.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 236 1.46 MB/sec warmup 62 sec latency 2281.447 ms 2023-12-13T22:41:57.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 241 1.46 MB/sec warmup 63 sec latency 2362.321 ms 2023-12-13T22:41:58.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 244 1.46 MB/sec warmup 64 sec latency 2503.117 ms 2023-12-13T22:41:59.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 247 1.45 MB/sec warmup 65 sec latency 2143.594 ms 2023-12-13T22:42:00.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 250 1.44 MB/sec warmup 66 sec latency 2063.312 ms 2023-12-13T22:42:01.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 253 1.43 MB/sec warmup 67 sec latency 2195.707 ms 2023-12-13T22:42:02.762 INFO:tasks.workunit.client.0.smithi091.stdout: 10 256 1.42 MB/sec warmup 68 sec latency 2329.587 ms 2023-12-13T22:42:02.937 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:42:02.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:42:03.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 261 1.43 MB/sec warmup 69 sec latency 2166.654 ms 2023-12-13T22:42:04.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 262 1.41 MB/sec warmup 70 sec latency 2172.395 ms 2023-12-13T22:42:05.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 265 1.40 MB/sec warmup 71 sec latency 2482.006 ms 2023-12-13T22:42:06.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 268 1.40 MB/sec warmup 72 sec latency 2201.563 ms 2023-12-13T22:42:07.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 270 1.39 MB/sec warmup 73 sec latency 2294.724 ms 2023-12-13T22:42:08.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 275 1.40 MB/sec warmup 74 sec latency 2303.352 ms 2023-12-13T22:42:09.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 277 1.38 MB/sec warmup 75 sec latency 2089.472 ms 2023-12-13T22:42:10.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 279 1.37 MB/sec warmup 76 sec latency 2254.433 ms 2023-12-13T22:42:11.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 284 1.38 MB/sec warmup 77 sec latency 2401.996 ms 2023-12-13T22:42:12.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 285 1.36 MB/sec warmup 78 sec latency 2171.907 ms 2023-12-13T22:42:13.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 289 1.36 MB/sec warmup 79 sec latency 2257.049 ms 2023-12-13T22:42:14.763 INFO:tasks.workunit.client.0.smithi091.stdout: 10 291 1.35 MB/sec warmup 80 sec latency 2160.586 ms 2023-12-13T22:42:15.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 294 1.34 MB/sec warmup 81 sec latency 2084.701 ms 2023-12-13T22:42:16.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 298 1.34 MB/sec warmup 82 sec latency 2085.886 ms 2023-12-13T22:42:17.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 301 1.34 MB/sec warmup 83 sec latency 1853.090 ms 2023-12-13T22:42:18.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 304 1.33 MB/sec warmup 84 sec latency 1868.194 ms 2023-12-13T22:42:19.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 307 1.33 MB/sec warmup 85 sec latency 2062.783 ms 2023-12-13T22:42:20.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 309 1.32 MB/sec warmup 86 sec latency 3062.846 ms 2023-12-13T22:42:21.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 312 1.32 MB/sec warmup 87 sec latency 3201.569 ms 2023-12-13T22:42:22.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 315 1.31 MB/sec warmup 88 sec latency 2898.193 ms 2023-12-13T22:42:23.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 318 1.30 MB/sec warmup 89 sec latency 2143.515 ms 2023-12-13T22:42:24.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 322 1.30 MB/sec warmup 90 sec latency 2419.563 ms 2023-12-13T22:42:25.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 325 1.30 MB/sec warmup 91 sec latency 1520.519 ms 2023-12-13T22:42:26.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 328 1.30 MB/sec warmup 92 sec latency 1924.707 ms 2023-12-13T22:42:27.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 332 1.29 MB/sec warmup 93 sec latency 2064.292 ms 2023-12-13T22:42:28.764 INFO:tasks.workunit.client.0.smithi091.stdout: 10 335 1.29 MB/sec warmup 94 sec latency 1807.573 ms 2023-12-13T22:42:29.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 338 1.29 MB/sec warmup 95 sec latency 2038.508 ms 2023-12-13T22:42:30.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 341 1.28 MB/sec warmup 96 sec latency 2335.872 ms 2023-12-13T22:42:31.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 344 1.28 MB/sec warmup 97 sec latency 2117.758 ms 2023-12-13T22:42:32.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 346 1.27 MB/sec warmup 98 sec latency 2242.678 ms 2023-12-13T22:42:32.984 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:42:32.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:42:33.512 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:57.675 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.524 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:57.687 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.646 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:17:57.809 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.713 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:57.819 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.720 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:57.825 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.727 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:57.833 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.736 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:57.842 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 352 1.28 MB/sec warmup 99 sec latency 2299.911 ms 2023-12-13T22:42:33.846 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:17:57.952 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:33.888 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:17:57.994 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:42:34.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 358 1.28 MB/sec warmup 100 sec latency 1680.172 ms 2023-12-13T22:42:35.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 363 1.28 MB/sec warmup 101 sec latency 1502.451 ms 2023-12-13T22:42:36.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 366 1.28 MB/sec warmup 102 sec latency 1785.653 ms 2023-12-13T22:42:37.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 369 1.28 MB/sec warmup 103 sec latency 1889.787 ms 2023-12-13T22:42:38.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 373 1.28 MB/sec warmup 104 sec latency 2206.373 ms 2023-12-13T22:42:39.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 376 1.28 MB/sec warmup 105 sec latency 1984.200 ms 2023-12-13T22:42:40.765 INFO:tasks.workunit.client.0.smithi091.stdout: 10 379 1.27 MB/sec warmup 106 sec latency 2212.437 ms 2023-12-13T22:42:41.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 383 1.27 MB/sec warmup 107 sec latency 2606.428 ms 2023-12-13T22:42:42.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 386 1.27 MB/sec warmup 108 sec latency 2615.451 ms 2023-12-13T22:42:43.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 390 1.27 MB/sec warmup 109 sec latency 2053.388 ms 2023-12-13T22:42:44.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 392 1.27 MB/sec warmup 110 sec latency 2322.186 ms 2023-12-13T22:42:45.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 395 1.26 MB/sec warmup 111 sec latency 2166.451 ms 2023-12-13T22:42:46.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 399 1.26 MB/sec warmup 112 sec latency 2310.456 ms 2023-12-13T22:42:47.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 401 1.26 MB/sec warmup 113 sec latency 2431.562 ms 2023-12-13T22:42:48.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 405 1.26 MB/sec warmup 114 sec latency 3214.627 ms 2023-12-13T22:42:49.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 408 1.25 MB/sec warmup 115 sec latency 2051.899 ms 2023-12-13T22:42:50.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 412 1.26 MB/sec warmup 116 sec latency 2174.487 ms 2023-12-13T22:42:51.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 414 1.25 MB/sec warmup 117 sec latency 2356.572 ms 2023-12-13T22:42:52.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 417 1.25 MB/sec warmup 118 sec latency 2802.914 ms 2023-12-13T22:42:53.766 INFO:tasks.workunit.client.0.smithi091.stdout: 10 422 1.25 MB/sec warmup 119 sec latency 2437.103 ms 2023-12-13T22:42:55.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 426 0.98 MB/sec execute 1 sec latency 3007.090 ms 2023-12-13T22:42:56.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 430 1.30 MB/sec execute 2 sec latency 3018.400 ms 2023-12-13T22:42:57.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 432 1.04 MB/sec execute 3 sec latency 2068.139 ms 2023-12-13T22:42:58.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 437 1.20 MB/sec execute 4 sec latency 2602.029 ms 2023-12-13T22:42:59.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 439 1.04 MB/sec execute 5 sec latency 2905.607 ms 2023-12-13T22:43:00.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 441 0.99 MB/sec execute 6 sec latency 2417.480 ms 2023-12-13T22:43:01.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 444 0.98 MB/sec execute 7 sec latency 2595.882 ms 2023-12-13T22:43:02.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 448 1.03 MB/sec execute 8 sec latency 2594.414 ms 2023-12-13T22:43:03.097 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:43:03.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:43:03.767 INFO:tasks.workunit.client.0.smithi091.stdout: 10 450 1.01 MB/sec execute 9 sec latency 2462.766 ms 2023-12-13T22:43:04.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 454 1.01 MB/sec execute 10 sec latency 2629.060 ms 2023-12-13T22:43:05.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 457 1.01 MB/sec execute 11 sec latency 2850.768 ms 2023-12-13T22:43:06.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 458 0.98 MB/sec execute 12 sec latency 2396.381 ms 2023-12-13T22:43:07.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 463 1.01 MB/sec execute 13 sec latency 2887.354 ms 2023-12-13T22:43:08.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 464 0.97 MB/sec execute 14 sec latency 2586.213 ms 2023-12-13T22:43:09.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 466 0.94 MB/sec execute 15 sec latency 3399.898 ms 2023-12-13T22:43:10.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 470 0.96 MB/sec execute 16 sec latency 2591.388 ms 2023-12-13T22:43:11.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 473 0.96 MB/sec execute 17 sec latency 2057.771 ms 2023-12-13T22:43:12.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 474 0.92 MB/sec execute 18 sec latency 2752.522 ms 2023-12-13T22:43:13.768 INFO:tasks.workunit.client.0.smithi091.stdout: 10 478 0.94 MB/sec execute 19 sec latency 2778.973 ms 2023-12-13T22:43:14.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 481 0.95 MB/sec execute 20 sec latency 2821.026 ms 2023-12-13T22:43:15.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 482 0.92 MB/sec execute 21 sec latency 2494.303 ms 2023-12-13T22:43:16.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 485 0.92 MB/sec execute 22 sec latency 3494.359 ms 2023-12-13T22:43:17.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 489 0.94 MB/sec execute 23 sec latency 3505.062 ms 2023-12-13T22:43:18.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 490 0.90 MB/sec execute 24 sec latency 2278.253 ms 2023-12-13T22:43:19.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 493 0.90 MB/sec execute 25 sec latency 2502.082 ms 2023-12-13T22:43:20.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 499 0.95 MB/sec execute 26 sec latency 1829.695 ms 2023-12-13T22:43:21.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 500 0.93 MB/sec execute 27 sec latency 2474.033 ms 2023-12-13T22:43:22.769 INFO:tasks.workunit.client.0.smithi091.stdout: 10 503 0.93 MB/sec execute 28 sec latency 2634.988 ms 2023-12-13T22:43:23.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 509 0.96 MB/sec execute 29 sec latency 2878.363 ms 2023-12-13T22:43:24.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 511 0.94 MB/sec execute 30 sec latency 2911.757 ms 2023-12-13T22:43:25.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 515 0.97 MB/sec execute 31 sec latency 2362.350 ms 2023-12-13T22:43:26.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 522 1.01 MB/sec execute 32 sec latency 1872.059 ms 2023-12-13T22:43:27.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 526 1.01 MB/sec execute 33 sec latency 2359.860 ms 2023-12-13T22:43:28.424 INFO:tasks.ceph.mds.f.smithi152.stderr:2023-12-13T22:43:28.337+0000 d1af640 -1 mds.0.bal find_exports balancer runs too long 2023-12-13T22:43:28.424 INFO:tasks.ceph.mds.f.smithi152.stderr:2023-12-13T22:43:28.337+0000 d1af640 -1 mds.0.bal find_exports balancer runs too long 2023-12-13T22:43:28.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 529 1.04 MB/sec execute 34 sec latency 2572.826 ms 2023-12-13T22:43:29.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 535 1.05 MB/sec execute 35 sec latency 3041.683 ms 2023-12-13T22:43:30.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 541 1.06 MB/sec execute 36 sec latency 3167.860 ms 2023-12-13T22:43:31.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 545 1.06 MB/sec execute 37 sec latency 2444.404 ms 2023-12-13T22:43:32.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 550 1.09 MB/sec execute 38 sec latency 3093.308 ms 2023-12-13T22:43:33.265 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:43:33.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:43:33.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 555 1.10 MB/sec execute 39 sec latency 3518.215 ms 2023-12-13T22:43:34.770 INFO:tasks.workunit.client.0.smithi091.stdout: 10 559 1.11 MB/sec execute 40 sec latency 1972.552 ms 2023-12-13T22:43:35.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 562 1.13 MB/sec execute 41 sec latency 2771.628 ms 2023-12-13T22:43:36.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 565 1.12 MB/sec execute 42 sec latency 3138.232 ms 2023-12-13T22:43:37.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 568 1.11 MB/sec execute 43 sec latency 3628.690 ms 2023-12-13T22:43:38.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 572 1.12 MB/sec execute 44 sec latency 3061.646 ms 2023-12-13T22:43:39.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 576 1.11 MB/sec execute 45 sec latency 3082.379 ms 2023-12-13T22:43:40.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 582 1.11 MB/sec execute 46 sec latency 2513.972 ms 2023-12-13T22:43:41.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 588 1.11 MB/sec execute 47 sec latency 3180.845 ms 2023-12-13T22:43:42.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 595 1.12 MB/sec execute 48 sec latency 3375.238 ms 2023-12-13T22:43:43.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 602 1.16 MB/sec execute 49 sec latency 3340.804 ms 2023-12-13T22:43:44.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 605 1.16 MB/sec execute 50 sec latency 2999.281 ms 2023-12-13T22:43:45.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 609 1.14 MB/sec execute 51 sec latency 2937.267 ms 2023-12-13T22:43:46.771 INFO:tasks.workunit.client.0.smithi091.stdout: 10 611 1.13 MB/sec execute 52 sec latency 2927.995 ms 2023-12-13T22:43:47.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 614 1.11 MB/sec execute 53 sec latency 3606.191 ms 2023-12-13T22:43:48.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 616 1.09 MB/sec execute 54 sec latency 3604.866 ms 2023-12-13T22:43:49.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 621 1.07 MB/sec execute 55 sec latency 3778.507 ms 2023-12-13T22:43:50.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 623 1.07 MB/sec execute 56 sec latency 3466.023 ms 2023-12-13T22:43:51.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 626 1.07 MB/sec execute 57 sec latency 3290.759 ms 2023-12-13T22:43:52.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 627 1.05 MB/sec execute 58 sec latency 3222.532 ms 2023-12-13T22:43:53.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 627 1.03 MB/sec execute 59 sec latency 3518.477 ms 2023-12-13T22:43:54.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 630 1.02 MB/sec execute 60 sec latency 3703.513 ms 2023-12-13T22:43:55.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 633 1.00 MB/sec execute 61 sec latency 2866.367 ms 2023-12-13T22:43:56.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 634 0.99 MB/sec execute 62 sec latency 2498.326 ms 2023-12-13T22:43:57.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 635 0.97 MB/sec execute 63 sec latency 3258.463 ms 2023-12-13T22:43:58.772 INFO:tasks.workunit.client.0.smithi091.stdout: 10 640 0.96 MB/sec execute 64 sec latency 3634.677 ms 2023-12-13T22:43:59.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 643 0.94 MB/sec execute 65 sec latency 2924.563 ms 2023-12-13T22:44:00.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 644 0.93 MB/sec execute 66 sec latency 3391.858 ms 2023-12-13T22:44:01.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 647 0.92 MB/sec execute 67 sec latency 3730.501 ms 2023-12-13T22:44:02.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 648 0.91 MB/sec execute 68 sec latency 3003.560 ms 2023-12-13T22:44:03.343 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:44:03.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:44:03.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 650 0.89 MB/sec execute 69 sec latency 3489.441 ms 2023-12-13T22:44:04.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 653 0.88 MB/sec execute 70 sec latency 3665.306 ms 2023-12-13T22:44:05.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 656 0.87 MB/sec execute 71 sec latency 1824.308 ms 2023-12-13T22:44:06.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 658 0.86 MB/sec execute 72 sec latency 2824.371 ms 2023-12-13T22:44:07.773 INFO:tasks.workunit.client.0.smithi091.stdout: 10 660 0.85 MB/sec execute 73 sec latency 3260.432 ms 2023-12-13T22:44:08.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 662 0.84 MB/sec execute 74 sec latency 3475.406 ms 2023-12-13T22:44:09.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 662 0.83 MB/sec execute 75 sec latency 2934.786 ms 2023-12-13T22:44:10.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 663 0.82 MB/sec execute 76 sec latency 3178.064 ms 2023-12-13T22:44:11.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 664 0.81 MB/sec execute 77 sec latency 3315.415 ms 2023-12-13T22:44:12.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 666 0.80 MB/sec execute 78 sec latency 3149.037 ms 2023-12-13T22:44:13.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 668 0.79 MB/sec execute 79 sec latency 2999.447 ms 2023-12-13T22:44:14.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 672 0.78 MB/sec execute 80 sec latency 3629.376 ms 2023-12-13T22:44:15.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 674 0.77 MB/sec execute 81 sec latency 3059.965 ms 2023-12-13T22:44:16.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 676 0.76 MB/sec execute 82 sec latency 1774.094 ms 2023-12-13T22:44:17.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 679 0.75 MB/sec execute 83 sec latency 2537.049 ms 2023-12-13T22:44:18.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 681 0.74 MB/sec execute 84 sec latency 3472.839 ms 2023-12-13T22:44:19.774 INFO:tasks.workunit.client.0.smithi091.stdout: 10 686 0.74 MB/sec execute 85 sec latency 3186.929 ms 2023-12-13T22:44:20.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 688 0.73 MB/sec execute 86 sec latency 1941.942 ms 2023-12-13T22:44:21.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 689 0.72 MB/sec execute 87 sec latency 2942.006 ms 2023-12-13T22:44:22.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 691 0.71 MB/sec execute 88 sec latency 3128.200 ms 2023-12-13T22:44:23.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 692 0.70 MB/sec execute 89 sec latency 3219.074 ms 2023-12-13T22:44:24.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 696 0.70 MB/sec execute 90 sec latency 3170.261 ms 2023-12-13T22:44:25.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 698 0.69 MB/sec execute 91 sec latency 1738.918 ms 2023-12-13T22:44:26.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 701 0.69 MB/sec execute 92 sec latency 2738.994 ms 2023-12-13T22:44:27.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 704 0.68 MB/sec execute 93 sec latency 3195.062 ms 2023-12-13T22:44:28.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 708 0.67 MB/sec execute 94 sec latency 2128.659 ms 2023-12-13T22:44:29.775 INFO:tasks.workunit.client.0.smithi091.stdout: 10 711 0.67 MB/sec execute 95 sec latency 2516.197 ms 2023-12-13T22:44:30.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 714 0.66 MB/sec execute 96 sec latency 1387.960 ms 2023-12-13T22:44:31.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 716 0.65 MB/sec execute 97 sec latency 2385.196 ms 2023-12-13T22:44:32.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 717 0.65 MB/sec execute 98 sec latency 2146.211 ms 2023-12-13T22:44:33.472 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:44:33.474 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:44:33.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 720 0.64 MB/sec execute 99 sec latency 2696.533 ms 2023-12-13T22:44:34.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 722 0.63 MB/sec execute 100 sec latency 3287.529 ms 2023-12-13T22:44:35.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 723 0.63 MB/sec execute 101 sec latency 2674.046 ms 2023-12-13T22:44:36.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 725 0.62 MB/sec execute 102 sec latency 2786.351 ms 2023-12-13T22:44:37.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 728 0.62 MB/sec execute 103 sec latency 2815.342 ms 2023-12-13T22:44:38.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 733 0.61 MB/sec execute 104 sec latency 2651.755 ms 2023-12-13T22:44:39.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 737 0.61 MB/sec execute 105 sec latency 2721.285 ms 2023-12-13T22:44:40.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 741 0.60 MB/sec execute 106 sec latency 1999.980 ms 2023-12-13T22:44:41.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 744 0.60 MB/sec execute 107 sec latency 2147.178 ms 2023-12-13T22:44:42.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 747 0.59 MB/sec execute 108 sec latency 1863.317 ms 2023-12-13T22:44:43.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 749 0.59 MB/sec execute 109 sec latency 2650.453 ms 2023-12-13T22:44:44.776 INFO:tasks.workunit.client.0.smithi091.stdout: 10 752 0.58 MB/sec execute 110 sec latency 1911.729 ms 2023-12-13T22:44:45.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 755 0.58 MB/sec execute 111 sec latency 2143.330 ms 2023-12-13T22:44:46.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 756 0.57 MB/sec execute 112 sec latency 3125.519 ms 2023-12-13T22:44:47.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 758 0.57 MB/sec execute 113 sec latency 3292.496 ms 2023-12-13T22:44:48.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 761 0.56 MB/sec execute 114 sec latency 3520.854 ms 2023-12-13T22:44:49.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 763 0.56 MB/sec execute 115 sec latency 3444.348 ms 2023-12-13T22:44:50.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 764 0.56 MB/sec execute 116 sec latency 2013.945 ms 2023-12-13T22:44:51.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 768 0.55 MB/sec execute 117 sec latency 2844.950 ms 2023-12-13T22:44:52.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 772 0.55 MB/sec execute 118 sec latency 3221.024 ms 2023-12-13T22:44:53.777 INFO:tasks.workunit.client.0.smithi091.stdout: 10 776 0.54 MB/sec execute 119 sec latency 1376.725 ms 2023-12-13T22:44:54.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 779 0.54 MB/sec execute 120 sec latency 2376.828 ms 2023-12-13T22:44:55.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 781 0.54 MB/sec execute 121 sec latency 2942.920 ms 2023-12-13T22:44:56.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 784 0.53 MB/sec execute 122 sec latency 3071.040 ms 2023-12-13T22:44:57.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 787 0.53 MB/sec execute 123 sec latency 2574.904 ms 2023-12-13T22:44:58.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 789 0.52 MB/sec execute 124 sec latency 2776.017 ms 2023-12-13T22:44:59.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 790 0.52 MB/sec execute 125 sec latency 2820.702 ms 2023-12-13T22:45:00.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 792 0.52 MB/sec execute 126 sec latency 3073.936 ms 2023-12-13T22:45:01.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 793 0.51 MB/sec execute 127 sec latency 2955.492 ms 2023-12-13T22:45:02.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 796 0.51 MB/sec execute 128 sec latency 3212.180 ms 2023-12-13T22:45:03.511 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:45:03.513 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:45:03.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 798 0.51 MB/sec execute 129 sec latency 2651.651 ms 2023-12-13T22:45:04.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 800 0.50 MB/sec execute 130 sec latency 2495.265 ms 2023-12-13T22:45:05.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 802 0.50 MB/sec execute 131 sec latency 2452.297 ms 2023-12-13T22:45:06.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 805 0.50 MB/sec execute 132 sec latency 2916.099 ms 2023-12-13T22:45:07.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 808 0.49 MB/sec execute 133 sec latency 3264.698 ms 2023-12-13T22:45:08.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 812 0.49 MB/sec execute 134 sec latency 2977.759 ms 2023-12-13T22:45:09.778 INFO:tasks.workunit.client.0.smithi091.stdout: 10 815 0.49 MB/sec execute 135 sec latency 2869.668 ms 2023-12-13T22:45:10.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 821 0.48 MB/sec execute 136 sec latency 3233.160 ms 2023-12-13T22:45:11.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 826 0.48 MB/sec execute 137 sec latency 2819.906 ms 2023-12-13T22:45:12.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 828 0.48 MB/sec execute 138 sec latency 2131.279 ms 2023-12-13T22:45:13.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 829 0.47 MB/sec execute 139 sec latency 2741.334 ms 2023-12-13T22:45:14.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 829 0.47 MB/sec execute 140 sec latency 3691.241 ms 2023-12-13T22:45:15.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 829 0.47 MB/sec execute 141 sec latency 3797.545 ms 2023-12-13T22:45:16.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 830 0.46 MB/sec execute 142 sec latency 3432.167 ms 2023-12-13T22:45:17.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 831 0.46 MB/sec execute 143 sec latency 3467.991 ms 2023-12-13T22:45:18.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 831 0.46 MB/sec execute 144 sec latency 3398.259 ms 2023-12-13T22:45:19.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 832 0.46 MB/sec execute 145 sec latency 3829.850 ms 2023-12-13T22:45:20.779 INFO:tasks.workunit.client.0.smithi091.stdout: 10 834 0.45 MB/sec execute 146 sec latency 3927.803 ms 2023-12-13T22:45:21.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 837 0.45 MB/sec execute 147 sec latency 3616.314 ms 2023-12-13T22:45:22.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 839 0.45 MB/sec execute 148 sec latency 2611.047 ms 2023-12-13T22:45:23.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 839 0.44 MB/sec execute 149 sec latency 2929.643 ms 2023-12-13T22:45:24.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 842 0.44 MB/sec execute 150 sec latency 2990.524 ms 2023-12-13T22:45:25.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 843 0.44 MB/sec execute 151 sec latency 3392.537 ms 2023-12-13T22:45:26.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 845 0.44 MB/sec execute 152 sec latency 3435.548 ms 2023-12-13T22:45:27.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 847 0.43 MB/sec execute 153 sec latency 3468.576 ms 2023-12-13T22:45:28.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 851 0.43 MB/sec execute 154 sec latency 3095.875 ms 2023-12-13T22:45:29.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 855 0.43 MB/sec execute 155 sec latency 3400.274 ms 2023-12-13T22:45:30.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 859 0.43 MB/sec execute 156 sec latency 3628.627 ms 2023-12-13T22:45:31.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 861 0.43 MB/sec execute 157 sec latency 2924.699 ms 2023-12-13T22:45:32.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 864 0.42 MB/sec execute 158 sec latency 2457.414 ms 2023-12-13T22:45:33.559 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:45:33.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:45:33.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 866 0.42 MB/sec execute 159 sec latency 3457.492 ms 2023-12-13T22:45:34.780 INFO:tasks.workunit.client.0.smithi091.stdout: 10 867 0.42 MB/sec execute 160 sec latency 3581.979 ms 2023-12-13T22:45:35.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 869 0.42 MB/sec execute 161 sec latency 3404.232 ms 2023-12-13T22:45:36.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 870 0.41 MB/sec execute 162 sec latency 3018.339 ms 2023-12-13T22:45:37.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 872 0.41 MB/sec execute 163 sec latency 3513.279 ms 2023-12-13T22:45:38.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 873 0.41 MB/sec execute 164 sec latency 3729.225 ms 2023-12-13T22:45:39.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 874 0.41 MB/sec execute 165 sec latency 3379.754 ms 2023-12-13T22:45:40.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 876 0.40 MB/sec execute 166 sec latency 3076.976 ms 2023-12-13T22:45:41.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 878 0.40 MB/sec execute 167 sec latency 3101.334 ms 2023-12-13T22:45:42.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 879 0.40 MB/sec execute 168 sec latency 1743.073 ms 2023-12-13T22:45:43.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 880 0.40 MB/sec execute 169 sec latency 2295.525 ms 2023-12-13T22:45:44.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 883 0.40 MB/sec execute 170 sec latency 3107.914 ms 2023-12-13T22:45:45.781 INFO:tasks.workunit.client.0.smithi091.stdout: 10 885 0.39 MB/sec execute 171 sec latency 2728.852 ms 2023-12-13T22:45:46.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 886 0.39 MB/sec execute 172 sec latency 2555.309 ms 2023-12-13T22:45:47.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 889 0.39 MB/sec execute 173 sec latency 3309.221 ms 2023-12-13T22:45:48.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 892 0.39 MB/sec execute 174 sec latency 3419.152 ms 2023-12-13T22:45:49.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 894 0.39 MB/sec execute 175 sec latency 3418.154 ms 2023-12-13T22:45:50.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 896 0.38 MB/sec execute 176 sec latency 2158.870 ms 2023-12-13T22:45:51.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 899 0.38 MB/sec execute 177 sec latency 2584.053 ms 2023-12-13T22:45:52.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 900 0.38 MB/sec execute 178 sec latency 3176.652 ms 2023-12-13T22:45:53.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 902 0.38 MB/sec execute 179 sec latency 3223.103 ms 2023-12-13T22:45:54.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 903 0.38 MB/sec execute 180 sec latency 3040.408 ms 2023-12-13T22:45:55.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 904 0.38 MB/sec execute 181 sec latency 3384.512 ms 2023-12-13T22:45:56.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 905 0.37 MB/sec execute 182 sec latency 3425.378 ms 2023-12-13T22:45:57.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 907 0.37 MB/sec execute 183 sec latency 3202.989 ms 2023-12-13T22:45:58.782 INFO:tasks.workunit.client.0.smithi091.stdout: 10 909 0.37 MB/sec execute 184 sec latency 3533.387 ms 2023-12-13T22:45:59.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 910 0.37 MB/sec execute 185 sec latency 1808.728 ms 2023-12-13T22:46:00.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 912 0.37 MB/sec execute 186 sec latency 2125.428 ms 2023-12-13T22:46:01.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 914 0.36 MB/sec execute 187 sec latency 3090.077 ms 2023-12-13T22:46:02.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 915 0.36 MB/sec execute 188 sec latency 2805.487 ms 2023-12-13T22:46:03.606 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:46:03.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:46:03.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 917 0.36 MB/sec execute 189 sec latency 2347.749 ms 2023-12-13T22:46:04.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 919 0.36 MB/sec execute 190 sec latency 3002.308 ms 2023-12-13T22:46:05.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 921 0.36 MB/sec execute 191 sec latency 2807.141 ms 2023-12-13T22:46:06.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 922 0.36 MB/sec execute 192 sec latency 1891.430 ms 2023-12-13T22:46:07.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 923 0.35 MB/sec execute 193 sec latency 2891.491 ms 2023-12-13T22:46:08.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 925 0.35 MB/sec execute 194 sec latency 2989.679 ms 2023-12-13T22:46:09.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 926 0.35 MB/sec execute 195 sec latency 3359.059 ms 2023-12-13T22:46:10.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 926 0.35 MB/sec execute 196 sec latency 3184.564 ms 2023-12-13T22:46:11.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 930 0.35 MB/sec execute 197 sec latency 3351.680 ms 2023-12-13T22:46:12.783 INFO:tasks.workunit.client.0.smithi091.stdout: 10 931 0.35 MB/sec execute 198 sec latency 3397.761 ms 2023-12-13T22:46:13.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 933 0.34 MB/sec execute 199 sec latency 2793.957 ms 2023-12-13T22:46:14.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 936 0.34 MB/sec execute 200 sec latency 2951.807 ms 2023-12-13T22:46:15.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 938 0.34 MB/sec execute 201 sec latency 2974.581 ms 2023-12-13T22:46:16.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 940 0.34 MB/sec execute 202 sec latency 2889.310 ms 2023-12-13T22:46:17.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 942 0.34 MB/sec execute 203 sec latency 2768.080 ms 2023-12-13T22:46:18.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 943 0.34 MB/sec execute 204 sec latency 2954.337 ms 2023-12-13T22:46:19.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 945 0.34 MB/sec execute 205 sec latency 3225.762 ms 2023-12-13T22:46:20.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 945 0.33 MB/sec execute 206 sec latency 3378.453 ms 2023-12-13T22:46:21.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 947 0.33 MB/sec execute 207 sec latency 3491.112 ms 2023-12-13T22:46:22.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 948 0.33 MB/sec execute 208 sec latency 2934.555 ms 2023-12-13T22:46:23.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 949 0.33 MB/sec execute 209 sec latency 3048.736 ms 2023-12-13T22:46:24.784 INFO:tasks.workunit.client.0.smithi091.stdout: 10 951 0.33 MB/sec execute 210 sec latency 3627.780 ms 2023-12-13T22:46:25.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 952 0.33 MB/sec execute 211 sec latency 2795.225 ms 2023-12-13T22:46:26.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 955 0.33 MB/sec execute 212 sec latency 3066.904 ms 2023-12-13T22:46:27.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 957 0.32 MB/sec execute 213 sec latency 3386.415 ms 2023-12-13T22:46:28.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 959 0.32 MB/sec execute 214 sec latency 2911.410 ms 2023-12-13T22:46:29.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 961 0.32 MB/sec execute 215 sec latency 3112.307 ms 2023-12-13T22:46:30.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 963 0.32 MB/sec execute 216 sec latency 2672.059 ms 2023-12-13T22:46:31.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 964 0.32 MB/sec execute 217 sec latency 3310.523 ms 2023-12-13T22:46:32.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 966 0.32 MB/sec execute 218 sec latency 3386.342 ms 2023-12-13T22:46:33.719 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:46:33.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:46:33.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 968 0.32 MB/sec execute 219 sec latency 3430.744 ms 2023-12-13T22:46:34.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 971 0.32 MB/sec execute 220 sec latency 3209.580 ms 2023-12-13T22:46:35.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 974 0.32 MB/sec execute 221 sec latency 2820.878 ms 2023-12-13T22:46:36.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 977 0.32 MB/sec execute 222 sec latency 2284.494 ms 2023-12-13T22:46:37.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 982 0.33 MB/sec execute 223 sec latency 3284.550 ms 2023-12-13T22:46:38.785 INFO:tasks.workunit.client.0.smithi091.stdout: 10 986 0.33 MB/sec execute 224 sec latency 3299.718 ms 2023-12-13T22:46:39.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 988 0.33 MB/sec execute 225 sec latency 3167.354 ms 2023-12-13T22:46:40.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 989 0.32 MB/sec execute 226 sec latency 3381.010 ms 2023-12-13T22:46:41.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 991 0.32 MB/sec execute 227 sec latency 3386.687 ms 2023-12-13T22:46:42.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 993 0.32 MB/sec execute 228 sec latency 3195.053 ms 2023-12-13T22:46:43.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 994 0.32 MB/sec execute 229 sec latency 2989.651 ms 2023-12-13T22:46:44.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 997 0.32 MB/sec execute 230 sec latency 3523.193 ms 2023-12-13T22:46:45.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 999 0.32 MB/sec execute 231 sec latency 3367.285 ms 2023-12-13T22:46:46.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1001 0.32 MB/sec execute 232 sec latency 2842.794 ms 2023-12-13T22:46:47.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1005 0.32 MB/sec execute 233 sec latency 3002.348 ms 2023-12-13T22:46:48.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1008 0.32 MB/sec execute 234 sec latency 1036.957 ms 2023-12-13T22:46:49.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1010 0.32 MB/sec execute 235 sec latency 1988.348 ms 2023-12-13T22:46:50.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1013 0.32 MB/sec execute 236 sec latency 2651.031 ms 2023-12-13T22:46:51.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1015 0.32 MB/sec execute 237 sec latency 3043.976 ms 2023-12-13T22:46:52.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1016 0.32 MB/sec execute 238 sec latency 3487.448 ms 2023-12-13T22:46:53.786 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1018 0.32 MB/sec execute 239 sec latency 3255.486 ms 2023-12-13T22:46:54.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1020 0.32 MB/sec execute 240 sec latency 3594.608 ms 2023-12-13T22:46:55.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1022 0.32 MB/sec execute 241 sec latency 2699.259 ms 2023-12-13T22:46:56.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1023 0.32 MB/sec execute 242 sec latency 3171.108 ms 2023-12-13T22:46:57.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1025 0.32 MB/sec execute 243 sec latency 3227.922 ms 2023-12-13T22:46:58.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1026 0.31 MB/sec execute 244 sec latency 3590.465 ms 2023-12-13T22:46:59.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1028 0.31 MB/sec execute 245 sec latency 3384.319 ms 2023-12-13T22:47:00.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1029 0.31 MB/sec execute 246 sec latency 3715.064 ms 2023-12-13T22:47:01.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1032 0.31 MB/sec execute 247 sec latency 3517.258 ms 2023-12-13T22:47:02.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1034 0.31 MB/sec execute 248 sec latency 3282.625 ms 2023-12-13T22:47:03.773 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:47:03.776 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:47:03.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1036 0.31 MB/sec execute 249 sec latency 2836.168 ms 2023-12-13T22:47:04.787 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1040 0.31 MB/sec execute 250 sec latency 3415.213 ms 2023-12-13T22:47:05.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1041 0.31 MB/sec execute 251 sec latency 2796.966 ms 2023-12-13T22:47:06.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1044 0.31 MB/sec execute 252 sec latency 3134.001 ms 2023-12-13T22:47:07.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1045 0.31 MB/sec execute 253 sec latency 3649.404 ms 2023-12-13T22:47:08.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1046 0.31 MB/sec execute 254 sec latency 3469.158 ms 2023-12-13T22:47:09.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1048 0.31 MB/sec execute 255 sec latency 3422.284 ms 2023-12-13T22:47:10.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1050 0.31 MB/sec execute 256 sec latency 3257.104 ms 2023-12-13T22:47:11.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1054 0.31 MB/sec execute 257 sec latency 3475.928 ms 2023-12-13T22:47:12.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1057 0.31 MB/sec execute 258 sec latency 2669.702 ms 2023-12-13T22:47:13.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1058 0.31 MB/sec execute 259 sec latency 2781.426 ms 2023-12-13T22:47:14.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1060 0.31 MB/sec execute 260 sec latency 3736.453 ms 2023-12-13T22:47:15.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1061 0.31 MB/sec execute 261 sec latency 3810.326 ms 2023-12-13T22:47:16.788 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1062 0.30 MB/sec execute 262 sec latency 2553.933 ms 2023-12-13T22:47:17.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1064 0.30 MB/sec execute 263 sec latency 3279.591 ms 2023-12-13T22:47:18.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1066 0.30 MB/sec execute 264 sec latency 3126.519 ms 2023-12-13T22:47:19.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1067 0.30 MB/sec execute 265 sec latency 3472.674 ms 2023-12-13T22:47:20.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1068 0.30 MB/sec execute 266 sec latency 2741.754 ms 2023-12-13T22:47:21.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1071 0.30 MB/sec execute 267 sec latency 3497.593 ms 2023-12-13T22:47:22.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1073 0.30 MB/sec execute 268 sec latency 3218.244 ms 2023-12-13T22:47:23.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1074 0.30 MB/sec execute 269 sec latency 2443.392 ms 2023-12-13T22:47:24.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1077 0.30 MB/sec execute 270 sec latency 3178.072 ms 2023-12-13T22:47:25.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1078 0.30 MB/sec execute 271 sec latency 3202.174 ms 2023-12-13T22:47:26.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1080 0.29 MB/sec execute 272 sec latency 3041.491 ms 2023-12-13T22:47:27.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1081 0.29 MB/sec execute 273 sec latency 2441.118 ms 2023-12-13T22:47:28.789 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1084 0.29 MB/sec execute 274 sec latency 3441.187 ms 2023-12-13T22:47:29.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1086 0.29 MB/sec execute 275 sec latency 3506.286 ms 2023-12-13T22:47:30.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1088 0.29 MB/sec execute 276 sec latency 3310.727 ms 2023-12-13T22:47:31.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1088 0.29 MB/sec execute 277 sec latency 2983.735 ms 2023-12-13T22:47:32.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1090 0.29 MB/sec execute 278 sec latency 3139.897 ms 2023-12-13T22:47:33.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1092 0.29 MB/sec execute 279 sec latency 3201.455 ms 2023-12-13T22:47:33.836 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:47:33.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:47:34.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1094 0.29 MB/sec execute 280 sec latency 2844.106 ms 2023-12-13T22:47:35.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1096 0.29 MB/sec execute 281 sec latency 3084.911 ms 2023-12-13T22:47:36.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1100 0.28 MB/sec execute 282 sec latency 2483.620 ms 2023-12-13T22:47:37.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1101 0.28 MB/sec execute 283 sec latency 3029.539 ms 2023-12-13T22:47:38.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1104 0.28 MB/sec execute 284 sec latency 3354.112 ms 2023-12-13T22:47:39.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1107 0.28 MB/sec execute 285 sec latency 2591.137 ms 2023-12-13T22:47:40.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1109 0.28 MB/sec execute 286 sec latency 2845.445 ms 2023-12-13T22:47:41.790 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1111 0.28 MB/sec execute 287 sec latency 1618.376 ms 2023-12-13T22:47:42.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1114 0.28 MB/sec execute 288 sec latency 2548.232 ms 2023-12-13T22:47:43.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1115 0.28 MB/sec execute 289 sec latency 3459.976 ms 2023-12-13T22:47:44.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1117 0.28 MB/sec execute 290 sec latency 2884.518 ms 2023-12-13T22:47:45.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1119 0.28 MB/sec execute 291 sec latency 3175.382 ms 2023-12-13T22:47:46.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1121 0.28 MB/sec execute 292 sec latency 3092.839 ms 2023-12-13T22:47:47.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1124 0.28 MB/sec execute 293 sec latency 1252.001 ms 2023-12-13T22:47:48.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1126 0.27 MB/sec execute 294 sec latency 1785.460 ms 2023-12-13T22:47:49.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1127 0.27 MB/sec execute 295 sec latency 2785.562 ms 2023-12-13T22:47:50.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1129 0.27 MB/sec execute 296 sec latency 3351.531 ms 2023-12-13T22:47:51.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1130 0.27 MB/sec execute 297 sec latency 2824.825 ms 2023-12-13T22:47:52.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1131 0.27 MB/sec execute 298 sec latency 3417.047 ms 2023-12-13T22:47:53.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1133 0.27 MB/sec execute 299 sec latency 3270.819 ms 2023-12-13T22:47:54.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1136 0.27 MB/sec execute 300 sec latency 3457.630 ms 2023-12-13T22:47:55.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1138 0.27 MB/sec execute 301 sec latency 2187.301 ms 2023-12-13T22:47:56.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1141 0.27 MB/sec execute 302 sec latency 2743.497 ms 2023-12-13T22:47:57.791 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1142 0.27 MB/sec execute 303 sec latency 2760.366 ms 2023-12-13T22:47:58.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1143 0.27 MB/sec execute 304 sec latency 3054.711 ms 2023-12-13T22:47:59.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1144 0.26 MB/sec execute 305 sec latency 3537.000 ms 2023-12-13T22:48:00.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1145 0.26 MB/sec execute 306 sec latency 3246.117 ms 2023-12-13T22:48:01.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1146 0.26 MB/sec execute 307 sec latency 3113.009 ms 2023-12-13T22:48:02.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1148 0.26 MB/sec execute 308 sec latency 3428.397 ms 2023-12-13T22:48:03.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1150 0.26 MB/sec execute 309 sec latency 3463.049 ms 2023-12-13T22:48:03.906 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:48:03.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:48:04.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1152 0.26 MB/sec execute 310 sec latency 2159.162 ms 2023-12-13T22:48:05.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1153 0.26 MB/sec execute 311 sec latency 2764.553 ms 2023-12-13T22:48:06.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1155 0.26 MB/sec execute 312 sec latency 2835.346 ms 2023-12-13T22:48:07.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1157 0.26 MB/sec execute 313 sec latency 1348.290 ms 2023-12-13T22:48:08.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1158 0.26 MB/sec execute 314 sec latency 1969.792 ms 2023-12-13T22:48:09.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1159 0.26 MB/sec execute 315 sec latency 2969.851 ms 2023-12-13T22:48:10.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1161 0.26 MB/sec execute 316 sec latency 3508.417 ms 2023-12-13T22:48:11.792 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1163 0.26 MB/sec execute 317 sec latency 3199.847 ms 2023-12-13T22:48:12.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1166 0.25 MB/sec execute 318 sec latency 3162.725 ms 2023-12-13T22:48:13.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1168 0.25 MB/sec execute 319 sec latency 3323.019 ms 2023-12-13T22:48:14.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1171 0.25 MB/sec execute 320 sec latency 2327.169 ms 2023-12-13T22:48:15.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1172 0.25 MB/sec execute 321 sec latency 2839.947 ms 2023-12-13T22:48:16.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1175 0.25 MB/sec execute 322 sec latency 3192.859 ms 2023-12-13T22:48:17.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1176 0.25 MB/sec execute 323 sec latency 2844.343 ms 2023-12-13T22:48:18.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1178 0.25 MB/sec execute 324 sec latency 2647.335 ms 2023-12-13T22:48:19.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1179 0.25 MB/sec execute 325 sec latency 3544.772 ms 2023-12-13T22:48:20.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1179 0.25 MB/sec execute 326 sec latency 3511.852 ms 2023-12-13T22:48:21.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1180 0.25 MB/sec execute 327 sec latency 3314.469 ms 2023-12-13T22:48:22.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1183 0.25 MB/sec execute 328 sec latency 3745.551 ms 2023-12-13T22:48:23.793 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1185 0.25 MB/sec execute 329 sec latency 2973.106 ms 2023-12-13T22:48:24.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1186 0.25 MB/sec execute 330 sec latency 1369.692 ms 2023-12-13T22:48:25.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1189 0.25 MB/sec execute 331 sec latency 1700.433 ms 2023-12-13T22:48:26.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1191 0.24 MB/sec execute 332 sec latency 2637.741 ms 2023-12-13T22:48:27.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1193 0.24 MB/sec execute 333 sec latency 3216.318 ms 2023-12-13T22:48:28.419 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:23:52.579 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.487 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:23:52.648 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.578 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:23:52.684 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.585 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:23:52.692 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.607 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:23:52.714 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.613 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:23:52.720 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:28.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1196 0.24 MB/sec execute 334 sec latency 3064.908 ms 2023-12-13T22:48:29.174 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:23:53.335 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:29.207 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:23:53.314 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:29.348 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:23:53.455 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:48:29.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1199 0.24 MB/sec execute 335 sec latency 1720.877 ms 2023-12-13T22:48:30.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1202 0.24 MB/sec execute 336 sec latency 2306.876 ms 2023-12-13T22:48:31.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1203 0.24 MB/sec execute 337 sec latency 1760.968 ms 2023-12-13T22:48:32.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1205 0.24 MB/sec execute 338 sec latency 2761.017 ms 2023-12-13T22:48:33.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1207 0.24 MB/sec execute 339 sec latency 3333.497 ms 2023-12-13T22:48:34.056 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:48:34.059 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:48:34.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1209 0.24 MB/sec execute 340 sec latency 2026.569 ms 2023-12-13T22:48:35.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1210 0.24 MB/sec execute 341 sec latency 2655.387 ms 2023-12-13T22:48:36.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1212 0.24 MB/sec execute 342 sec latency 2653.866 ms 2023-12-13T22:48:37.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1213 0.24 MB/sec execute 343 sec latency 2789.322 ms 2023-12-13T22:48:38.794 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1214 0.24 MB/sec execute 344 sec latency 3230.355 ms 2023-12-13T22:48:39.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1216 0.24 MB/sec execute 345 sec latency 3454.939 ms 2023-12-13T22:48:40.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1218 0.24 MB/sec execute 346 sec latency 3520.309 ms 2023-12-13T22:48:41.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1220 0.23 MB/sec execute 347 sec latency 2622.138 ms 2023-12-13T22:48:42.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1224 0.23 MB/sec execute 348 sec latency 2439.945 ms 2023-12-13T22:48:43.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1229 0.23 MB/sec execute 349 sec latency 2716.913 ms 2023-12-13T22:48:44.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1232 0.23 MB/sec execute 350 sec latency 1189.780 ms 2023-12-13T22:48:45.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1234 0.23 MB/sec execute 351 sec latency 1646.898 ms 2023-12-13T22:48:46.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1237 0.23 MB/sec execute 352 sec latency 2271.269 ms 2023-12-13T22:48:47.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1240 0.23 MB/sec execute 353 sec latency 2370.942 ms 2023-12-13T22:48:48.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1241 0.23 MB/sec execute 354 sec latency 1823.509 ms 2023-12-13T22:48:49.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1243 0.23 MB/sec execute 355 sec latency 2609.753 ms 2023-12-13T22:48:50.795 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1244 0.23 MB/sec execute 356 sec latency 3495.522 ms 2023-12-13T22:48:51.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1246 0.23 MB/sec execute 357 sec latency 3793.616 ms 2023-12-13T22:48:52.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1248 0.23 MB/sec execute 358 sec latency 3207.989 ms 2023-12-13T22:48:53.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1248 0.23 MB/sec execute 359 sec latency 3496.529 ms 2023-12-13T22:48:54.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1249 0.23 MB/sec execute 360 sec latency 3964.868 ms 2023-12-13T22:48:55.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1250 0.23 MB/sec execute 361 sec latency 4269.347 ms 2023-12-13T22:48:56.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1252 0.23 MB/sec execute 362 sec latency 3156.211 ms 2023-12-13T22:48:57.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1256 0.23 MB/sec execute 363 sec latency 3241.597 ms 2023-12-13T22:48:58.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1263 0.23 MB/sec execute 364 sec latency 3079.815 ms 2023-12-13T22:48:59.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1266 0.23 MB/sec execute 365 sec latency 3127.473 ms 2023-12-13T22:49:00.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1269 0.23 MB/sec execute 366 sec latency 2709.145 ms 2023-12-13T22:49:01.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1273 0.23 MB/sec execute 367 sec latency 2867.138 ms 2023-12-13T22:49:02.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1292 0.25 MB/sec execute 368 sec latency 2100.500 ms 2023-12-13T22:49:03.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1293 0.25 MB/sec execute 369 sec latency 2529.378 ms 2023-12-13T22:49:04.270 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:49:04.273 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:49:04.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1294 0.24 MB/sec execute 370 sec latency 2717.991 ms 2023-12-13T22:49:05.796 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1295 0.24 MB/sec execute 371 sec latency 3259.146 ms 2023-12-13T22:49:06.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1297 0.24 MB/sec execute 372 sec latency 3637.331 ms 2023-12-13T22:49:07.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1300 0.25 MB/sec execute 373 sec latency 3954.097 ms 2023-12-13T22:49:08.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1307 0.25 MB/sec execute 374 sec latency 4325.517 ms 2023-12-13T22:49:09.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1308 0.25 MB/sec execute 375 sec latency 4011.473 ms 2023-12-13T22:49:10.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1309 0.25 MB/sec execute 376 sec latency 3733.761 ms 2023-12-13T22:49:11.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1310 0.25 MB/sec execute 377 sec latency 3286.310 ms 2023-12-13T22:49:12.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1310 0.25 MB/sec execute 378 sec latency 3307.773 ms 2023-12-13T22:49:13.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1311 0.25 MB/sec execute 379 sec latency 3527.711 ms 2023-12-13T22:49:14.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1312 0.25 MB/sec execute 380 sec latency 3604.952 ms 2023-12-13T22:49:15.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1314 0.25 MB/sec execute 381 sec latency 3644.761 ms 2023-12-13T22:49:16.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1315 0.24 MB/sec execute 382 sec latency 3616.880 ms 2023-12-13T22:49:17.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1317 0.25 MB/sec execute 383 sec latency 3796.817 ms 2023-12-13T22:49:18.797 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1321 0.25 MB/sec execute 384 sec latency 3501.815 ms 2023-12-13T22:49:19.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1331 0.25 MB/sec execute 385 sec latency 3134.186 ms 2023-12-13T22:49:20.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1340 0.26 MB/sec execute 386 sec latency 3134.319 ms 2023-12-13T22:49:21.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1347 0.26 MB/sec execute 387 sec latency 3310.252 ms 2023-12-13T22:49:22.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1348 0.26 MB/sec execute 388 sec latency 2919.640 ms 2023-12-13T22:49:22.969 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:47.130 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.005 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:47.166 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.148 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:24:47.256 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.159 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:24:47.320 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.160 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:24:47.267 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.165 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:24:47.272 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.169 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:24:47.276 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.335 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:24:47.442 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.349 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:24:47.456 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:49:23.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1350 0.26 MB/sec execute 389 sec latency 3283.094 ms 2023-12-13T22:49:24.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1351 0.26 MB/sec execute 390 sec latency 3393.669 ms 2023-12-13T22:49:25.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1352 0.26 MB/sec execute 391 sec latency 3092.848 ms 2023-12-13T22:49:26.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1354 0.26 MB/sec execute 392 sec latency 3211.548 ms 2023-12-13T22:49:27.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1356 0.26 MB/sec execute 393 sec latency 3095.297 ms 2023-12-13T22:49:28.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1357 0.26 MB/sec execute 394 sec latency 3028.823 ms 2023-12-13T22:49:29.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1358 0.26 MB/sec execute 395 sec latency 3218.767 ms 2023-12-13T22:49:30.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1360 0.26 MB/sec execute 396 sec latency 2958.015 ms 2023-12-13T22:49:31.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1361 0.26 MB/sec execute 397 sec latency 3334.159 ms 2023-12-13T22:49:32.798 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1363 0.26 MB/sec execute 398 sec latency 3119.364 ms 2023-12-13T22:49:33.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1363 0.26 MB/sec execute 399 sec latency 3164.840 ms 2023-12-13T22:49:34.383 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:49:34.385 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:49:34.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1364 0.26 MB/sec execute 400 sec latency 3234.668 ms 2023-12-13T22:49:35.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1365 0.26 MB/sec execute 401 sec latency 3881.626 ms 2023-12-13T22:49:36.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1367 0.26 MB/sec execute 402 sec latency 3508.861 ms 2023-12-13T22:49:37.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1370 0.26 MB/sec execute 403 sec latency 3969.615 ms 2023-12-13T22:49:38.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1377 0.26 MB/sec execute 404 sec latency 4394.790 ms 2023-12-13T22:49:39.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1378 0.26 MB/sec execute 405 sec latency 4062.354 ms 2023-12-13T22:49:40.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1381 0.26 MB/sec execute 406 sec latency 4346.225 ms 2023-12-13T22:49:41.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1383 0.26 MB/sec execute 407 sec latency 3419.634 ms 2023-12-13T22:49:42.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1385 0.26 MB/sec execute 408 sec latency 2716.396 ms 2023-12-13T22:49:43.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1388 0.26 MB/sec execute 409 sec latency 3465.353 ms 2023-12-13T22:49:44.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1396 0.26 MB/sec execute 410 sec latency 3443.011 ms 2023-12-13T22:49:45.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1397 0.26 MB/sec execute 411 sec latency 3761.423 ms 2023-12-13T22:49:46.799 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1399 0.26 MB/sec execute 412 sec latency 3111.678 ms 2023-12-13T22:49:47.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1399 0.26 MB/sec execute 413 sec latency 3961.133 ms 2023-12-13T22:49:48.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1400 0.26 MB/sec execute 414 sec latency 4166.329 ms 2023-12-13T22:49:49.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1403 0.26 MB/sec execute 415 sec latency 3934.208 ms 2023-12-13T22:49:50.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1406 0.26 MB/sec execute 416 sec latency 3225.162 ms 2023-12-13T22:49:51.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1413 0.27 MB/sec execute 417 sec latency 3709.355 ms 2023-12-13T22:49:52.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1416 0.27 MB/sec execute 418 sec latency 3869.778 ms 2023-12-13T22:49:53.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1417 0.26 MB/sec execute 419 sec latency 3873.811 ms 2023-12-13T22:49:54.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1420 0.26 MB/sec execute 420 sec latency 3505.691 ms 2023-12-13T22:49:55.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1421 0.26 MB/sec execute 421 sec latency 3298.152 ms 2023-12-13T22:49:56.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1422 0.26 MB/sec execute 422 sec latency 3682.103 ms 2023-12-13T22:49:57.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1423 0.26 MB/sec execute 423 sec latency 3390.463 ms 2023-12-13T22:49:58.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1424 0.26 MB/sec execute 424 sec latency 3463.200 ms 2023-12-13T22:49:59.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1426 0.26 MB/sec execute 425 sec latency 3469.050 ms 2023-12-13T22:50:00.800 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1427 0.26 MB/sec execute 426 sec latency 3608.531 ms 2023-12-13T22:50:01.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1428 0.26 MB/sec execute 427 sec latency 3032.200 ms 2023-12-13T22:50:02.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1429 0.26 MB/sec execute 428 sec latency 3369.835 ms 2023-12-13T22:50:03.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1432 0.26 MB/sec execute 429 sec latency 3581.599 ms 2023-12-13T22:50:04.501 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:50:04.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:50:04.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1434 0.26 MB/sec execute 430 sec latency 3682.022 ms 2023-12-13T22:50:05.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1436 0.26 MB/sec execute 431 sec latency 2691.310 ms 2023-12-13T22:50:06.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1437 0.26 MB/sec execute 432 sec latency 3366.410 ms 2023-12-13T22:50:07.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1438 0.26 MB/sec execute 433 sec latency 3897.207 ms 2023-12-13T22:50:08.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1440 0.26 MB/sec execute 434 sec latency 3170.093 ms 2023-12-13T22:50:09.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1441 0.26 MB/sec execute 435 sec latency 3512.926 ms 2023-12-13T22:50:10.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1444 0.25 MB/sec execute 436 sec latency 3554.644 ms 2023-12-13T22:50:11.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1445 0.25 MB/sec execute 437 sec latency 3829.145 ms 2023-12-13T22:50:12.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1447 0.25 MB/sec execute 438 sec latency 3699.225 ms 2023-12-13T22:50:13.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1448 0.25 MB/sec execute 439 sec latency 3815.888 ms 2023-12-13T22:50:14.801 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1449 0.25 MB/sec execute 440 sec latency 3322.782 ms 2023-12-13T22:50:15.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1451 0.25 MB/sec execute 441 sec latency 2130.237 ms 2023-12-13T22:50:16.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1452 0.25 MB/sec execute 442 sec latency 3130.302 ms 2023-12-13T22:50:17.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1453 0.25 MB/sec execute 443 sec latency 3157.865 ms 2023-12-13T22:50:18.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1454 0.25 MB/sec execute 444 sec latency 3414.178 ms 2023-12-13T22:50:19.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1456 0.25 MB/sec execute 445 sec latency 3026.932 ms 2023-12-13T22:50:20.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1458 0.25 MB/sec execute 446 sec latency 3358.065 ms 2023-12-13T22:50:21.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1459 0.25 MB/sec execute 447 sec latency 3011.035 ms 2023-12-13T22:50:22.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1460 0.25 MB/sec execute 448 sec latency 3283.503 ms 2023-12-13T22:50:23.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1462 0.25 MB/sec execute 449 sec latency 3554.034 ms 2023-12-13T22:50:24.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1464 0.25 MB/sec execute 450 sec latency 3252.522 ms 2023-12-13T22:50:25.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1466 0.25 MB/sec execute 451 sec latency 3293.023 ms 2023-12-13T22:50:26.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1468 0.25 MB/sec execute 452 sec latency 2723.600 ms 2023-12-13T22:50:27.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1469 0.25 MB/sec execute 453 sec latency 2928.079 ms 2023-12-13T22:50:28.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1472 0.24 MB/sec execute 454 sec latency 3091.285 ms 2023-12-13T22:50:29.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1473 0.24 MB/sec execute 455 sec latency 2276.185 ms 2023-12-13T22:50:30.802 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1475 0.24 MB/sec execute 456 sec latency 3276.245 ms 2023-12-13T22:50:31.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1477 0.24 MB/sec execute 457 sec latency 3384.264 ms 2023-12-13T22:50:32.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1479 0.24 MB/sec execute 458 sec latency 3123.671 ms 2023-12-13T22:50:33.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1480 0.24 MB/sec execute 459 sec latency 3633.186 ms 2023-12-13T22:50:34.624 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:50:34.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:50:34.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1482 0.24 MB/sec execute 460 sec latency 3822.853 ms 2023-12-13T22:50:35.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1483 0.24 MB/sec execute 461 sec latency 3748.646 ms 2023-12-13T22:50:36.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1485 0.24 MB/sec execute 462 sec latency 3314.663 ms 2023-12-13T22:50:37.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1487 0.24 MB/sec execute 463 sec latency 3657.243 ms 2023-12-13T22:50:38.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1490 0.24 MB/sec execute 464 sec latency 1925.427 ms 2023-12-13T22:50:39.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1491 0.24 MB/sec execute 465 sec latency 1904.242 ms 2023-12-13T22:50:40.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1491 0.24 MB/sec execute 466 sec latency 2904.312 ms 2023-12-13T22:50:41.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1492 0.24 MB/sec execute 467 sec latency 3486.846 ms 2023-12-13T22:50:42.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1494 0.24 MB/sec execute 468 sec latency 3403.707 ms 2023-12-13T22:50:43.803 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1495 0.24 MB/sec execute 469 sec latency 3368.263 ms 2023-12-13T22:50:44.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1496 0.24 MB/sec execute 470 sec latency 3560.873 ms 2023-12-13T22:50:45.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1498 0.24 MB/sec execute 471 sec latency 4024.864 ms 2023-12-13T22:50:46.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1499 0.24 MB/sec execute 472 sec latency 4217.304 ms 2023-12-13T22:50:47.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1501 0.24 MB/sec execute 473 sec latency 3003.779 ms 2023-12-13T22:50:48.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1503 0.24 MB/sec execute 474 sec latency 3751.992 ms 2023-12-13T22:50:49.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1505 0.23 MB/sec execute 475 sec latency 2933.271 ms 2023-12-13T22:50:50.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1509 0.23 MB/sec execute 476 sec latency 2816.595 ms 2023-12-13T22:50:51.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1512 0.23 MB/sec execute 477 sec latency 2880.303 ms 2023-12-13T22:50:52.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1513 0.23 MB/sec execute 478 sec latency 2500.580 ms 2023-12-13T22:50:53.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1514 0.23 MB/sec execute 479 sec latency 3500.654 ms 2023-12-13T22:50:54.042 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:18.203 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.091 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:18.253 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.257 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:26:18.364 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.263 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:26:18.371 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.272 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:26:18.434 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.276 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:26:18.384 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.285 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:26:18.393 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.478 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:26:18.585 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.501 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:26:18.609 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:50:54.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1517 0.23 MB/sec execute 480 sec latency 3592.202 ms 2023-12-13T22:50:55.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1519 0.23 MB/sec execute 481 sec latency 2415.007 ms 2023-12-13T22:50:56.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1521 0.23 MB/sec execute 482 sec latency 1563.819 ms 2023-12-13T22:50:57.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1523 0.23 MB/sec execute 483 sec latency 2563.911 ms 2023-12-13T22:50:58.804 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1524 0.23 MB/sec execute 484 sec latency 3313.194 ms 2023-12-13T22:50:59.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1527 0.23 MB/sec execute 485 sec latency 3450.124 ms 2023-12-13T22:51:00.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1529 0.23 MB/sec execute 486 sec latency 3725.273 ms 2023-12-13T22:51:01.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1531 0.23 MB/sec execute 487 sec latency 3792.365 ms 2023-12-13T22:51:02.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1534 0.23 MB/sec execute 488 sec latency 3153.994 ms 2023-12-13T22:51:03.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1536 0.23 MB/sec execute 489 sec latency 3233.883 ms 2023-12-13T22:51:04.688 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:51:04.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:51:04.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1537 0.23 MB/sec execute 490 sec latency 2372.194 ms 2023-12-13T22:51:05.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1539 0.23 MB/sec execute 491 sec latency 2883.442 ms 2023-12-13T22:51:06.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1540 0.23 MB/sec execute 492 sec latency 3295.112 ms 2023-12-13T22:51:07.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1542 0.23 MB/sec execute 493 sec latency 3433.609 ms 2023-12-13T22:51:08.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1543 0.23 MB/sec execute 494 sec latency 3346.154 ms 2023-12-13T22:51:09.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1546 0.23 MB/sec execute 495 sec latency 3573.821 ms 2023-12-13T22:51:10.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1548 0.23 MB/sec execute 496 sec latency 1567.919 ms 2023-12-13T22:51:11.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1549 0.23 MB/sec execute 497 sec latency 1279.774 ms 2023-12-13T22:51:12.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1549 0.22 MB/sec execute 498 sec latency 2279.830 ms 2023-12-13T22:51:13.805 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1550 0.22 MB/sec execute 499 sec latency 3279.888 ms 2023-12-13T22:51:14.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1551 0.22 MB/sec execute 500 sec latency 4084.701 ms 2023-12-13T22:51:15.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1554 0.22 MB/sec execute 501 sec latency 3658.610 ms 2023-12-13T22:51:16.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1556 0.22 MB/sec execute 502 sec latency 3663.163 ms 2023-12-13T22:51:17.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1558 0.22 MB/sec execute 503 sec latency 1694.692 ms 2023-12-13T22:51:18.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1560 0.22 MB/sec execute 504 sec latency 1250.467 ms 2023-12-13T22:51:19.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1561 0.22 MB/sec execute 505 sec latency 2199.938 ms 2023-12-13T22:51:20.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1562 0.22 MB/sec execute 506 sec latency 2978.886 ms 2023-12-13T22:51:21.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1563 0.22 MB/sec execute 507 sec latency 3665.962 ms 2023-12-13T22:51:22.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1565 0.22 MB/sec execute 508 sec latency 3398.773 ms 2023-12-13T22:51:23.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1567 0.22 MB/sec execute 509 sec latency 3327.428 ms 2023-12-13T22:51:24.806 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1569 0.22 MB/sec execute 510 sec latency 2320.660 ms 2023-12-13T22:51:25.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1570 0.22 MB/sec execute 511 sec latency 3320.745 ms 2023-12-13T22:51:26.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1572 0.22 MB/sec execute 512 sec latency 3695.199 ms 2023-12-13T22:51:27.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1574 0.22 MB/sec execute 513 sec latency 3029.787 ms 2023-12-13T22:51:28.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1575 0.22 MB/sec execute 514 sec latency 2549.758 ms 2023-12-13T22:51:29.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1577 0.22 MB/sec execute 515 sec latency 2993.799 ms 2023-12-13T22:51:30.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1580 0.22 MB/sec execute 516 sec latency 2951.778 ms 2023-12-13T22:51:31.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1581 0.22 MB/sec execute 517 sec latency 2368.596 ms 2023-12-13T22:51:32.807 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1582 0.22 MB/sec execute 518 sec latency 3077.375 ms 2023-12-13T22:51:33.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1583 0.22 MB/sec execute 519 sec latency 1570.083 ms 2023-12-13T22:51:34.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1584 0.22 MB/sec execute 520 sec latency 2570.165 ms 2023-12-13T22:51:34.827 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:51:34.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:51:35.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1585 0.22 MB/sec execute 521 sec latency 3072.768 ms 2023-12-13T22:51:36.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1587 0.22 MB/sec execute 522 sec latency 3527.272 ms 2023-12-13T22:51:37.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1589 0.21 MB/sec execute 523 sec latency 3795.208 ms 2023-12-13T22:51:38.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1592 0.21 MB/sec execute 524 sec latency 3215.987 ms 2023-12-13T22:51:39.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1594 0.21 MB/sec execute 525 sec latency 1394.978 ms 2023-12-13T22:51:40.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1596 0.21 MB/sec execute 526 sec latency 2068.811 ms 2023-12-13T22:51:41.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1598 0.21 MB/sec execute 527 sec latency 2786.567 ms 2023-12-13T22:51:42.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1600 0.21 MB/sec execute 528 sec latency 2360.241 ms 2023-12-13T22:51:43.808 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1601 0.21 MB/sec execute 529 sec latency 3251.834 ms 2023-12-13T22:51:44.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1602 0.21 MB/sec execute 530 sec latency 3452.841 ms 2023-12-13T22:51:45.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1605 0.21 MB/sec execute 531 sec latency 3397.165 ms 2023-12-13T22:51:46.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1606 0.21 MB/sec execute 532 sec latency 3550.763 ms 2023-12-13T22:51:47.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1608 0.21 MB/sec execute 533 sec latency 3215.585 ms 2023-12-13T22:51:48.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1610 0.21 MB/sec execute 534 sec latency 3380.400 ms 2023-12-13T22:51:49.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1613 0.21 MB/sec execute 535 sec latency 3507.381 ms 2023-12-13T22:51:50.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1615 0.21 MB/sec execute 536 sec latency 3496.237 ms 2023-12-13T22:51:51.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1616 0.21 MB/sec execute 537 sec latency 3556.281 ms 2023-12-13T22:51:52.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1617 0.21 MB/sec execute 538 sec latency 3027.781 ms 2023-12-13T22:51:53.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1619 0.21 MB/sec execute 539 sec latency 2145.467 ms 2023-12-13T22:51:53.968 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:18.129 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:53.997 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:18.158 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.105 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:27:18.213 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.118 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:27:18.226 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.124 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:27:18.232 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.155 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:27:18.263 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.210 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:27:18.371 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.545 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:27:18.653 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.574 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:27:18.682 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:51:54.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1621 0.21 MB/sec execute 540 sec latency 2792.913 ms 2023-12-13T22:51:55.809 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1625 0.21 MB/sec execute 541 sec latency 1620.629 ms 2023-12-13T22:51:56.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1627 0.21 MB/sec execute 542 sec latency 2620.667 ms 2023-12-13T22:51:57.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1629 0.21 MB/sec execute 543 sec latency 2934.702 ms 2023-12-13T22:51:58.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1632 0.21 MB/sec execute 544 sec latency 3155.678 ms 2023-12-13T22:51:59.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1633 0.21 MB/sec execute 545 sec latency 3460.799 ms 2023-12-13T22:52:00.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1638 0.21 MB/sec execute 546 sec latency 2543.332 ms 2023-12-13T22:52:01.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1640 0.21 MB/sec execute 547 sec latency 1530.178 ms 2023-12-13T22:52:02.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1642 0.21 MB/sec execute 548 sec latency 2530.224 ms 2023-12-13T22:52:03.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1645 0.21 MB/sec execute 549 sec latency 3530.281 ms 2023-12-13T22:52:04.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1646 0.20 MB/sec execute 550 sec latency 3751.039 ms 2023-12-13T22:52:04.958 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:52:04.961 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:52:05.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1647 0.20 MB/sec execute 551 sec latency 3110.759 ms 2023-12-13T22:52:06.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1648 0.20 MB/sec execute 552 sec latency 3405.273 ms 2023-12-13T22:52:07.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1648 0.20 MB/sec execute 553 sec latency 3468.833 ms 2023-12-13T22:52:08.810 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1649 0.20 MB/sec execute 554 sec latency 3832.477 ms 2023-12-13T22:52:09.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1651 0.20 MB/sec execute 555 sec latency 3303.529 ms 2023-12-13T22:52:10.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1653 0.20 MB/sec execute 556 sec latency 3777.197 ms 2023-12-13T22:52:11.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1655 0.20 MB/sec execute 557 sec latency 4128.176 ms 2023-12-13T22:52:12.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1658 0.20 MB/sec execute 558 sec latency 3619.179 ms 2023-12-13T22:52:13.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1659 0.20 MB/sec execute 559 sec latency 1818.404 ms 2023-12-13T22:52:14.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1660 0.20 MB/sec execute 560 sec latency 2818.501 ms 2023-12-13T22:52:15.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1662 0.20 MB/sec execute 561 sec latency 3699.152 ms 2023-12-13T22:52:16.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1664 0.20 MB/sec execute 562 sec latency 3190.493 ms 2023-12-13T22:52:17.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1665 0.20 MB/sec execute 563 sec latency 2254.907 ms 2023-12-13T22:52:18.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1668 0.20 MB/sec execute 564 sec latency 2576.219 ms 2023-12-13T22:52:19.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1671 0.20 MB/sec execute 565 sec latency 2331.918 ms 2023-12-13T22:52:20.811 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1673 0.20 MB/sec execute 566 sec latency 3203.106 ms 2023-12-13T22:52:21.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1676 0.20 MB/sec execute 567 sec latency 3295.601 ms 2023-12-13T22:52:22.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1677 0.20 MB/sec execute 568 sec latency 2280.648 ms 2023-12-13T22:52:23.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1680 0.20 MB/sec execute 569 sec latency 3059.753 ms 2023-12-13T22:52:24.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1682 0.20 MB/sec execute 570 sec latency 2527.052 ms 2023-12-13T22:52:25.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1685 0.20 MB/sec execute 571 sec latency 3257.351 ms 2023-12-13T22:52:26.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1687 0.20 MB/sec execute 572 sec latency 1967.968 ms 2023-12-13T22:52:27.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1690 0.20 MB/sec execute 573 sec latency 2396.304 ms 2023-12-13T22:52:28.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1693 0.20 MB/sec execute 574 sec latency 2705.660 ms 2023-12-13T22:52:29.812 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1696 0.20 MB/sec execute 575 sec latency 3073.928 ms 2023-12-13T22:52:30.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1698 0.20 MB/sec execute 576 sec latency 3198.520 ms 2023-12-13T22:52:31.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1700 0.20 MB/sec execute 577 sec latency 2534.739 ms 2023-12-13T22:52:32.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1702 0.20 MB/sec execute 578 sec latency 2634.069 ms 2023-12-13T22:52:33.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1703 0.20 MB/sec execute 579 sec latency 3129.228 ms 2023-12-13T22:52:34.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1705 0.20 MB/sec execute 580 sec latency 3293.401 ms 2023-12-13T22:52:35.031 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:52:35.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:52:35.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1709 0.19 MB/sec execute 581 sec latency 3664.862 ms 2023-12-13T22:52:36.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1711 0.19 MB/sec execute 582 sec latency 4235.228 ms 2023-12-13T22:52:37.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1712 0.19 MB/sec execute 583 sec latency 2723.198 ms 2023-12-13T22:52:38.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1715 0.19 MB/sec execute 584 sec latency 3247.774 ms 2023-12-13T22:52:39.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1717 0.19 MB/sec execute 585 sec latency 1615.435 ms 2023-12-13T22:52:40.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1719 0.19 MB/sec execute 586 sec latency 2038.376 ms 2023-12-13T22:52:41.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1722 0.19 MB/sec execute 587 sec latency 2998.638 ms 2023-12-13T22:52:42.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1723 0.19 MB/sec execute 588 sec latency 2658.818 ms 2023-12-13T22:52:43.813 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1725 0.19 MB/sec execute 589 sec latency 3589.212 ms 2023-12-13T22:52:44.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1727 0.19 MB/sec execute 590 sec latency 3356.833 ms 2023-12-13T22:52:45.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1729 0.19 MB/sec execute 591 sec latency 3019.596 ms 2023-12-13T22:52:46.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1730 0.19 MB/sec execute 592 sec latency 3754.831 ms 2023-12-13T22:52:47.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1731 0.19 MB/sec execute 593 sec latency 2807.022 ms 2023-12-13T22:52:48.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1733 0.19 MB/sec execute 594 sec latency 2222.619 ms 2023-12-13T22:52:49.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1735 0.19 MB/sec execute 595 sec latency 2483.613 ms 2023-12-13T22:52:50.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1737 0.19 MB/sec execute 596 sec latency 3125.784 ms 2023-12-13T22:52:51.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1742 0.19 MB/sec execute 597 sec latency 3150.857 ms 2023-12-13T22:52:52.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1743 0.19 MB/sec execute 598 sec latency 1122.542 ms 2023-12-13T22:52:53.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 1745 0.19 MB/sec execute 599 sec latency 1559.002 ms 2023-12-13T22:52:54.814 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 600 sec 2023-12-13T22:52:55.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 601 sec 2023-12-13T22:52:56.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 602 sec 2023-12-13T22:52:57.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 603 sec 2023-12-13T22:52:58.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 604 sec 2023-12-13T22:52:59.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 605 sec 2023-12-13T22:53:00.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 606 sec 2023-12-13T22:53:01.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 607 sec 2023-12-13T22:53:02.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 608 sec 2023-12-13T22:53:03.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 609 sec 2023-12-13T22:53:04.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 610 sec 2023-12-13T22:53:05.292 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:53:05.294 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:53:05.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 611 sec 2023-12-13T22:53:06.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 612 sec 2023-12-13T22:53:07.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 613 sec 2023-12-13T22:53:08.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 614 sec 2023-12-13T22:53:09.815 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 615 sec 2023-12-13T22:53:10.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 616 sec 2023-12-13T22:53:11.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 617 sec 2023-12-13T22:53:12.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 618 sec 2023-12-13T22:53:13.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 619 sec 2023-12-13T22:53:14.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 620 sec 2023-12-13T22:53:15.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 621 sec 2023-12-13T22:53:16.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 622 sec 2023-12-13T22:53:17.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 623 sec 2023-12-13T22:53:18.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 624 sec 2023-12-13T22:53:19.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 625 sec 2023-12-13T22:53:20.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 626 sec 2023-12-13T22:53:21.816 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 627 sec 2023-12-13T22:53:22.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 628 sec 2023-12-13T22:53:23.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 629 sec 2023-12-13T22:53:24.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 630 sec 2023-12-13T22:53:25.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 631 sec 2023-12-13T22:53:26.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 632 sec 2023-12-13T22:53:27.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 633 sec 2023-12-13T22:53:28.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 634 sec 2023-12-13T22:53:29.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 635 sec 2023-12-13T22:53:30.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 636 sec 2023-12-13T22:53:31.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 637 sec 2023-12-13T22:53:32.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 638 sec 2023-12-13T22:53:33.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 639 sec 2023-12-13T22:53:34.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 640 sec 2023-12-13T22:53:35.350 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:53:35.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:53:35.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 641 sec 2023-12-13T22:53:36.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 642 sec 2023-12-13T22:53:37.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 643 sec 2023-12-13T22:53:38.817 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 644 sec 2023-12-13T22:53:39.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 645 sec 2023-12-13T22:53:40.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 646 sec 2023-12-13T22:53:41.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 647 sec 2023-12-13T22:53:42.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 648 sec 2023-12-13T22:53:43.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 649 sec 2023-12-13T22:53:44.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 650 sec 2023-12-13T22:53:45.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 651 sec 2023-12-13T22:53:46.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 652 sec 2023-12-13T22:53:47.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 653 sec 2023-12-13T22:53:48.818 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 654 sec 2023-12-13T22:53:49.819 INFO:tasks.workunit.client.0.smithi091.stdout: 10 cleanup 655 sec 2023-12-13T22:53:50.819 INFO:tasks.workunit.client.0.smithi091.stdout: 9 cleanup 656 sec 2023-12-13T22:53:51.819 INFO:tasks.workunit.client.0.smithi091.stdout: 9 cleanup 657 sec 2023-12-13T22:53:52.819 INFO:tasks.workunit.client.0.smithi091.stdout: 9 cleanup 658 sec 2023-12-13T22:53:53.819 INFO:tasks.workunit.client.0.smithi091.stdout: 6 cleanup 659 sec 2023-12-13T22:53:54.819 INFO:tasks.workunit.client.0.smithi091.stdout: 6 cleanup 660 sec 2023-12-13T22:53:55.819 INFO:tasks.workunit.client.0.smithi091.stdout: 6 cleanup 661 sec 2023-12-13T22:53:56.819 INFO:tasks.workunit.client.0.smithi091.stdout: 6 cleanup 662 sec 2023-12-13T22:53:57.819 INFO:tasks.workunit.client.0.smithi091.stdout: 5 cleanup 663 sec 2023-12-13T22:53:58.819 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 664 sec 2023-12-13T22:53:59.820 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 665 sec 2023-12-13T22:54:00.819 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 666 sec 2023-12-13T22:54:01.819 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 667 sec 2023-12-13T22:54:02.820 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 668 sec 2023-12-13T22:54:03.820 INFO:tasks.workunit.client.0.smithi091.stdout: 4 cleanup 669 sec 2023-12-13T22:54:04.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 670 sec 2023-12-13T22:54:05.464 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:54:05.467 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:54:05.821 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 671 sec 2023-12-13T22:54:06.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 672 sec 2023-12-13T22:54:07.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 673 sec 2023-12-13T22:54:08.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 674 sec 2023-12-13T22:54:09.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 675 sec 2023-12-13T22:54:10.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 676 sec 2023-12-13T22:54:11.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 677 sec 2023-12-13T22:54:12.820 INFO:tasks.workunit.client.0.smithi091.stdout: 3 cleanup 678 sec 2023-12-13T22:54:13.820 INFO:tasks.workunit.client.0.smithi091.stdout: 2 cleanup 679 sec 2023-12-13T22:54:14.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 680 sec 2023-12-13T22:54:15.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 681 sec 2023-12-13T22:54:16.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 682 sec 2023-12-13T22:54:17.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 683 sec 2023-12-13T22:54:18.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 684 sec 2023-12-13T22:54:19.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 685 sec 2023-12-13T22:54:20.821 INFO:tasks.workunit.client.0.smithi091.stdout: 1 cleanup 686 sec 2023-12-13T22:54:21.780 INFO:tasks.workunit.client.0.smithi091.stdout: 0 cleanup 687 sec 2023-12-13T22:54:21.780 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Operation Count AvgLat MaxLat 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: ---------------------------------------- 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: NTCreateX 2217 1004.357 3518.205 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Close 1873 14.392 169.995 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Rename 109 2060.994 3616.858 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Unlink 229 852.235 2702.949 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Qpathinfo 1644 552.021 2604.462 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Qfileinfo 597 51.281 216.504 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Qfsinfo 330 152.873 824.965 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Sfileinfo 340 325.098 754.102 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Find 631 3192.682 4394.779 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: WriteX 2334 75.258 341.497 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: ReadX 2707 0.573 48.656 2023-12-13T22:54:21.781 INFO:tasks.workunit.client.0.smithi091.stdout: Flush 270 212.781 519.222 2023-12-13T22:54:21.782 INFO:tasks.workunit.client.0.smithi091.stdout: 2023-12-13T22:54:21.782 INFO:tasks.workunit.client.0.smithi091.stdout:Throughput 0.189648 MB/sec 10 clients 10 procs max_latency=4394.790 ms 2023-12-13T22:54:21.783 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-13T22:54:21.783 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-13T22:54:35.553 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:54:35.556 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:55:05.651 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:55:05.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:55:12.627 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:30:36.786 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:12.641 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:30:36.800 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:12.785 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:30:36.894 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:12.792 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:30:36.901 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:12.835 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:30:36.944 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:12.936 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:30:37.045 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:13.019 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:30:37.177 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:13.301 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:30:37.409 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:13.417 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:30:37.526 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:55:24.268 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-13T22:55:24.269 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-13T22:55:24.574 DEBUG:teuthology.parallel:result is None 2023-12-13T22:55:24.574 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-13T22:55:25.391 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-13T22:55:25.391 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-13T22:55:25.401 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-13T22:55:25.401 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:55:25.401 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T22:55:25.407 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:55:25.407 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T22:55:25.457 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:55:25.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.624+0000 7fdf27a44640 1 Processor -- start 2023-12-13T22:55:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.624+0000 7fdf27a44640 1 -- start start 2023-12-13T22:55:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.624+0000 7fdf27a44640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdf2014f850 0x7fdf200c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.624+0000 7fdf27a44640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf200c1ed0 0x7fdf2006e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.624+0000 7fdf27a44640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200c3b10 con 0x7fdf20070ab0 2023-12-13T22:55:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.628+0000 7fdf27a44640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2014fc30 con 0x7fdf2014f850 2023-12-13T22:55:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.628+0000 7fdf27a44640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200c11e0 con 0x7fdf200c1ed0 2023-12-13T22:55:25.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.628+0000 7fdf257e0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdf2014f850 0x7fdf200c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.628+0000 7fdf257e0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdf2014f850 0x7fdf200c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59930/0 (socket says 172.21.15.91:59930) 2023-12-13T22:55:25.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.628+0000 7fdf257e0640 1 -- 172.21.15.91:0/3342875948 learned_addr learned my addr 172.21.15.91:0/3342875948 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.632+0000 7fdf257e0640 1 -- 172.21.15.91:0/3342875948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf200c1ed0 msgr2=0x7fdf2006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:25.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.632+0000 7fdf257e0640 1 --2- 172.21.15.91:0/3342875948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf200c1ed0 0x7fdf2006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.632+0000 7fdf257e0640 1 -- 172.21.15.91:0/3342875948 >> v1:172.21.15.91:6789/0 conn(0x7fdf20070ab0 legacy=0x7fdf20158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:25.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.632+0000 7fdf257e0640 1 -- 172.21.15.91:0/3342875948 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200c2410 con 0x7fdf2014f850 2023-12-13T22:55:25.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.636+0000 7fdf257e0640 1 --2- 172.21.15.91:0/3342875948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf2014f850 0x7fdf200c3fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00aa10 tx=0x7fdf1c01d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd4021d7c6118a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:25.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf17fff640 1 -- 172.21.15.91:0/3342875948 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0a68d0 con 0x7fdf2014f850 2023-12-13T22:55:25.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf17fff640 1 -- 172.21.15.91:0/3342875948 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0a6a30 con 0x7fdf2014f850 2023-12-13T22:55:25.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf17fff640 1 -- 172.21.15.91:0/3342875948 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0a6dc0 con 0x7fdf2014f850 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- 172.21.15.91:0/3342875948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf2014f850 msgr2=0x7fdf200c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3342875948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf2014f850 0x7fdf200c3fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00aa10 tx=0x7fdf1c01d8e0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- 172.21.15.91:0/3342875948 shutdown_connections 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3342875948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf200c1ed0 0x7fdf2006e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3342875948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf2014f850 0x7fdf200c3fa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- 172.21.15.91:0/3342875948 >> 172.21.15.91:0/3342875948 conn(0x7fdf2006c6a0 msgr2=0x7fdf2006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- 172.21.15.91:0/3342875948 shutdown_connections 2023-12-13T22:55:25.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- 172.21.15.91:0/3342875948 wait complete. 2023-12-13T22:55:25.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 Processor -- start 2023-12-13T22:55:25.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- start start 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf20070ab0 0x7fdf20141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2014f850 0x7fdf2014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201452a0 con 0x7fdf200c1ed0 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf20146fa0 con 0x7fdf20070ab0 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf27a44640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201459a0 con 0x7fdf2014f850 2023-12-13T22:55:25.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.644+0000 7fdf24fdf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.648+0000 7fdf24fdf640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59946/0 (socket says 172.21.15.91:59946) 2023-12-13T22:55:25.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.648+0000 7fdf24fdf640 1 -- 172.21.15.91:0/3129592104 learned_addr learned my addr 172.21.15.91:0/3129592104 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:25.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.648+0000 7fdf24fdf640 1 -- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2014f850 msgr2=0x7fdf2014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:25.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.648+0000 7fdf24fdf640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2014f850 0x7fdf2014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.652+0000 7fdf24fdf640 1 -- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf20070ab0 msgr2=0x7fdf20141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:25.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.652+0000 7fdf24fdf640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf20070ab0 0x7fdf20141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:25.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.652+0000 7fdf24fdf640 1 -- 172.21.15.91:0/3129592104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c00a670 con 0x7fdf200c1ed0 2023-12-13T22:55:25.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.652+0000 7fdf24fdf640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3f0 tx=0x7fdf1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.656+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011830 con 0x7fdf200c1ed0 2023-12-13T22:55:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.656+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf201431c0 con 0x7fdf200c1ed0 2023-12-13T22:55:25.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.656+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf20143460 con 0x7fdf200c1ed0 2023-12-13T22:55:25.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.656+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20067520 con 0x7fdf200c1ed0 2023-12-13T22:55:25.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.660+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10009200 con 0x7fdf200c1ed0 2023-12-13T22:55:25.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.660+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011bb0 con 0x7fdf200c1ed0 2023-12-13T22:55:25.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.940+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdf10011d10 con 0x7fdf200c1ed0 2023-12-13T22:55:25.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.940+0000 7fdf15ffb640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 0x7fdf04068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:25.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.940+0000 7fdf257e0640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 0x7fdf04068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:25.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.940+0000 7fdf257e0640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 0x7fdf04068cb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0b0000 tx=0x7fdf1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:25.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.992+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf1000f2e0 con 0x7fdf200c1ed0 2023-12-13T22:55:25.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:25.996+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdf10051ac0 con 0x7fdf200c1ed0 2023-12-13T22:55:26.159 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.160+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf20072590 con 0x7fdf200c1ed0 2023-12-13T22:55:26.261 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.264+0000 7fdf15ffb640 1 -- 172.21.15.91:0/3129592104 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18712 (secure 0 0 0) 0x7fdf100550e0 con 0x7fdf200c1ed0 2023-12-13T22:55:26.262 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:26.262 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":31,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:27:02.661258+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:55:26.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 msgr2=0x7fdf04068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 0x7fdf04068cb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0b0000 tx=0x7fdf1c008040 comp rx=0 tx=0).stop 2023-12-13T22:55:26.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 msgr2=0x7fdf201442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b3f0 tx=0x7fdf1000b8b0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 shutdown_connections 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf040667f0 0x7fdf04068cb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2014f850 0x7fdf2014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf200c1ed0 0x7fdf201442a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 --2- 172.21.15.91:0/3129592104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf20070ab0 0x7fdf20141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 >> 172.21.15.91:0/3129592104 conn(0x7fdf2006c6a0 msgr2=0x7fdf20158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 shutdown_connections 2023-12-13T22:55:26.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.268+0000 7fdf27a44640 1 -- 172.21.15.91:0/3129592104 wait complete. 2023-12-13T22:55:26.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:55:26.287 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:55:26.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.424+0000 7f511f3b0640 1 Processor -- start 2023-12-13T22:55:26.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 -- start start 2023-12-13T22:55:26.424 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5118151720 0x7f511806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f51180c40e0 0x7f51180c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511806f4a0 con 0x7f5118151340 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5118072570 con 0x7f51180c40e0 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511f3b0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5118070be0 con 0x7f5118151720 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511d94d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f51180c40e0 0x7f51180c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.425 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511d94d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f51180c40e0 0x7f51180c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59952/0 (socket says 172.21.15.91:59952) 2023-12-13T22:55:26.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511d94d640 1 -- 172.21.15.91:0/116774331 learned_addr learned my addr 172.21.15.91:0/116774331 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:26.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.428+0000 7f511c94b640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5118151720 0x7f511806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.432+0000 7f511d94d640 1 -- 172.21.15.91:0/116774331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5118151720 msgr2=0x7f511806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:26.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.432+0000 7f511d94d640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5118151720 0x7f511806ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.432+0000 7f511d94d640 1 -- 172.21.15.91:0/116774331 >> v1:172.21.15.152:6789/0 conn(0x7f5118151340 legacy=0x7f5118157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.432+0000 7f511d94d640 1 -- 172.21.15.91:0/116774331 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5118070e80 con 0x7f51180c40e0 2023-12-13T22:55:26.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.436+0000 7f511d94d640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51180c40e0 0x7f51180c4590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5110009e50 tx=0x7f511001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1399975142fed63 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:26.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f510ffff640 1 -- 172.21.15.91:0/116774331 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100a58a0 con 0x7f51180c40e0 2023-12-13T22:55:26.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f510ffff640 1 -- 172.21.15.91:0/116774331 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51100a5a00 con 0x7f51180c40e0 2023-12-13T22:55:26.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f510ffff640 1 -- 172.21.15.91:0/116774331 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100a5d90 con 0x7f51180c40e0 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 -- 172.21.15.91:0/116774331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51180c40e0 msgr2=0x7f51180c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51180c40e0 0x7f51180c4590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5110009e50 tx=0x7f511001c9e0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 -- 172.21.15.91:0/116774331 shutdown_connections 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f51180c40e0 0x7f51180c4590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 --2- 172.21.15.91:0/116774331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5118151720 0x7f511806ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 -- 172.21.15.91:0/116774331 >> 172.21.15.91:0/116774331 conn(0x7f511806c6a0 msgr2=0x7f511806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 -- 172.21.15.91:0/116774331 shutdown_connections 2023-12-13T22:55:26.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.440+0000 7f511f3b0640 1 -- 172.21.15.91:0/116774331 wait complete. 2023-12-13T22:55:26.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 Processor -- start 2023-12-13T22:55:26.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 -- start start 2023-12-13T22:55:26.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51180c40e0 0x7f5118073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.441 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5118151340 0x7f5118152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5118150ce0 con 0x7f5118151720 2023-12-13T22:55:26.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51181f5270 con 0x7f5118151340 2023-12-13T22:55:26.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511f3b0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511814bb00 con 0x7f51180c40e0 2023-12-13T22:55:26.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511d94d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511d94d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59964/0 (socket says 172.21.15.91:59964) 2023-12-13T22:55:26.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511d94d640 1 -- 172.21.15.91:0/3720619554 learned_addr learned my addr 172.21.15.91:0/3720619554 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:26.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511c94b640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5118151340 0x7f5118152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.444+0000 7f511d14c640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51180c40e0 0x7f5118073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.448+0000 7f511d94d640 1 -- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51180c40e0 msgr2=0x7f5118073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.448+0000 7f511d94d640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51180c40e0 0x7f5118073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.448+0000 7f511d94d640 1 -- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5118151340 msgr2=0x7f5118152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:26.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.448+0000 7f511d94d640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5118151340 0x7f5118152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:26.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.448+0000 7f511d94d640 1 -- 172.21.15.91:0/3720619554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5110009b30 con 0x7f5118151720 2023-12-13T22:55:26.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.452+0000 7f511d94d640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f51100af040 tx=0x7f5110019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:26.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100b8880 con 0x7f5118151720 2023-12-13T22:55:26.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51100b8a00 con 0x7f5118151720 2023-12-13T22:55:26.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100b8db0 con 0x7f5118151720 2023-12-13T22:55:26.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511814d450 con 0x7f5118151720 2023-12-13T22:55:26.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511814da10 con 0x7f5118151720 2023-12-13T22:55:26.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.456+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5118067520 con 0x7f5118151720 2023-12-13T22:55:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.748+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f51100c3460 con 0x7f5118151720 2023-12-13T22:55:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.748+0000 7f510dffb640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 0x7f50fc068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:26.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.748+0000 7f511d14c640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 0x7f50fc068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:26.745 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.748+0000 7f511d14c640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 0x7f50fc068d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5114001770 tx=0x7f5114009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:26.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.820+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f51100f1120 con 0x7f5118151720 2023-12-13T22:55:26.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:26.820+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f51100ed460 con 0x7f5118151720 2023-12-13T22:55:27.029 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.032+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51181f53b0 con 0x7f5118151720 2023-12-13T22:55:27.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f510dffb640 1 -- 172.21.15.91:0/3720619554 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51100f0a80 con 0x7f5118151720 2023-12-13T22:55:27.064 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 msgr2=0x7f50fc068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 0x7f50fc068d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5114001770 tx=0x7f5114009040 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 msgr2=0x7f5118152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f51100af040 tx=0x7f5110019780 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 shutdown_connections 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f50fc066870 0x7f50fc068d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5118151720 0x7f5118152560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5118151340 0x7f5118152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 --2- 172.21.15.91:0/3720619554 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51180c40e0 0x7f5118073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 >> 172.21.15.91:0/3720619554 conn(0x7f511806c6a0 msgr2=0x7f5118155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 shutdown_connections 2023-12-13T22:55:27.068 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.068+0000 7f511f3b0640 1 -- 172.21.15.91:0/3720619554 wait complete. 2023-12-13T22:55:27.086 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:55:27.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.212+0000 7f4d35ce9640 1 Processor -- start 2023-12-13T22:55:27.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.212+0000 7f4d35ce9640 1 -- start start 2023-12-13T22:55:27.211 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151340 0x7f4d3006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d30151720 0x7f4d30157c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4d300c40e0 0x7f4d300c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d30072570 con 0x7f4d30151720 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3006f4a0 con 0x7f4d300c40e0 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d35ce9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30070be0 con 0x7f4d30151340 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d30151720 0x7f4d30157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.212 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4d30151720 0x7f4d30157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59970/0 (socket says 172.21.15.91:59970) 2023-12-13T22:55:27.213 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 -- 172.21.15.91:0/1982148002 learned_addr learned my addr 172.21.15.91:0/1982148002 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:27.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 -- 172.21.15.91:0/1982148002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151340 msgr2=0x7f4d3006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:27.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 --2- 172.21.15.91:0/1982148002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151340 0x7f4d3006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 -- 172.21.15.91:0/1982148002 >> v2:172.21.15.152:3300/0 conn(0x7f4d300c40e0 msgr2=0x7f4d300c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:27.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 --2- 172.21.15.91:0/1982148002 >> v2:172.21.15.152:3300/0 conn(0x7f4d300c40e0 0x7f4d300c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.215 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.216+0000 7f4d2effd640 1 -- 172.21.15.91:0/1982148002 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30158190 con 0x7f4d30151720 2023-12-13T22:55:27.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.224+0000 7f4d2effd640 1 --2- 172.21.15.91:0/1982148002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d30151720 0x7f4d30157c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006d6a0 tx=0x7f4d2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d1c35e799c915f server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:27.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d2e7fc640 1 -- 172.21.15.91:0/1982148002 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240aa5f0 con 0x7f4d30151720 2023-12-13T22:55:27.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d2e7fc640 1 -- 172.21.15.91:0/1982148002 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d240aa750 con 0x7f4d30151720 2023-12-13T22:55:27.224 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d2e7fc640 1 -- 172.21.15.91:0/1982148002 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240aaae0 con 0x7f4d30151720 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- 172.21.15.91:0/1982148002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d30151720 msgr2=0x7f4d30157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/1982148002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d30151720 0x7f4d30157c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006d6a0 tx=0x7f4d2401c4d0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- 172.21.15.91:0/1982148002 shutdown_connections 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/1982148002 >> v2:172.21.15.152:3300/0 conn(0x7f4d300c40e0 0x7f4d300c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/1982148002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d30151720 0x7f4d30157c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.225 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/1982148002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151340 0x7f4d3006ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- 172.21.15.91:0/1982148002 >> 172.21.15.91:0/1982148002 conn(0x7f4d3006c6a0 msgr2=0x7f4d3006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:27.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- 172.21.15.91:0/1982148002 shutdown_connections 2023-12-13T22:55:27.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- 172.21.15.91:0/1982148002 wait complete. 2023-12-13T22:55:27.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 Processor -- start 2023-12-13T22:55:27.226 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- start start 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d30151340 0x7f4d30154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151720 0x7f4d300bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d301f9a60 con 0x7f4d300c40e0 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30159dd0 con 0x7f4d30151340 2023-12-13T22:55:27.227 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.228+0000 7f4d35ce9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d301f9730 con 0x7f4d30151720 2023-12-13T22:55:27.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59974/0 (socket says 172.21.15.91:59974) 2023-12-13T22:55:27.228 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 -- 172.21.15.91:0/2482103333 learned_addr learned my addr 172.21.15.91:0/2482103333 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:27.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 -- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151720 msgr2=0x7f4d300bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151720 0x7f4d300bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 -- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d30151340 msgr2=0x7f4d30154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d30151340 0x7f4d30154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.232+0000 7f4d2f7fe640 1 -- 172.21.15.91:0/2482103333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240094d0 con 0x7f4d300c40e0 2023-12-13T22:55:27.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.236+0000 7f4d2f7fe640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b410 tx=0x7f4d2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:27.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.240+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011830 con 0x7f4d300c40e0 2023-12-13T22:55:27.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.240+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20011990 con 0x7f4d300c40e0 2023-12-13T22:55:27.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.240+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20011d40 con 0x7f4d300c40e0 2023-12-13T22:55:27.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.244+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30159530 con 0x7f4d300c40e0 2023-12-13T22:55:27.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.244+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d30159af0 con 0x7f4d300c40e0 2023-12-13T22:55:27.240 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.244+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d30067520 con 0x7f4d300c40e0 2023-12-13T22:55:27.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.496+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4d2001a400 con 0x7f4d300c40e0 2023-12-13T22:55:27.495 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.500+0000 7f4d17fff640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 0x7f4d1c068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.496 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.500+0000 7f4d2effd640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 0x7f4d1c068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.497 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.500+0000 7f4d2effd640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 0x7f4d1c068d30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4d240ae000 tx=0x7f4d24004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:27.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.528+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d20055ed0 con 0x7f4d300c40e0 2023-12-13T22:55:27.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.528+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4d20051b10 con 0x7f4d300c40e0 2023-12-13T22:55:27.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.696+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d301f9870 con 0x7f4d300c40e0 2023-12-13T22:55:27.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.704+0000 7f4d17fff640 1 -- 172.21.15.91:0/2482103333 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d200150a0 con 0x7f4d300c40e0 2023-12-13T22:55:27.701 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.704+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 msgr2=0x7f4d1c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.704+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 0x7f4d1c068d30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4d240ae000 tx=0x7f4d24004740 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.704+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 msgr2=0x7f4d301f9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.704+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000b410 tx=0x7f4d2000b8d0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 shutdown_connections 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4d1c066870 0x7f4d1c068d30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4d30151720 0x7f4d300bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d30151340 0x7f4d30154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 --2- 172.21.15.91:0/2482103333 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4d300c40e0 0x7f4d301f9ef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 >> 172.21.15.91:0/2482103333 conn(0x7f4d3006c6a0 msgr2=0x7f4d300c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 shutdown_connections 2023-12-13T22:55:27.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.708+0000 7f4d35ce9640 1 -- 172.21.15.91:0/2482103333 wait complete. 2023-12-13T22:55:27.722 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:55:27.840 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 Processor -- start 2023-12-13T22:55:27.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 -- start start 2023-12-13T22:55:27.841 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2cac157280 0x7f2cac06f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac0c21d0 con 0x7f2cac06f840 2023-12-13T22:55:27.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cac157750 con 0x7f2cac151460 2023-12-13T22:55:27.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb4669640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac06ec00 con 0x7f2cac157280 2023-12-13T22:55:27.842 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb1c04640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2cac157280 0x7f2cac06f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb1c04640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2cac157280 0x7f2cac06f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:59986/0 (socket says 172.21.15.91:59986) 2023-12-13T22:55:27.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb2c06640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2cac06f840 0x7f2cac0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:50352/0 (socket says 172.21.15.91:50352) 2023-12-13T22:55:27.843 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.844+0000 7f2cb1c04640 1 -- 172.21.15.91:0/1235207745 learned_addr learned my addr 172.21.15.91:0/1235207745 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:27.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.848+0000 7f2cb1c04640 1 -- 172.21.15.91:0/1235207745 >> v1:172.21.15.152:6789/0 conn(0x7f2cac151460 legacy=0x7f2cac0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.846 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.848+0000 7f2cb1c04640 1 -- 172.21.15.91:0/1235207745 >> v1:172.21.15.91:6789/0 conn(0x7f2cac06f840 legacy=0x7f2cac0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.847 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.848+0000 7f2cb1c04640 1 -- 172.21.15.91:0/1235207745 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac157a30 con 0x7f2cac157280 2023-12-13T22:55:27.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.860+0000 7f2cb1c04640 1 --2- 172.21.15.91:0/1235207745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac06f300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00098a0 tx=0x7f2ca001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465e3e389116349c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:27.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb1403640 1 -- 172.21.15.91:0/1235207745 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00ab660 con 0x7f2cac157280 2023-12-13T22:55:27.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb1403640 1 -- 172.21.15.91:0/1235207745 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca00ab7c0 con 0x7f2cac157280 2023-12-13T22:55:27.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb1403640 1 -- 172.21.15.91:0/1235207745 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00abb50 con 0x7f2cac157280 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 -- 172.21.15.91:0/1235207745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 msgr2=0x7f2cac06f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 --2- 172.21.15.91:0/1235207745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac06f300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00098a0 tx=0x7f2ca001c460 comp rx=0 tx=0).stop 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 -- 172.21.15.91:0/1235207745 shutdown_connections 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 --2- 172.21.15.91:0/1235207745 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac06f300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 -- 172.21.15.91:0/1235207745 >> 172.21.15.91:0/1235207745 conn(0x7f2cac0708a0 msgr2=0x7f2cac070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 -- 172.21.15.91:0/1235207745 shutdown_connections 2023-12-13T22:55:27.878 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.880+0000 7f2cb4669640 1 -- 172.21.15.91:0/1235207745 wait complete. 2023-12-13T22:55:27.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 Processor -- start 2023-12-13T22:55:27.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 -- start start 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cac151460 0x7f2cac0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac1f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0ca330 con 0x7f2cac157280 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0ace90 con 0x7f2cac151460 2023-12-13T22:55:27.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.884+0000 7f2cb4669640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac14dcb0 con 0x7f2cac06f840 2023-12-13T22:55:27.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.888+0000 7f2cb2405640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.883 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.888+0000 7f2cb1c04640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cac151460 0x7f2cac0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.888+0000 7f2cb2c06640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac1f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:27.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.888+0000 7f2cb2405640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:48340/0 (socket says 172.21.15.91:48340) 2023-12-13T22:55:27.884 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.888+0000 7f2cb2405640 1 -- 172.21.15.91:0/3359240240 learned_addr learned my addr 172.21.15.91:0/3359240240 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:27.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.900+0000 7f2cb2405640 1 -- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cac151460 msgr2=0x7f2cac0c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.900+0000 7f2cb2405640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cac151460 0x7f2cac0c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.900+0000 7f2cb2405640 1 -- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 msgr2=0x7f2cac1f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:27.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.900+0000 7f2cb2405640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac1f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:27.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.900+0000 7f2cb2405640 1 -- 172.21.15.91:0/3359240240 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00094d0 con 0x7f2cac06f840 2023-12-13T22:55:27.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:27.948+0000 7f2cb2405640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c730 tx=0x7f2c9c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c006d60 con 0x7f2cac06f840 2023-12-13T22:55:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00ce40 con 0x7f2cac06f840 2023-12-13T22:55:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c003bc0 con 0x7f2cac06f840 2023-12-13T22:55:28.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac14df70 con 0x7f2cac06f840 2023-12-13T22:55:28.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac14e530 con 0x7f2cac06f840 2023-12-13T22:55:28.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.060+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac073e70 con 0x7f2cac06f840 2023-12-13T22:55:28.095 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.096+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2c9c003d20 con 0x7f2cac06f840 2023-12-13T22:55:28.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.100+0000 7f2caaffd640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 0x7f2c98068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:28.096 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.100+0000 7f2cb1c04640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 0x7f2c98068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:28.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.100+0000 7f2cb1c04640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 0x7f2c98068d00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00af000 tx=0x7f2ca00b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:28.098 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.100+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c9c055960 con 0x7f2cac06f840 2023-12-13T22:55:28.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.384+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2c9c055730 con 0x7f2cac06f840 2023-12-13T22:55:28.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.552+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cac0c8c10 con 0x7f2cac06f840 2023-12-13T22:55:28.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.708+0000 7f2caaffd640 1 -- 172.21.15.91:0/3359240240 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c9c0552c0 con 0x7f2cac06f840 2023-12-13T22:55:28.706 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 msgr2=0x7f2c98068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 0x7f2c98068d00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00af000 tx=0x7f2ca00b6040 comp rx=0 tx=0).stop 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 msgr2=0x7f2cac150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c730 tx=0x7f2c9c00cbf0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 shutdown_connections 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f2c98066840 0x7f2c98068d00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2cac157280 0x7f2cac1f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cac151460 0x7f2cac0c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 --2- 172.21.15.91:0/3359240240 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2cac06f840 0x7f2cac150890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 >> 172.21.15.91:0/3359240240 conn(0x7f2cac0708a0 msgr2=0x7f2cac070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:28.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 shutdown_connections 2023-12-13T22:55:28.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.712+0000 7f2cb4669640 1 -- 172.21.15.91:0/3359240240 wait complete. 2023-12-13T22:55:28.730 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:55:28.852 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 Processor -- start 2023-12-13T22:55:28.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 -- start start 2023-12-13T22:55:28.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08840c4630 0x7f08840c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840c72b0 con 0x7f0884156dc0 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088415a100 con 0x7f08840c4a10 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088c67e640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840c4f40 con 0x7f08840c4630 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088a41a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08840c4630 0x7f08840c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088a41a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08840c4630 0x7f08840c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50626/0 (socket says 172.21.15.91:50626) 2023-12-13T22:55:28.854 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.856+0000 7f088a41a640 1 -- 172.21.15.91:0/3234656290 learned_addr learned my addr 172.21.15.91:0/3234656290 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.860+0000 7f088a41a640 1 -- 172.21.15.91:0/3234656290 >> v1:172.21.15.152:6789/0 conn(0x7f08840c4a10 legacy=0x7f08841596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.860+0000 7f088a41a640 1 -- 172.21.15.91:0/3234656290 >> v1:172.21.15.91:6789/0 conn(0x7f0884156dc0 legacy=0x7f088414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:28.857 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.860+0000 7f088a41a640 1 -- 172.21.15.91:0/3234656290 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088415a3e0 con 0x7f08840c4630 2023-12-13T22:55:28.861 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.864+0000 7f088a41a640 1 --2- 172.21.15.91:0/3234656290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08840c4630 0x7f08840c6d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0878009870 tx=0x7f0878020f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e01b8be8e36652 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:28.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f0889418640 1 -- 172.21.15.91:0/3234656290 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08780aac00 con 0x7f08840c4630 2023-12-13T22:55:28.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f0889418640 1 -- 172.21.15.91:0/3234656290 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08780aad60 con 0x7f08840c4630 2023-12-13T22:55:28.865 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f0889418640 1 -- 172.21.15.91:0/3234656290 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08780b2660 con 0x7f08840c4630 2023-12-13T22:55:28.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 -- 172.21.15.91:0/3234656290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08840c4630 msgr2=0x7f08840c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 --2- 172.21.15.91:0/3234656290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08840c4630 0x7f08840c6d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0878009870 tx=0x7f0878020f00 comp rx=0 tx=0).stop 2023-12-13T22:55:28.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 -- 172.21.15.91:0/3234656290 shutdown_connections 2023-12-13T22:55:28.866 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 --2- 172.21.15.91:0/3234656290 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08840c4630 0x7f08840c6d70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 -- 172.21.15.91:0/3234656290 >> 172.21.15.91:0/3234656290 conn(0x7f088406c6a0 msgr2=0x7f088406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 -- 172.21.15.91:0/3234656290 shutdown_connections 2023-12-13T22:55:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.868+0000 7f088c67e640 1 -- 172.21.15.91:0/3234656290 wait complete. 2023-12-13T22:55:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 Processor -- start 2023-12-13T22:55:28.867 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 -- start start 2023-12-13T22:55:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08840c4630 0x7f0884072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08840c4a10 0x7f08841485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:28.868 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:28.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884155450 con 0x7f0884156dc0 2023-12-13T22:55:28.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884154520 con 0x7f08840c4630 2023-12-13T22:55:28.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088c67e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0884155f50 con 0x7f08840c4a10 2023-12-13T22:55:28.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088ac1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:28.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088ac1b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50632/0 (socket says 172.21.15.91:50632) 2023-12-13T22:55:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088ac1b640 1 -- 172.21.15.91:0/4093970527 learned_addr learned my addr 172.21.15.91:0/4093970527 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f0889c19640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08840c4a10 0x7f08841485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:28.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.872+0000 7f088a41a640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08840c4630 0x7f0884072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 -- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08840c4a10 msgr2=0x7f08841485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08840c4a10 0x7f08841485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 -- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08840c4630 msgr2=0x7f0884072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08840c4630 0x7f0884072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:28.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 -- 172.21.15.91:0/4093970527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780094d0 con 0x7f0884156dc0 2023-12-13T22:55:28.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.876+0000 7f088ac1b640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c780 tx=0x7f087c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:28.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.880+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c004b70 con 0x7f0884156dc0 2023-12-13T22:55:28.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.880+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c00ce90 con 0x7f0884156dc0 2023-12-13T22:55:28.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.880+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00a850 con 0x7f0884156dc0 2023-12-13T22:55:28.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.880+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088414a5e0 con 0x7f0884156dc0 2023-12-13T22:55:28.879 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.880+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0884153ef0 con 0x7f0884156dc0 2023-12-13T22:55:28.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:28.884+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0884154660 con 0x7f0884156dc0 2023-12-13T22:55:29.165 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.168+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f087c006b60 con 0x7f0884156dc0 2023-12-13T22:55:29.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.168+0000 7f0876ffd640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 0x7f0868068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.168+0000 7f088a41a640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 0x7f0868068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:29.166 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.168+0000 7f088a41a640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 0x7f0868068d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08780b4000 tx=0x7f08780ac070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:29.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.204+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f087c055580 con 0x7f0884156dc0 2023-12-13T22:55:29.204 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.208+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f087c0518c0 con 0x7f0884156dc0 2023-12-13T22:55:29.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.364+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f088414a5e0 con 0x7f0884156dc0 2023-12-13T22:55:29.383 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.384+0000 7f0876ffd640 1 -- 172.21.15.91:0/4093970527 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f088414a5e0 con 0x7f0884156dc0 2023-12-13T22:55:29.383 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:55:29.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 msgr2=0x7f0868068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:29.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 0x7f0868068d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f08780b4000 tx=0x7f08780ac070 comp rx=0 tx=0).stop 2023-12-13T22:55:29.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 msgr2=0x7f0884154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:29.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c780 tx=0x7f087c00cc40 comp rx=0 tx=0).stop 2023-12-13T22:55:29.385 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 shutdown_connections 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0868066870 0x7f0868068d30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f0884156dc0 0x7f0884154940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08840c4a10 0x7f08841485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 --2- 172.21.15.91:0/4093970527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08840c4630 0x7f0884072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 >> 172.21.15.91:0/4093970527 conn(0x7f088406c6a0 msgr2=0x7f088414e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 shutdown_connections 2023-12-13T22:55:29.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.388+0000 7f088c67e640 1 -- 172.21.15.91:0/4093970527 wait complete. 2023-12-13T22:55:29.404 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T22:55:29.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 Processor -- start 2023-12-13T22:55:29.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 -- start start 2023-12-13T22:55:29.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f32140cb7d0 0x7f3214163f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321406b4c0 con 0x7f321414ff30 2023-12-13T22:55:29.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321415cd60 con 0x7f32140cb7d0 2023-12-13T22:55:29.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.528+0000 7f3219eca640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321415a4c0 con 0x7f321415a050 2023-12-13T22:55:29.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.532+0000 7f320affd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:29.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.532+0000 7f320affd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:41074/0 (socket says 172.21.15.91:41074) 2023-12-13T22:55:29.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.532+0000 7f320affd640 1 -- 172.21.15.91:0/3647786791 learned_addr learned my addr 172.21.15.91:0/3647786791 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.536+0000 7f320affd640 1 -- 172.21.15.91:0/3647786791 >> v2:172.21.15.91:3300/0 conn(0x7f32140cb7d0 msgr2=0x7f3214163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.536+0000 7f320affd640 1 --2- 172.21.15.91:0/3647786791 >> v2:172.21.15.91:3300/0 conn(0x7f32140cb7d0 0x7f3214163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.536+0000 7f320affd640 1 -- 172.21.15.91:0/3647786791 >> v1:172.21.15.91:6789/0 conn(0x7f321414ff30 legacy=0x7f321415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:29.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.536+0000 7f320affd640 1 -- 172.21.15.91:0/3647786791 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321406bcd0 con 0x7f321415a050 2023-12-13T22:55:29.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.540+0000 7f320affd640 1 --2- 172.21.15.91:0/3647786791 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009870 tx=0x7f31fc01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8156eabcdd71dcc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:29.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.684+0000 7f3212ffd640 1 -- 172.21.15.91:0/3647786791 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0ac630 con 0x7f321415a050 2023-12-13T22:55:29.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.684+0000 7f3212ffd640 1 -- 172.21.15.91:0/3647786791 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0ac790 con 0x7f321415a050 2023-12-13T22:55:29.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.684+0000 7f3212ffd640 1 -- 172.21.15.91:0/3647786791 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0acb20 con 0x7f321415a050 2023-12-13T22:55:29.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- 172.21.15.91:0/3647786791 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 msgr2=0x7f32140cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:29.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- 172.21.15.91:0/3647786791 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009870 tx=0x7f31fc01c500 comp rx=0 tx=0).stop 2023-12-13T22:55:29.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- 172.21.15.91:0/3647786791 shutdown_connections 2023-12-13T22:55:29.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- 172.21.15.91:0/3647786791 >> v2:172.21.15.91:3300/0 conn(0x7f32140cb7d0 0x7f3214163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- 172.21.15.91:0/3647786791 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f321415a050 0x7f32140cb290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- 172.21.15.91:0/3647786791 >> 172.21.15.91:0/3647786791 conn(0x7f321406d220 msgr2=0x7f321406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:29.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- 172.21.15.91:0/3647786791 shutdown_connections 2023-12-13T22:55:29.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- 172.21.15.91:0/3647786791 wait complete. 2023-12-13T22:55:29.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 Processor -- start 2023-12-13T22:55:29.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- start start 2023-12-13T22:55:29.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f32140cb7d0 0x7f32141f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321414ff30 0x7f3214148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:29.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140c7bc0 con 0x7f321414ff30 2023-12-13T22:55:29.687 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141f2d80 con 0x7f321415a050 2023-12-13T22:55:29.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.688+0000 7f3219eca640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321414bd80 con 0x7f32140cb7d0 2023-12-13T22:55:29.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.692+0000 7f3213fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:29.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.692+0000 7f3213fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:42778/0 (socket says 172.21.15.91:42778) 2023-12-13T22:55:29.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.692+0000 7f3213fff640 1 -- 172.21.15.91:0/1052095296 learned_addr learned my addr 172.21.15.91:0/1052095296 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:29.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.692+0000 7f32137fe640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f32140cb7d0 0x7f32141f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:29.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f320affd640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321414ff30 0x7f3214148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:29.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f3213fff640 1 -- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f32140cb7d0 msgr2=0x7f32141f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:29.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f3213fff640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f32140cb7d0 0x7f32141f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f3213fff640 1 -- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321414ff30 msgr2=0x7f3214148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:29.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f3213fff640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321414ff30 0x7f3214148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:29.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.696+0000 7f3213fff640 1 -- 172.21.15.91:0/1052095296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0094d0 con 0x7f321415a050 2023-12-13T22:55:29.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.700+0000 7f3213fff640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b970 tx=0x7f320c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00cb40 con 0x7f321415a050 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00ccc0 con 0x7f321415a050 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32141f1da0 con 0x7f321415a050 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c014680 con 0x7f321415a050 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321414c2c0 con 0x7f321415a050 2023-12-13T22:55:29.710 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:29.712+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3214073e70 con 0x7f321415a050 2023-12-13T22:55:30.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.132+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f320c01d3b0 con 0x7f321415a050 2023-12-13T22:55:30.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.132+0000 7f3210ff9640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 0x7f31f4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.132+0000 7f32137fe640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 0x7f31f4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.132 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.132+0000 7f32137fe640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 0x7f31f4068d30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3204007fd0 tx=0x7f3204009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:30.158 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.156+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f320c00ce30 con 0x7f321415a050 2023-12-13T22:55:30.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.196+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f320c051750 con 0x7f321415a050 2023-12-13T22:55:30.384 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.384+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f32140c5800 con 0x7f321415a050 2023-12-13T22:55:30.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3210ff9640 1 -- 172.21.15.91:0/1052095296 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f320c019070 con 0x7f321415a050 2023-12-13T22:55:30.399 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 msgr2=0x7f31f4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 0x7f31f4068d30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3204007fd0 tx=0x7f3204009040 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 msgr2=0x7f321414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f320c00b970 tx=0x7f320c00be30 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 shutdown_connections 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f31f4066870 0x7f31f4068d30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f321415a050 0x7f321414ef20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f321414ff30 0x7f3214148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 --2- 172.21.15.91:0/1052095296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f32140cb7d0 0x7f32141f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 >> 172.21.15.91:0/1052095296 conn(0x7f321406d220 msgr2=0x7f321406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 shutdown_connections 2023-12-13T22:55:30.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.400+0000 7f3219eca640 1 -- 172.21.15.91:0/1052095296 wait complete. 2023-12-13T22:55:30.419 DEBUG:teuthology.orchestra.run.smithi091:> set -ex 2023-12-13T22:55:30.419 DEBUG:teuthology.orchestra.run.smithi091:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-13T22:55:30.425 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:55:30.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.596+0000 7fbb1235f640 1 Processor -- start 2023-12-13T22:55:30.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.596+0000 7fbb1235f640 1 -- start start 2023-12-13T22:55:30.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb1235f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb0c0c5ab0 0x7fbb0c071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb1235f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c157fa0 con 0x7fbb0c161950 2023-12-13T22:55:30.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb1235f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c161d80 con 0x7fbb0c157bc0 2023-12-13T22:55:30.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb1235f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c161530 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb108fc640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fbb0c161950 0x7fbb0c0c7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:41416/0 (socket says 172.21.15.91:41416) 2023-12-13T22:55:30.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb108fc640 1 -- 172.21.15.91:0/3344211450 learned_addr learned my addr 172.21.15.91:0/3344211450 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:30.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.600+0000 7fbb0b7fe640 1 --2- 172.21.15.91:0/3344211450 >> v2:172.21.15.152:3300/0 conn(0x7fbb0c0c5ab0 0x7fbb0c071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.604+0000 7fbb0affd640 1 -- 172.21.15.91:0/3344211450 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290297489 0 0) 0x7fbb0c157fa0 con 0x7fbb0c161950 2023-12-13T22:55:30.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.604+0000 7fbb0affd640 1 -- 172.21.15.91:0/3344211450 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf4003530 con 0x7fbb0c161950 2023-12-13T22:55:30.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.608+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/3344211450 >> v1:172.21.15.152:6789/0 conn(0x7fbb0c157bc0 legacy=0x7fbb0c15e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:30.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.608+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/3344211450 >> v1:172.21.15.91:6789/0 conn(0x7fbb0c161950 legacy=0x7fbb0c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.608+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/3344211450 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c160eb0 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.612+0000 7fbb0b7fe640 1 --2- 172.21.15.91:0/3344211450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c071540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb000097c0 tx=0x7fbb0001c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be7870c6b0aca2a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:30.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb0affd640 1 -- 172.21.15.91:0/3344211450 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000ab600 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb0affd640 1 -- 172.21.15.91:0/3344211450 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb000a7050 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb0affd640 1 -- 172.21.15.91:0/3344211450 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000ab980 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- 172.21.15.91:0/3344211450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 msgr2=0x7fbb0c071540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 --2- 172.21.15.91:0/3344211450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c071540 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb000097c0 tx=0x7fbb0001c2f0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- 172.21.15.91:0/3344211450 shutdown_connections 2023-12-13T22:55:30.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 --2- 172.21.15.91:0/3344211450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c071540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- 172.21.15.91:0/3344211450 >> 172.21.15.91:0/3344211450 conn(0x7fbb0c06c6a0 msgr2=0x7fbb0c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:30.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- 172.21.15.91:0/3344211450 shutdown_connections 2023-12-13T22:55:30.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- 172.21.15.91:0/3344211450 wait complete. 2023-12-13T22:55:30.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 Processor -- start 2023-12-13T22:55:30.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- start start 2023-12-13T22:55:30.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0c161950 0x7fbb0c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c148da0 con 0x7fbb0c157bc0 2023-12-13T22:55:30.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c1503f0 con 0x7fbb0c0c5ab0 2023-12-13T22:55:30.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.628+0000 7fbb1235f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c146f90 con 0x7fbb0c161950 2023-12-13T22:55:30.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.632+0000 7fbb0b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.632+0000 7fbb0b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50662/0 (socket says 172.21.15.91:50662) 2023-12-13T22:55:30.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.632+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/1174965864 learned_addr learned my addr 172.21.15.91:0/1174965864 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:30.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.632+0000 7fbb108fc640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0c161950 0x7fbb0c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.632+0000 7fbb0bfff640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0c161950 msgr2=0x7fbb0c14f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0c161950 0x7fbb0c14f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 msgr2=0x7fbb0c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c15fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:30.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 -- 172.21.15.91:0/1174965864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009420 con 0x7fbb0c157bc0 2023-12-13T22:55:30.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.636+0000 7fbb0b7fe640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ae040 tx=0x7fbb00019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:30.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000b4430 con 0x7fbb0c157bc0 2023-12-13T22:55:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c147270 con 0x7fbb0c157bc0 2023-12-13T22:55:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c147830 con 0x7fbb0c157bc0 2023-12-13T22:55:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c0c6680 con 0x7fbb0c157bc0 2023-12-13T22:55:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb000b4590 con 0x7fbb0c157bc0 2023-12-13T22:55:30.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.640+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000b4900 con 0x7fbb0c157bc0 2023-12-13T22:55:30.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.964+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbb000b2040 con 0x7fbb0c157bc0 2023-12-13T22:55:30.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.964+0000 7fbb08ff9640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 0x7fbaf8068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.964+0000 7fbb0bfff640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 0x7fbaf8068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:30.962 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.964+0000 7fbb0bfff640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 0x7fbaf8068ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009f20 tx=0x7fbb040094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:30.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.992+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbb000f0080 con 0x7fbb0c157bc0 2023-12-13T22:55:30.990 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:30.992+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbb000ebcc0 con 0x7fbb0c157bc0 2023-12-13T22:55:31.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.160+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb0c0c8c30 con 0x7fbb0c157bc0 2023-12-13T22:55:31.231 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.232+0000 7fbb08ff9640 1 -- 172.21.15.91:0/1174965864 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18712 (secure 0 0 0) 0x7fbb000b0090 con 0x7fbb0c157bc0 2023-12-13T22:55:31.232 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:31.232 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":31,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:27:02.661258+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:55:31.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 msgr2=0x7fbaf8068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 0x7fbaf8068ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009f20 tx=0x7fbb040094d0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 msgr2=0x7fbb0c160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbb000ae040 tx=0x7fbb00019090 comp rx=0 tx=0).stop 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 shutdown_connections 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fbaf8066820 0x7fbaf8068ce0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0c161950 0x7fbb0c14f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fbb0c157bc0 0x7fbb0c160580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 --2- 172.21.15.91:0/1174965864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0c5ab0 0x7fbb0c15fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 >> 172.21.15.91:0/1174965864 conn(0x7fbb0c06c6a0 msgr2=0x7fbb0c0c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 shutdown_connections 2023-12-13T22:55:31.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.236+0000 7fbb1235f640 1 -- 172.21.15.91:0/1174965864 wait complete. 2023-12-13T22:55:31.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-13T22:25:17.301016+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-13T22:25:55.336057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-13T22:25:56.963208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-13T22:26:03.245007+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-13T22:55:31.257 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-13T22:55:31.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.388+0000 7fa56ee69640 1 Processor -- start 2023-12-13T22:55:31.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.388+0000 7fa56ee69640 1 -- start start 2023-12-13T22:55:31.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56ee69640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa568151340 0x7fa56806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56ee69640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5680c40e0 0x7fa5680c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56ee69640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56806f4a0 con 0x7fa568151720 2023-12-13T22:55:31.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56ee69640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa568072570 con 0x7fa568151340 2023-12-13T22:55:31.388 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56ee69640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa568070be0 con 0x7fa5680c40e0 2023-12-13T22:55:31.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56cc05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa568151340 0x7fa56806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:31.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56cc05640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa568151340 0x7fa56806ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50666/0 (socket says 172.21.15.91:50666) 2023-12-13T22:55:31.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56cc05640 1 -- 172.21.15.91:0/4063580632 learned_addr learned my addr 172.21.15.91:0/4063580632 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:31.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.392+0000 7fa56d406640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5680c40e0 0x7fa5680c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:31.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.396+0000 7fa56cc05640 1 -- 172.21.15.91:0/4063580632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5680c40e0 msgr2=0x7fa5680c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:31.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.396+0000 7fa56cc05640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5680c40e0 0x7fa5680c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.396+0000 7fa56cc05640 1 -- 172.21.15.91:0/4063580632 >> v1:172.21.15.152:6789/0 conn(0x7fa568151720 legacy=0x7fa568157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.396+0000 7fa56cc05640 1 -- 172.21.15.91:0/4063580632 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568070e80 con 0x7fa568151340 2023-12-13T22:55:31.396 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.400+0000 7fa56cc05640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151340 0x7fa56806ee10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa558009870 tx=0x7fa55801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e9092dad11b355 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:31.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa5677fe640 1 -- 172.21.15.91:0/4063580632 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580aa670 con 0x7fa568151340 2023-12-13T22:55:31.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa5677fe640 1 -- 172.21.15.91:0/4063580632 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580aa7d0 con 0x7fa568151340 2023-12-13T22:55:31.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa5677fe640 1 -- 172.21.15.91:0/4063580632 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580aab60 con 0x7fa568151340 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- 172.21.15.91:0/4063580632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151340 msgr2=0x7fa56806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151340 0x7fa56806ee10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa558009870 tx=0x7fa55801c510 comp rx=0 tx=0).stop 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- 172.21.15.91:0/4063580632 shutdown_connections 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5680c40e0 0x7fa5680c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- 172.21.15.91:0/4063580632 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151340 0x7fa56806ee10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- 172.21.15.91:0/4063580632 >> 172.21.15.91:0/4063580632 conn(0x7fa56806c6a0 msgr2=0x7fa56806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:31.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- 172.21.15.91:0/4063580632 shutdown_connections 2023-12-13T22:55:31.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- 172.21.15.91:0/4063580632 wait complete. 2023-12-13T22:55:31.402 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 Processor -- start 2023-12-13T22:55:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- start start 2023-12-13T22:55:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5680c40e0 0x7fa56814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa568151340 0x7fa56814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681618d0 con 0x7fa568151720 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56814ceb0 con 0x7fa5680c40e0 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.404+0000 7fa56ee69640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681f2a30 con 0x7fa568151340 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.408+0000 7fa56d406640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.408+0000 7fa56d406640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50682/0 (socket says 172.21.15.91:50682) 2023-12-13T22:55:31.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.408+0000 7fa56d406640 1 -- 172.21.15.91:0/3094611521 learned_addr learned my addr 172.21.15.91:0/3094611521 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:31.405 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.408+0000 7fa56cc05640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5680c40e0 0x7fa56814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:31.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 -- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa568151340 msgr2=0x7fa56814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.409 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa568151340 0x7fa56814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 -- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5680c40e0 msgr2=0x7fa56814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5680c40e0 0x7fa56814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.410 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 -- 172.21.15.91:0/3094611521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580094d0 con 0x7fa568151720 2023-12-13T22:55:31.411 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.412+0000 7fa56d406640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa56000efc0 tx=0x7fa56000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:31.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560014480 con 0x7fa568151720 2023-12-13T22:55:31.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000f040 con 0x7fa568151720 2023-12-13T22:55:31.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560014820 con 0x7fa568151720 2023-12-13T22:55:31.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5681f24b0 con 0x7fa568151720 2023-12-13T22:55:31.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680c6a20 con 0x7fa568151720 2023-12-13T22:55:31.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.420+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa568067520 con 0x7fa568151720 2023-12-13T22:55:31.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.440+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa560014980 con 0x7fa568151720 2023-12-13T22:55:31.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.440+0000 7fa5657fa640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:31.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.440+0000 7fa56cc05640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:31.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.440+0000 7fa56cc05640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 0x7fa554068d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:31.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.444+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa560056cf0 con 0x7fa568151720 2023-12-13T22:55:31.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.700+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa560052930 con 0x7fa568151720 2023-12-13T22:55:31.863 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.864+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa56814d100 con 0x7fa568151720 2023-12-13T22:55:31.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.872+0000 7fa5657fa640 1 -- 172.21.15.91:0/3094611521 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa560018070 con 0x7fa568151720 2023-12-13T22:55:31.870 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 1 2023-12-13T22:55:31.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 msgr2=0x7fa554068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 0x7fa554068d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580b5040 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 msgr2=0x7fa568149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa56000efc0 tx=0x7fa56000c490 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 shutdown_connections 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa568151720 0x7fa568149030 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa568151340 0x7fa56814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 --2- 172.21.15.91:0/3094611521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5680c40e0 0x7fa56814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 >> 172.21.15.91:0/3094611521 conn(0x7fa56806c6a0 msgr2=0x7fa5680c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 shutdown_connections 2023-12-13T22:55:31.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:31.876+0000 7fa56ee69640 1 -- 172.21.15.91:0/3094611521 wait complete. 2023-12-13T22:55:31.890 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-13T22:55:32.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 Processor -- start 2023-12-13T22:55:32.012 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 -- start start 2023-12-13T22:55:32.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 0x7fdf44159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4415a4a0 con 0x7fdf4415c1c0 2023-12-13T22:55:32.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4406d560 con 0x7fdf4415c5a0 2023-12-13T22:55:32.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4bf59640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4406cc00 con 0x7fdf4415b620 2023-12-13T22:55:32.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf4a4f6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 0x7fdf44159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf494f4640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdf4415c5a0 0x7fdf440cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:55896/0 (socket says 172.21.15.91:55896) 2023-12-13T22:55:32.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.016+0000 7fdf494f4640 1 -- 172.21.15.91:0/1127004923 learned_addr learned my addr 172.21.15.91:0/1127004923 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.024+0000 7fdf4a4f6640 1 -- 172.21.15.91:0/1127004923 >> v1:172.21.15.152:6789/0 conn(0x7fdf4415c5a0 legacy=0x7fdf440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.024+0000 7fdf4a4f6640 1 -- 172.21.15.91:0/1127004923 >> v1:172.21.15.91:6789/0 conn(0x7fdf4415c1c0 legacy=0x7fdf4415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.024+0000 7fdf4a4f6640 1 -- 172.21.15.91:0/1127004923 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4406c680 con 0x7fdf4415b620 2023-12-13T22:55:32.033 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.036+0000 7fdf4a4f6640 1 --2- 172.21.15.91:0/1127004923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 0x7fdf44159f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009dc0 tx=0x7fdf3c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0c48f462e2e7bc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:32.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.052+0000 7fdf48cf3640 1 -- 172.21.15.91:0/1127004923 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0a5a00 con 0x7fdf4415b620 2023-12-13T22:55:32.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.052+0000 7fdf48cf3640 1 -- 172.21.15.91:0/1127004923 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c0a5b60 con 0x7fdf4415b620 2023-12-13T22:55:32.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.052+0000 7fdf48cf3640 1 -- 172.21.15.91:0/1127004923 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0ad440 con 0x7fdf4415b620 2023-12-13T22:55:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- 172.21.15.91:0/1127004923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 msgr2=0x7fdf44159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/1127004923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 0x7fdf44159f60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009dc0 tx=0x7fdf3c01c940 comp rx=0 tx=0).stop 2023-12-13T22:55:32.052 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- 172.21.15.91:0/1127004923 shutdown_connections 2023-12-13T22:55:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/1127004923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415b620 0x7fdf44159f60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- 172.21.15.91:0/1127004923 >> 172.21.15.91:0/1127004923 conn(0x7fdf44060fd0 msgr2=0x7fdf440613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- 172.21.15.91:0/1127004923 shutdown_connections 2023-12-13T22:55:32.053 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- 172.21.15.91:0/1127004923 wait complete. 2023-12-13T22:55:32.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 Processor -- start 2023-12-13T22:55:32.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- start start 2023-12-13T22:55:32.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf4415b620 0x7fdf440bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.054 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415c5a0 0x7fdf44155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440bcba0 con 0x7fdf4415b620 2023-12-13T22:55:32.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44156b60 con 0x7fdf4415c1c0 2023-12-13T22:55:32.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.056+0000 7fdf4bf59640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44156e30 con 0x7fdf4415c5a0 2023-12-13T22:55:32.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.060+0000 7fdf494f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.060+0000 7fdf494f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:42800/0 (socket says 172.21.15.91:42800) 2023-12-13T22:55:32.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.060+0000 7fdf494f4640 1 -- 172.21.15.91:0/2487549958 learned_addr learned my addr 172.21.15.91:0/2487549958 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:32.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.060+0000 7fdf4a4f6640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415c5a0 0x7fdf44155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.068+0000 7fdf494f4640 1 -- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415c5a0 msgr2=0x7fdf44155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.068+0000 7fdf494f4640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415c5a0 0x7fdf44155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.068+0000 7fdf494f4640 1 -- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf4415b620 msgr2=0x7fdf440bef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.068+0000 7fdf494f4640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf4415b620 0x7fdf440bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.067 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.068+0000 7fdf494f4640 1 -- 172.21.15.91:0/2487549958 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009a70 con 0x7fdf4415c1c0 2023-12-13T22:55:32.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.076+0000 7fdf494f4640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c500 tx=0x7fdf3400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34005cf0 con 0x7fdf4415c1c0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf34005e50 con 0x7fdf4415c1c0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340072f0 con 0x7fdf4415c1c0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44155fe0 con 0x7fdf4415c1c0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf441565a0 con 0x7fdf4415c1c0 2023-12-13T22:55:32.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.088+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44067d50 con 0x7fdf4415c1c0 2023-12-13T22:55:32.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.435+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdf34007450 con 0x7fdf4415c1c0 2023-12-13T22:55:32.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.435+0000 7fdf3a7fc640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 0x7fdf28068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.433 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.435+0000 7fdf49cf5640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 0x7fdf28068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.435+0000 7fdf49cf5640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 0x7fdf28068d30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000f70 tx=0x7fdf400079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:32.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.447+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf34054b00 con 0x7fdf4415c1c0 2023-12-13T22:55:32.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.567+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdf34050e40 con 0x7fdf4415c1c0 2023-12-13T22:55:32.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.719+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf44067520 con 0x7fdf4415c1c0 2023-12-13T22:55:32.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.807+0000 7fdf3a7fc640 1 -- 172.21.15.91:0/2487549958 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf34054460 con 0x7fdf4415c1c0 2023-12-13T22:55:32.807 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 msgr2=0x7fdf28068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 0x7fdf28068d30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf40000f70 tx=0x7fdf400079e0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 msgr2=0x7fdf441540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400c500 tx=0x7fdf3400c9c0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 shutdown_connections 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdf28066870 0x7fdf28068d30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf4415c5a0 0x7fdf44155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf4415c1c0 0x7fdf441540b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 --2- 172.21.15.91:0/2487549958 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdf4415b620 0x7fdf440bef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 >> 172.21.15.91:0/2487549958 conn(0x7fdf44060fd0 msgr2=0x7fdf440613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:32.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 shutdown_connections 2023-12-13T22:55:32.811 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.811+0000 7fdf4bf59640 1 -- 172.21.15.91:0/2487549958 wait complete. 2023-12-13T22:55:32.831 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-13T22:55:32.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.959+0000 7fa535033640 1 Processor -- start 2023-12-13T22:55:32.959 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.959+0000 7fa535033640 1 -- start start 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa535033640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa5300c46c0 0x7fa5300c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa535033640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5301567d0 0x7fa53014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa535033640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5300c27c0 con 0x7fa5300c4aa0 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa535033640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5300c1ed0 con 0x7fa5301567d0 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa535033640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa530156ca0 con 0x7fa5300c46c0 2023-12-13T22:55:32.960 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa52f59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5301567d0 0x7fa53014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa52f59e640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa5301567d0 0x7fa53014fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50690/0 (socket says 172.21.15.91:50690) 2023-12-13T22:55:32.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa52f59e640 1 -- 172.21.15.91:0/1117793918 learned_addr learned my addr 172.21.15.91:0/1117793918 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:32.961 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.963+0000 7fa52ed9d640 1 --2- 172.21.15.91:0/1117793918 >> v2:172.21.15.152:3300/0 conn(0x7fa5300c46c0 0x7fa5300c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.967+0000 7fa52f59e640 1 -- 172.21.15.91:0/1117793918 >> v2:172.21.15.152:3300/0 conn(0x7fa5300c46c0 msgr2=0x7fa5300c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:32.964 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.967+0000 7fa52f59e640 1 --2- 172.21.15.91:0/1117793918 >> v2:172.21.15.152:3300/0 conn(0x7fa5300c46c0 0x7fa5300c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.967+0000 7fa52f59e640 1 -- 172.21.15.91:0/1117793918 >> v1:172.21.15.152:6789/0 conn(0x7fa5300c4aa0 legacy=0x7fa5301560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:32.965 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.967+0000 7fa52f59e640 1 -- 172.21.15.91:0/1117793918 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530156f60 con 0x7fa5301567d0 2023-12-13T22:55:32.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.971+0000 7fa52f59e640 1 --2- 172.21.15.91:0/1117793918 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5301567d0 0x7fa53014fdf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5300c6690 tx=0x7fa52801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8424c76404ac21ff server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:32.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa52dd9b640 1 -- 172.21.15.91:0/1117793918 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280af400 con 0x7fa5301567d0 2023-12-13T22:55:32.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa52dd9b640 1 -- 172.21.15.91:0/1117793918 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280ab050 con 0x7fa5301567d0 2023-12-13T22:55:32.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa52dd9b640 1 -- 172.21.15.91:0/1117793918 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280af780 con 0x7fa5301567d0 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- 172.21.15.91:0/1117793918 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5301567d0 msgr2=0x7fa53014fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 --2- 172.21.15.91:0/1117793918 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5301567d0 0x7fa53014fdf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5300c6690 tx=0x7fa52801f180 comp rx=0 tx=0).stop 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- 172.21.15.91:0/1117793918 shutdown_connections 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 --2- 172.21.15.91:0/1117793918 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5301567d0 0x7fa53014fdf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 --2- 172.21.15.91:0/1117793918 >> v2:172.21.15.152:3300/0 conn(0x7fa5300c46c0 0x7fa5300c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- 172.21.15.91:0/1117793918 >> 172.21.15.91:0/1117793918 conn(0x7fa53006c6a0 msgr2=0x7fa53006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- 172.21.15.91:0/1117793918 shutdown_connections 2023-12-13T22:55:32.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- 172.21.15.91:0/1117793918 wait complete. 2023-12-13T22:55:32.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 Processor -- start 2023-12-13T22:55:32.975 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.975+0000 7fa535033640 1 -- start start 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5300c4aa0 0x7fa53015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5301567d0 0x7fa5301f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa530155010 con 0x7fa5300c46c0 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53015b780 con 0x7fa5300c4aa0 2023-12-13T22:55:32.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa535033640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa530150f50 con 0x7fa5301567d0 2023-12-13T22:55:32.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa52ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa52ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50700/0 (socket says 172.21.15.91:50700) 2023-12-13T22:55:32.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa52ed9d640 1 -- 172.21.15.91:0/1779287280 learned_addr learned my addr 172.21.15.91:0/1779287280 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:32.977 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa52f59e640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5301567d0 0x7fa5301f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.979+0000 7fa52e59c640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5300c4aa0 0x7fa53015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 -- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5301567d0 msgr2=0x7fa5301f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5301567d0 0x7fa5301f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 -- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5300c4aa0 msgr2=0x7fa53015ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5300c4aa0 0x7fa53015ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:32.980 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 -- 172.21.15.91:0/1779287280 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009b30 con 0x7fa5300c46c0 2023-12-13T22:55:32.982 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.983+0000 7fa52ed9d640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa52000e930 tx=0x7fa52000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:32.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520009690 con 0x7fa5300c46c0 2023-12-13T22:55:32.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52000ca00 con 0x7fa5300c46c0 2023-12-13T22:55:32.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52000cd70 con 0x7fa5300c46c0 2023-12-13T22:55:32.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa530151230 con 0x7fa5300c46c0 2023-12-13T22:55:32.986 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa530154ca0 con 0x7fa5300c46c0 2023-12-13T22:55:32.987 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:32.987+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5300c1590 con 0x7fa5300c46c0 2023-12-13T22:55:33.263 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.263+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa520013470 con 0x7fa5300c46c0 2023-12-13T22:55:33.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.267+0000 7fa5177fe640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 0x7fa51c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.264 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.267+0000 7fa52e59c640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 0x7fa51c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:33.265 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.267+0000 7fa52e59c640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 0x7fa51c068cb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa5300c1a20 tx=0x7fa524009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:33.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.295+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa520055be0 con 0x7fa5300c46c0 2023-12-13T22:55:33.292 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.295+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa520051f20 con 0x7fa5300c46c0 2023-12-13T22:55:33.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.459+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa530067520 con 0x7fa5300c46c0 2023-12-13T22:55:33.473 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa5177fe640 1 -- 172.21.15.91:0/1779287280 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa520021020 con 0x7fa5300c46c0 2023-12-13T22:55:33.473 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 64 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 msgr2=0x7fa51c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 0x7fa51c068cb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa5300c1a20 tx=0x7fa524009040 comp rx=0 tx=0).stop 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 msgr2=0x7fa5301554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa52000e930 tx=0x7fa52000edf0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 shutdown_connections 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa51c0667f0 0x7fa51c068cb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5301567d0 0x7fa5301f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5300c4aa0 0x7fa53015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 --2- 172.21.15.91:0/1779287280 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa5300c46c0 0x7fa5301554a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 >> 172.21.15.91:0/1779287280 conn(0x7fa53006c6a0 msgr2=0x7fa5300c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:33.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 shutdown_connections 2023-12-13T22:55:33.476 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.475+0000 7fa535033640 1 -- 172.21.15.91:0/1779287280 wait complete. 2023-12-13T22:55:33.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-13T22:55:33.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 Processor -- start 2023-12-13T22:55:33.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 -- start start 2023-12-13T22:55:33.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f8d400ce0c0 0x7f8d400ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 0x7f8d40159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400cd9a0 con 0x7f8d400cdb70 2023-12-13T22:55:33.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d400ca550 con 0x7f8d400ce0c0 2023-12-13T22:55:33.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d473bb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d400ce9e0 con 0x7f8d400cc3c0 2023-12-13T22:55:33.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.623+0000 7f8d44956640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 0x7f8d40159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:33.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.627+0000 7f8d45958640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8d400cdb70 0x7f8d4015cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:55908/0 (socket says 172.21.15.91:55908) 2023-12-13T22:55:33.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.627+0000 7f8d45958640 1 -- 172.21.15.91:0/699415783 learned_addr learned my addr 172.21.15.91:0/699415783 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:33.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.631+0000 7f8d44956640 1 -- 172.21.15.91:0/699415783 >> v2:172.21.15.91:3300/0 conn(0x7f8d400ce0c0 msgr2=0x7f8d400ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:33.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.631+0000 7f8d44956640 1 --2- 172.21.15.91:0/699415783 >> v2:172.21.15.91:3300/0 conn(0x7f8d400ce0c0 0x7f8d400ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.631+0000 7f8d44956640 1 -- 172.21.15.91:0/699415783 >> v1:172.21.15.152:6789/0 conn(0x7f8d400cdb70 legacy=0x7f8d4015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.631+0000 7f8d44956640 1 -- 172.21.15.91:0/699415783 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d401596c0 con 0x7f8d400cc3c0 2023-12-13T22:55:33.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.639+0000 7f8d44956640 1 --2- 172.21.15.91:0/699415783 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 0x7f8d40159b70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d340097c0 tx=0x7f8d3401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade1956e32af3b58 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:33.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d33fff640 1 -- 172.21.15.91:0/699415783 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340ab680 con 0x7f8d400cc3c0 2023-12-13T22:55:33.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d33fff640 1 -- 172.21.15.91:0/699415783 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d340ab7e0 con 0x7f8d400cc3c0 2023-12-13T22:55:33.647 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d33fff640 1 -- 172.21.15.91:0/699415783 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340abb70 con 0x7f8d400cc3c0 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 -- 172.21.15.91:0/699415783 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 msgr2=0x7f8d40159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 --2- 172.21.15.91:0/699415783 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 0x7f8d40159b70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8d340097c0 tx=0x7f8d3401c480 comp rx=0 tx=0).stop 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 -- 172.21.15.91:0/699415783 shutdown_connections 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 --2- 172.21.15.91:0/699415783 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400cc3c0 0x7f8d40159b70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 --2- 172.21.15.91:0/699415783 >> v2:172.21.15.91:3300/0 conn(0x7f8d400ce0c0 0x7f8d400ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.647+0000 7f8d473bb640 1 -- 172.21.15.91:0/699415783 >> 172.21.15.91:0/699415783 conn(0x7f8d400b07c0 msgr2=0x7f8d400b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- 172.21.15.91:0/699415783 shutdown_connections 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- 172.21.15.91:0/699415783 wait complete. 2023-12-13T22:55:33.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 Processor -- start 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- start start 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d400cc3c0 0x7f8d401f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400ce0c0 0x7f8d40148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4015b3d0 con 0x7f8d400cc3c0 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d401f2ce0 con 0x7f8d400cdb70 2023-12-13T22:55:33.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.651+0000 7f8d473bb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4015be20 con 0x7f8d400ce0c0 2023-12-13T22:55:33.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.655+0000 7f8d44956640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:33.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.655+0000 7f8d44956640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:42822/0 (socket says 172.21.15.91:42822) 2023-12-13T22:55:33.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.655+0000 7f8d44956640 1 -- 172.21.15.91:0/144203954 learned_addr learned my addr 172.21.15.91:0/144203954 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:33.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.655+0000 7f8d45958640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400ce0c0 0x7f8d40148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:33.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.663+0000 7f8d44956640 1 -- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400ce0c0 msgr2=0x7f8d40148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.663+0000 7f8d44956640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400ce0c0 0x7f8d40148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.663+0000 7f8d44956640 1 -- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d400cc3c0 msgr2=0x7f8d401f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:33.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.663+0000 7f8d44956640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d400cc3c0 0x7f8d401f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:33.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.663+0000 7f8d44956640 1 -- 172.21.15.91:0/144203954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009420 con 0x7f8d400cdb70 2023-12-13T22:55:33.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.675+0000 7f8d44956640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d340ad040 tx=0x7f8d3401acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:33.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.683+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b58d0 con 0x7f8d400cdb70 2023-12-13T22:55:33.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.683+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d340b5a50 con 0x7f8d400cdb70 2023-12-13T22:55:33.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.683+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340b5e00 con 0x7f8d400cdb70 2023-12-13T22:55:33.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.683+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4015a890 con 0x7f8d400cdb70 2023-12-13T22:55:33.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.683+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d401f2690 con 0x7f8d400cdb70 2023-12-13T22:55:33.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.687+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d40067520 con 0x7f8d400cdb70 2023-12-13T22:55:33.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.743+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8d340c83f0 con 0x7f8d400cdb70 2023-12-13T22:55:33.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.743+0000 7f8d31ffb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 0x7f8d24068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:33.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.743+0000 7f8d45157640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 0x7f8d24068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:33.740 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:33.743+0000 7f8d45157640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 0x7f8d24068d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009690 tx=0x7f8d3c006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:34.042 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.047+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d340f0650 con 0x7f8d400cdb70 2023-12-13T22:55:34.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.075+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8d340ec990 con 0x7f8d400cdb70 2023-12-13T22:55:34.234 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.235+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d400b1570 con 0x7f8d400cdb70 2023-12-13T22:55:34.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.331+0000 7f8d31ffb640 1 -- 172.21.15.91:0/144203954 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d340effb0 con 0x7f8d400cdb70 2023-12-13T22:55:34.329 INFO:teuthology.orchestra.run.smithi091.stdout:pg_num: 32 2023-12-13T22:55:34.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 msgr2=0x7f8d24068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 0x7f8d24068d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009690 tx=0x7f8d3c006c00 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 msgr2=0x7f8d40146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d340ad040 tx=0x7f8d3401acc0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 shutdown_connections 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8d24066840 0x7f8d24068d00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8d400ce0c0 0x7f8d40148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d400cdb70 0x7f8d40146c40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 --2- 172.21.15.91:0/144203954 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f8d400cc3c0 0x7f8d401f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 >> 172.21.15.91:0/144203954 conn(0x7f8d400b07c0 msgr2=0x7f8d400735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 shutdown_connections 2023-12-13T22:55:34.333 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.335+0000 7f8d473bb640 1 -- 172.21.15.91:0/144203954 wait complete. 2023-12-13T22:55:34.357 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-13T22:55:34.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 Processor -- start 2023-12-13T22:55:34.481 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 -- start start 2023-12-13T22:55:34.482 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0778070290 0x7f0778151230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07781575c0 con 0x7f07780c8ca0 2023-12-13T22:55:34.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07781578a0 con 0x7f0778070290 2023-12-13T22:55:34.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077f10e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0778157b80 con 0x7f07780c88c0 2023-12-13T22:55:34.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f0777fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0778070290 0x7f0778151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:34.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.483+0000 7f077ceaa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:34.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.487+0000 7f0777fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0778070290 0x7f0778151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:42836/0 (socket says 172.21.15.91:42836) 2023-12-13T22:55:34.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.487+0000 7f0777fff640 1 -- 172.21.15.91:0/2933060968 learned_addr learned my addr 172.21.15.91:0/2933060968 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.491+0000 7f0777fff640 1 -- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 msgr2=0x7f07780c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:34.490 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.491+0000 7f0777fff640 1 --2- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.491+0000 7f0777fff640 1 -- 172.21.15.91:0/2933060968 >> v1:172.21.15.152:6789/0 conn(0x7f07780c8ca0 legacy=0x7f077806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:34.491 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.491+0000 7f0777fff640 1 -- 172.21.15.91:0/2933060968 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778157e60 con 0x7f0778070290 2023-12-13T22:55:34.501 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.503+0000 7f0777fff640 1 --2- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f0778151230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f07680098a0 tx=0x7f076801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c19a3be0633c45d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:34.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f07777fe640 1 -- 172.21.15.91:0/2933060968 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680ac410 con 0x7f0778070290 2023-12-13T22:55:34.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f07777fe640 1 -- 172.21.15.91:0/2933060968 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07680ac570 con 0x7f0778070290 2023-12-13T22:55:34.513 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f07777fe640 1 -- 172.21.15.91:0/2933060968 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680ac900 con 0x7f0778070290 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 msgr2=0x7f0778151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 --2- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f0778151230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f07680098a0 tx=0x7f076801c4e0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- 172.21.15.91:0/2933060968 shutdown_connections 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 --2- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f0778151230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 --2- 172.21.15.91:0/2933060968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- 172.21.15.91:0/2933060968 >> 172.21.15.91:0/2933060968 conn(0x7f0778070900 msgr2=0x7f0778070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- 172.21.15.91:0/2933060968 shutdown_connections 2023-12-13T22:55:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- 172.21.15.91:0/2933060968 wait complete. 2023-12-13T22:55:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 Processor -- start 2023-12-13T22:55:34.515 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.515+0000 7f077f10e640 1 -- start start 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f077813d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778143300 con 0x7f07780c8ca0 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077813dec0 con 0x7f0778070290 2023-12-13T22:55:34.516 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077f10e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780af050 con 0x7f07780c88c0 2023-12-13T22:55:34.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077d6ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:34.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077d6ab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50726/0 (socket says 172.21.15.91:50726) 2023-12-13T22:55:34.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f077d6ab640 1 -- 172.21.15.91:0/37126558 learned_addr learned my addr 172.21.15.91:0/37126558 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:34.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.519+0000 7f0777fff640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 -- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 msgr2=0x7f07780c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 -- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 msgr2=0x7f077813d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f077813d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:34.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 -- 172.21.15.91:0/37126558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680094d0 con 0x7f07780c8ca0 2023-12-13T22:55:34.523 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.523+0000 7f077d6ab640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f077000b930 tx=0x7f077000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000cb20 con 0x7f07780c8ca0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000ccc0 con 0x7f07780c8ca0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778142d60 con 0x7f07780c8ca0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770014680 con 0x7f07780c8ca0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780ae720 con 0x7f07780c8ca0 2023-12-13T22:55:34.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.531+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778073e70 con 0x7f07780c8ca0 2023-12-13T22:55:34.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.551+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f07700147e0 con 0x7f07780c8ca0 2023-12-13T22:55:34.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.551+0000 7f07757fa640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 0x7f0758068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:34.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.551+0000 7f077ceaa640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 0x7f0758068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:34.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.551+0000 7f077ceaa640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 0x7f0758068d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0760006aa0 tx=0x7f0760006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:34.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.551+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f077000ce30 con 0x7f07780c8ca0 2023-12-13T22:55:34.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.815+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0770051a60 con 0x7f07780c8ca0 2023-12-13T22:55:34.991 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.991+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07780b1700 con 0x7f07780c8ca0 2023-12-13T22:55:34.997 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f07757fa640 1 -- 172.21.15.91:0/37126558 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0770023080 con 0x7f07780c8ca0 2023-12-13T22:55:34.998 INFO:teuthology.orchestra.run.smithi091.stderr:listed 0 entries 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 msgr2=0x7f0758068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 0x7f0758068d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0760006aa0 tx=0x7f0760006a30 comp rx=0 tx=0).stop 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 msgr2=0x7f07780c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f077000b930 tx=0x7f077000bdf0 comp rx=0 tx=0).stop 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 shutdown_connections 2023-12-13T22:55:35.000 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0758066840 0x7f0758068d00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f07780c8ca0 0x7f07780c9630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07780c88c0 0x7f07780c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 --2- 172.21.15.91:0/37126558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0778070290 0x7f077813d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:34.999+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 >> 172.21.15.91:0/37126558 conn(0x7f0778070900 msgr2=0x7f07780b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:35.003+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 shutdown_connections 2023-12-13T22:55:35.001 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:35.003+0000 7f077f10e640 1 -- 172.21.15.91:0/37126558 wait complete. 2023-12-13T22:55:35.017 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi091.front.sepia.ceph.com... 2023-12-13T22:55:35.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:55:35.017 DEBUG:teuthology.orchestra.run.smithi091:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-13T22:55:35.027 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:55:35.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:ceph-fuse[46534]: fuse finished with error 0 and tester_r 0 2023-12-13T22:55:35.761 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:55:35.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:55:36.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:==00:00:28:29.347 46534== 2023-12-13T22:55:36.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:==00:00:28:29.347 46534== Exit program on first error (--exit-on-first-error=yes) 2023-12-13T22:55:36.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi091.stderr:daemon-helper: command failed with exit status 42 2023-12-13T22:55:41.129 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-13T22:55:41.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:55:41.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:55:41.130 DEBUG:teuthology.orchestra.run.smithi091:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-13T22:55:41.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:55:41.137 DEBUG:teuthology.orchestra.run.smithi091:> ip netns list 2023-12-13T22:55:41.185 INFO:teuthology.orchestra.run.smithi091.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-13T22:55:41.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:55:41.186 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-13T22:55:41.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-13T22:55:41.242 DEBUG:teuthology.orchestra.run.smithi091:> sudo ip link delete ceph-brx 2023-12-13T22:55:41.409 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-13T22:55:41.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-13T22:55:41.420 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:55:41.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 Processor -- start 2023-12-13T22:55:41.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 -- start start 2023-12-13T22:55:41.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f079c1505a0 0x7f079c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:41.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c0c72b0 con 0x7f079c0c4630 2023-12-13T22:55:41.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c15a100 con 0x7f079c0c4a10 2023-12-13T22:55:41.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f07a225a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0c4f40 con 0x7f079c1505a0 2023-12-13T22:55:41.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f079bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f079c1505a0 0x7f079c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:41.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f079bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f079c1505a0 0x7f079c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57124/0 (socket says 172.21.15.91:57124) 2023-12-13T22:55:41.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.547+0000 7f079bfff640 1 -- 172.21.15.91:0/2152249479 learned_addr learned my addr 172.21.15.91:0/2152249479 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:41.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.551+0000 7f079bfff640 1 -- 172.21.15.91:0/2152249479 >> v1:172.21.15.152:6789/0 conn(0x7f079c0c4a10 legacy=0x7f079c14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:41.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.551+0000 7f079bfff640 1 -- 172.21.15.91:0/2152249479 >> v1:172.21.15.91:6789/0 conn(0x7f079c0c4630 legacy=0x7f079c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:41.551 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.551+0000 7f079bfff640 1 -- 172.21.15.91:0/2152249479 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c15a3e0 con 0x7f079c1505a0 2023-12-13T22:55:41.556 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.559+0000 7f079bfff640 1 --2- 172.21.15.91:0/2152249479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c1505a0 0x7f079c0c6d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f079400d150 tx=0x7f0794021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb0c7e5958c38b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:41.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f079a7fc640 1 -- 172.21.15.91:0/2152249479 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400b2d0 con 0x7f079c1505a0 2023-12-13T22:55:41.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f079a7fc640 1 -- 172.21.15.91:0/2152249479 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07940ad050 con 0x7f079c1505a0 2023-12-13T22:55:41.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f079a7fc640 1 -- 172.21.15.91:0/2152249479 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794009820 con 0x7f079c1505a0 2023-12-13T22:55:41.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- 172.21.15.91:0/2152249479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c1505a0 msgr2=0x7f079c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:41.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 --2- 172.21.15.91:0/2152249479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c1505a0 0x7f079c0c6d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f079400d150 tx=0x7f0794021400 comp rx=0 tx=0).stop 2023-12-13T22:55:41.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- 172.21.15.91:0/2152249479 shutdown_connections 2023-12-13T22:55:41.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 --2- 172.21.15.91:0/2152249479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c1505a0 0x7f079c0c6d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:41.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- 172.21.15.91:0/2152249479 >> 172.21.15.91:0/2152249479 conn(0x7f079c06c6a0 msgr2=0x7f079c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:41.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- 172.21.15.91:0/2152249479 shutdown_connections 2023-12-13T22:55:41.654 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- 172.21.15.91:0/2152249479 wait complete. 2023-12-13T22:55:41.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 Processor -- start 2023-12-13T22:55:41.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.655+0000 7f07a225a640 1 -- start start 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f079c0c4a10 0x7f079c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f079c1505a0 0x7f079c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c154040 con 0x7f079c0c4630 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1eeea0 con 0x7f079c1505a0 2023-12-13T22:55:41.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f07a225a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1ef140 con 0x7f079c0c4a10 2023-12-13T22:55:41.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.659+0000 7f079b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:41.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57126/0 (socket says 172.21.15.91:57126) 2023-12-13T22:55:41.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 -- 172.21.15.91:0/956516905 learned_addr learned my addr 172.21.15.91:0/956516905 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:41.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 -- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f079c0c4a10 msgr2=0x7f079c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:41.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f079c0c4a10 0x7f079c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:41.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 -- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f079c1505a0 msgr2=0x7f079c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:41.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f079c1505a0 0x7f079c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:41.664 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.663+0000 7f079b7fe640 1 -- 172.21.15.91:0/956516905 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079400bd40 con 0x7f079c0c4630 2023-12-13T22:55:41.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.667+0000 7f079b7fe640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c500 tx=0x7f078c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:41.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.671+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c005220 con 0x7f079c0c4630 2023-12-13T22:55:41.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.671+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c005380 con 0x7f079c0c4630 2023-12-13T22:55:41.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.671+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c007270 con 0x7f079c0c4630 2023-12-13T22:55:41.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.671+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c1ef420 con 0x7f079c0c4630 2023-12-13T22:55:41.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.671+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c1ef9e0 con 0x7f079c0c4630 2023-12-13T22:55:41.672 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.675+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c154180 con 0x7f079c0c4630 2023-12-13T22:55:41.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.703+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f078c0073d0 con 0x7f079c0c4630 2023-12-13T22:55:41.700 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.703+0000 7f0783fff640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 0x7f0788068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:41.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.703+0000 7f079affd640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 0x7f0788068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:41.701 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.703+0000 7f079affd640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 0x7f0788068d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0790000f70 tx=0x7f07900079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:41.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.707+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f078c007680 con 0x7f079c0c4630 2023-12-13T22:55:41.978 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:41.979+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f078c051ae0 con 0x7f079c0c4630 2023-12-13T22:55:42.143 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.143+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f079c1568a0 con 0x7f0788066840 2023-12-13T22:55:42.171 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.171+0000 7f0783fff640 1 -- 172.21.15.91:0/956516905 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368860 (secure 0 0 0) 0x7f0790005080 con 0x7f0788066840 2023-12-13T22:55:42.176 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:42.178 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:55:42.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.175+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 msgr2=0x7f0788068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.175+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 0x7f0788068d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0790000f70 tx=0x7f07900079e0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.175+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 msgr2=0x7f079c073840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.175+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c500 tx=0x7f078c00c9c0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 shutdown_connections 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f0788066840 0x7f0788068d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f079c1505a0 0x7f079c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f079c0c4a10 0x7f079c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 --2- 172.21.15.91:0/956516905 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f079c0c4630 0x7f079c073840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 >> 172.21.15.91:0/956516905 conn(0x7f079c06c6a0 msgr2=0x7f079c148100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 shutdown_connections 2023-12-13T22:55:42.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.179+0000 7f07a225a640 1 -- 172.21.15.91:0/956516905 wait complete. 2023-12-13T22:55:42.194 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":941,"stamp":"2023-12-13T22:55:41.346937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13422,"ondisk_log_size":13422,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10974,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":22,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005013"},"pg_stats":[{"pgid":"2.1f","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.805619+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:55:09.805619+0000","last_peered":"2023-12-13T22:55:09.805619+0000","last_clean":"2023-12-13T22:55:09.805619+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:09.805619+0000","last_undegraded":"2023-12-13T22:55:09.805619+0000","last_fullsized":"2023-12-13T22:55:09.805619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.688943+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:55:35.688943+0000","last_peered":"2023-12-13T22:55:35.688943+0000","last_clean":"2023-12-13T22:55:35.688943+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:35.688943+0000","last_undegraded":"2023-12-13T22:55:35.688943+0000","last_fullsized":"2023-12-13T22:55:35.688943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.696675+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:54:15.696675+0000","last_peered":"2023-12-13T22:54:15.696675+0000","last_clean":"2023-12-13T22:54:15.696675+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:54:15.696675+0000","last_undegraded":"2023-12-13T22:54:15.696675+0000","last_fullsized":"2023-12-13T22:54:15.696675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.112249+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:55:35.112249+0000","last_peered":"2023-12-13T22:55:35.112249+0000","last_clean":"2023-12-13T22:55:35.112249+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:55:35.112249+0000","last_undegraded":"2023-12-13T22:55:35.112249+0000","last_fullsized":"2023-12-13T22:55:35.112249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579225+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:55:35.579225+0000","last_peered":"2023-12-13T22:55:35.579225+0000","last_clean":"2023-12-13T22:55:35.579225+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:35.579225+0000","last_undegraded":"2023-12-13T22:55:35.579225+0000","last_fullsized":"2023-12-13T22:55:35.579225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.333132+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:54:24.333132+0000","last_peered":"2023-12-13T22:54:24.333132+0000","last_clean":"2023-12-13T22:54:24.333132+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:54:24.333132+0000","last_undegraded":"2023-12-13T22:54:24.333132+0000","last_fullsized":"2023-12-13T22:54:24.333132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'12","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.221109+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:55:13.221109+0000","last_peered":"2023-12-13T22:55:13.221109+0000","last_clean":"2023-12-13T22:55:13.221109+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:55:13.221109+0000","last_undegraded":"2023-12-13T22:55:13.221109+0000","last_fullsized":"2023-12-13T22:55:13.221109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631543+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:55:35.631543+0000","last_peered":"2023-12-13T22:55:35.631543+0000","last_clean":"2023-12-13T22:55:35.631543+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:55:35.631543+0000","last_undegraded":"2023-12-13T22:55:35.631543+0000","last_fullsized":"2023-12-13T22:55:35.631543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:06.394820+0000","last_change":"2023-12-13T22:27:03.108442+0000","last_active":"2023-12-13T22:54:06.394820+0000","last_peered":"2023-12-13T22:54:06.394820+0000","last_clean":"2023-12-13T22:54:06.394820+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:54:06.394820+0000","last_undegraded":"2023-12-13T22:54:06.394820+0000","last_fullsized":"2023-12-13T22:54:06.394820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:43.918776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.539803+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:54:58.539803+0000","last_peered":"2023-12-13T22:54:58.539803+0000","last_clean":"2023-12-13T22:54:58.539803+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:54:58.539803+0000","last_undegraded":"2023-12-13T22:54:58.539803+0000","last_fullsized":"2023-12-13T22:54:58.539803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638381+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:55:35.638381+0000","last_peered":"2023-12-13T22:55:35.638381+0000","last_clean":"2023-12-13T22:55:35.638381+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:55:35.638381+0000","last_undegraded":"2023-12-13T22:55:35.638381+0000","last_fullsized":"2023-12-13T22:55:35.638381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.679608+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:54:15.679608+0000","last_peered":"2023-12-13T22:54:15.679608+0000","last_clean":"2023-12-13T22:54:15.679608+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:54:15.679608+0000","last_undegraded":"2023-12-13T22:54:15.679608+0000","last_fullsized":"2023-12-13T22:54:15.679608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624367+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:55:35.624367+0000","last_peered":"2023-12-13T22:55:35.624367+0000","last_clean":"2023-12-13T22:55:35.624367+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:55:35.624367+0000","last_undegraded":"2023-12-13T22:55:35.624367+0000","last_fullsized":"2023-12-13T22:55:35.624367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'671","reported_seq":705,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.116962+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:55:35.116962+0000","last_peered":"2023-12-13T22:55:35.116962+0000","last_clean":"2023-12-13T22:55:35.116962+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:55:35.116962+0000","last_undegraded":"2023-12-13T22:55:35.116962+0000","last_fullsized":"2023-12-13T22:55:35.116962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.953445+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:54:15.953445+0000","last_peered":"2023-12-13T22:54:15.953445+0000","last_clean":"2023-12-13T22:54:15.953445+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:54:15.953445+0000","last_undegraded":"2023-12-13T22:54:15.953445+0000","last_fullsized":"2023-12-13T22:54:15.953445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.697096+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:55:35.697096+0000","last_peered":"2023-12-13T22:55:35.697096+0000","last_clean":"2023-12-13T22:55:35.697096+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:55:35.697096+0000","last_undegraded":"2023-12-13T22:55:35.697096+0000","last_fullsized":"2023-12-13T22:55:35.697096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'230","reported_seq":264,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.535151+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:55:13.535151+0000","last_peered":"2023-12-13T22:55:13.535151+0000","last_clean":"2023-12-13T22:55:13.535151+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:13.535151+0000","last_undegraded":"2023-12-13T22:55:13.535151+0000","last_fullsized":"2023-12-13T22:55:13.535151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:16.899782+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:54:16.899782+0000","last_peered":"2023-12-13T22:54:16.899782+0000","last_clean":"2023-12-13T22:54:16.899782+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:54:16.899782+0000","last_undegraded":"2023-12-13T22:54:16.899782+0000","last_fullsized":"2023-12-13T22:54:16.899782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698820+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:55:35.698820+0000","last_peered":"2023-12-13T22:55:35.698820+0000","last_clean":"2023-12-13T22:55:35.698820+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:55:35.698820+0000","last_undegraded":"2023-12-13T22:55:35.698820+0000","last_fullsized":"2023-12-13T22:55:35.698820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'165","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.241562+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:55:13.241562+0000","last_peered":"2023-12-13T22:55:13.241562+0000","last_clean":"2023-12-13T22:55:13.241562+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:55:13.241562+0000","last_undegraded":"2023-12-13T22:55:13.241562+0000","last_fullsized":"2023-12-13T22:55:13.241562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.078027+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:54:15.078027+0000","last_peered":"2023-12-13T22:54:15.078027+0000","last_clean":"2023-12-13T22:54:15.078027+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:54:15.078027+0000","last_undegraded":"2023-12-13T22:54:15.078027+0000","last_fullsized":"2023-12-13T22:54:15.078027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.457436+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:55:35.457436+0000","last_peered":"2023-12-13T22:55:35.457436+0000","last_clean":"2023-12-13T22:55:35.457436+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:35.457436+0000","last_undegraded":"2023-12-13T22:55:35.457436+0000","last_fullsized":"2023-12-13T22:55:35.457436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.867630+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:55:09.867630+0000","last_peered":"2023-12-13T22:55:09.867630+0000","last_clean":"2023-12-13T22:55:09.867630+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:09.867630+0000","last_undegraded":"2023-12-13T22:55:09.867630+0000","last_fullsized":"2023-12-13T22:55:09.867630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.389221+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:54:24.389221+0000","last_peered":"2023-12-13T22:54:24.389221+0000","last_clean":"2023-12-13T22:54:24.389221+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:54:24.389221+0000","last_undegraded":"2023-12-13T22:54:24.389221+0000","last_fullsized":"2023-12-13T22:54:24.389221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555941+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:55:35.555941+0000","last_peered":"2023-12-13T22:55:35.555941+0000","last_clean":"2023-12-13T22:55:35.555941+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:35.555941+0000","last_undegraded":"2023-12-13T22:55:35.555941+0000","last_fullsized":"2023-12-13T22:55:35.555941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.637577+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:55:12.637577+0000","last_peered":"2023-12-13T22:55:12.637577+0000","last_clean":"2023-12-13T22:55:12.637577+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:12.637577+0000","last_undegraded":"2023-12-13T22:55:12.637577+0000","last_fullsized":"2023-12-13T22:55:12.637577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.399554+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:54:24.399554+0000","last_peered":"2023-12-13T22:54:24.399554+0000","last_clean":"2023-12-13T22:54:24.399554+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:54:24.399554+0000","last_undegraded":"2023-12-13T22:54:24.399554+0000","last_fullsized":"2023-12-13T22:54:24.399554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694184+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:55:35.694184+0000","last_peered":"2023-12-13T22:55:35.694184+0000","last_clean":"2023-12-13T22:55:35.694184+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:55:35.694184+0000","last_undegraded":"2023-12-13T22:55:35.694184+0000","last_fullsized":"2023-12-13T22:55:35.694184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'188","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:29.793234+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:55:29.793234+0000","last_peered":"2023-12-13T22:55:29.793234+0000","last_clean":"2023-12-13T22:55:29.793234+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:55:29.793234+0000","last_undegraded":"2023-12-13T22:55:29.793234+0000","last_fullsized":"2023-12-13T22:55:29.793234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.864556+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:54:12.864556+0000","last_peered":"2023-12-13T22:54:12.864556+0000","last_clean":"2023-12-13T22:54:12.864556+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:54:12.864556+0000","last_undegraded":"2023-12-13T22:54:12.864556+0000","last_fullsized":"2023-12-13T22:54:12.864556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501731+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:55:35.501731+0000","last_peered":"2023-12-13T22:55:35.501731+0000","last_clean":"2023-12-13T22:55:35.501731+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:55:35.501731+0000","last_undegraded":"2023-12-13T22:55:35.501731+0000","last_fullsized":"2023-12-13T22:55:35.501731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:31.335556+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:54:31.335556+0000","last_peered":"2023-12-13T22:54:31.335556+0000","last_clean":"2023-12-13T22:54:31.335556+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:54:31.335556+0000","last_undegraded":"2023-12-13T22:54:31.335556+0000","last_fullsized":"2023-12-13T22:54:31.335556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.279383+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:54:24.279383+0000","last_peered":"2023-12-13T22:54:24.279383+0000","last_clean":"2023-12-13T22:54:24.279383+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:54:24.279383+0000","last_undegraded":"2023-12-13T22:54:24.279383+0000","last_fullsized":"2023-12-13T22:54:24.279383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638034+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:55:35.638034+0000","last_peered":"2023-12-13T22:55:35.638034+0000","last_clean":"2023-12-13T22:55:35.638034+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:55:35.638034+0000","last_undegraded":"2023-12-13T22:55:35.638034+0000","last_fullsized":"2023-12-13T22:55:35.638034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.641222+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:55:18.641222+0000","last_peered":"2023-12-13T22:55:18.641222+0000","last_clean":"2023-12-13T22:55:18.641222+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:55:18.641222+0000","last_undegraded":"2023-12-13T22:55:18.641222+0000","last_fullsized":"2023-12-13T22:55:18.641222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.467825+0000","last_change":"2023-12-13T22:27:03.566251+0000","last_active":"2023-12-13T22:54:09.467825+0000","last_peered":"2023-12-13T22:54:09.467825+0000","last_clean":"2023-12-13T22:54:09.467825+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:54:09.467825+0000","last_undegraded":"2023-12-13T22:54:09.467825+0000","last_fullsized":"2023-12-13T22:54:09.467825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596787+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:55:35.596787+0000","last_peered":"2023-12-13T22:55:35.596787+0000","last_clean":"2023-12-13T22:55:35.596787+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:35.596787+0000","last_undegraded":"2023-12-13T22:55:35.596787+0000","last_fullsized":"2023-12-13T22:55:35.596787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.064015+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:55:08.064015+0000","last_peered":"2023-12-13T22:55:08.064015+0000","last_clean":"2023-12-13T22:55:08.064015+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:08.064015+0000","last_undegraded":"2023-12-13T22:55:08.064015+0000","last_fullsized":"2023-12-13T22:55:08.064015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.871697+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:54:12.871697+0000","last_peered":"2023-12-13T22:54:12.871697+0000","last_clean":"2023-12-13T22:54:12.871697+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:54:12.871697+0000","last_undegraded":"2023-12-13T22:54:12.871697+0000","last_fullsized":"2023-12-13T22:54:12.871697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501224+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:55:35.501224+0000","last_peered":"2023-12-13T22:55:35.501224+0000","last_clean":"2023-12-13T22:55:35.501224+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:55:35.501224+0000","last_undegraded":"2023-12-13T22:55:35.501224+0000","last_fullsized":"2023-12-13T22:55:35.501224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'252","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.009575+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:55:32.009575+0000","last_peered":"2023-12-13T22:55:32.009575+0000","last_clean":"2023-12-13T22:55:32.009575+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:32.009575+0000","last_undegraded":"2023-12-13T22:55:32.009575+0000","last_fullsized":"2023-12-13T22:55:32.009575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721359+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:54:14.721359+0000","last_peered":"2023-12-13T22:54:14.721359+0000","last_clean":"2023-12-13T22:54:14.721359+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:54:14.721359+0000","last_undegraded":"2023-12-13T22:54:14.721359+0000","last_fullsized":"2023-12-13T22:54:14.721359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.567799+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:55:35.567799+0000","last_peered":"2023-12-13T22:55:35.567799+0000","last_clean":"2023-12-13T22:55:35.567799+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:35.567799+0000","last_undegraded":"2023-12-13T22:55:35.567799+0000","last_fullsized":"2023-12-13T22:55:35.567799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.540014+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:54:58.540014+0000","last_peered":"2023-12-13T22:54:58.540014+0000","last_clean":"2023-12-13T22:54:58.540014+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:54:58.540014+0000","last_undegraded":"2023-12-13T22:54:58.540014+0000","last_fullsized":"2023-12-13T22:54:58.540014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.793578+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:54:14.793578+0000","last_peered":"2023-12-13T22:54:14.793578+0000","last_clean":"2023-12-13T22:54:14.793578+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:54:14.793578+0000","last_undegraded":"2023-12-13T22:54:14.793578+0000","last_fullsized":"2023-12-13T22:54:14.793578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.696626+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:55:35.696626+0000","last_peered":"2023-12-13T22:55:35.696626+0000","last_clean":"2023-12-13T22:55:35.696626+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:55:35.696626+0000","last_undegraded":"2023-12-13T22:55:35.696626+0000","last_fullsized":"2023-12-13T22:55:35.696626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.639382+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:55:18.639382+0000","last_peered":"2023-12-13T22:55:18.639382+0000","last_clean":"2023-12-13T22:55:18.639382+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:18.639382+0000","last_undegraded":"2023-12-13T22:55:18.639382+0000","last_fullsized":"2023-12-13T22:55:18.639382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:23.067917+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:53:23.067917+0000","last_peered":"2023-12-13T22:53:23.067917+0000","last_clean":"2023-12-13T22:53:23.067917+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:53:23.067917+0000","last_undegraded":"2023-12-13T22:53:23.067917+0000","last_fullsized":"2023-12-13T22:53:23.067917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.054977+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:54:23.054977+0000","last_peered":"2023-12-13T22:54:23.054977+0000","last_clean":"2023-12-13T22:54:23.054977+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:54:23.054977+0000","last_undegraded":"2023-12-13T22:54:23.054977+0000","last_fullsized":"2023-12-13T22:54:23.054977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629343+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:55:35.629343+0000","last_peered":"2023-12-13T22:55:35.629343+0000","last_clean":"2023-12-13T22:55:35.629343+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:55:35.629343+0000","last_undegraded":"2023-12-13T22:55:35.629343+0000","last_fullsized":"2023-12-13T22:55:35.629343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.561518+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:55:18.561518+0000","last_peered":"2023-12-13T22:55:18.561518+0000","last_clean":"2023-12-13T22:55:18.561518+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:55:18.561518+0000","last_undegraded":"2023-12-13T22:55:18.561518+0000","last_fullsized":"2023-12-13T22:55:18.561518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.943447+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:54:17.943447+0000","last_peered":"2023-12-13T22:54:17.943447+0000","last_clean":"2023-12-13T22:54:17.943447+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:54:17.943447+0000","last_undegraded":"2023-12-13T22:54:17.943447+0000","last_fullsized":"2023-12-13T22:54:17.943447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631055+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:55:35.631055+0000","last_peered":"2023-12-13T22:55:35.631055+0000","last_clean":"2023-12-13T22:55:35.631055+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:35.631055+0000","last_undegraded":"2023-12-13T22:55:35.631055+0000","last_fullsized":"2023-12-13T22:55:35.631055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'6","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:57.259703+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:54:57.259703+0000","last_peered":"2023-12-13T22:54:57.259703+0000","last_clean":"2023-12-13T22:54:57.259703+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:54:57.259703+0000","last_undegraded":"2023-12-13T22:54:57.259703+0000","last_fullsized":"2023-12-13T22:54:57.259703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.777096+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:54:08.777096+0000","last_peered":"2023-12-13T22:54:08.777096+0000","last_clean":"2023-12-13T22:54:08.777096+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:54:08.777096+0000","last_undegraded":"2023-12-13T22:54:08.777096+0000","last_fullsized":"2023-12-13T22:54:08.777096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.542756+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.542756+0000","last_peered":"2023-12-13T22:55:35.542756+0000","last_clean":"2023-12-13T22:55:35.542756+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.542756+0000","last_undegraded":"2023-12-13T22:55:35.542756+0000","last_fullsized":"2023-12-13T22:55:35.542756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:54.567074+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:54:54.567074+0000","last_peered":"2023-12-13T22:54:54.567074+0000","last_clean":"2023-12-13T22:54:54.567074+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:54:54.567074+0000","last_undegraded":"2023-12-13T22:54:54.567074+0000","last_fullsized":"2023-12-13T22:54:54.567074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.052609+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:54:18.052609+0000","last_peered":"2023-12-13T22:54:18.052609+0000","last_clean":"2023-12-13T22:54:18.052609+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:54:18.052609+0000","last_undegraded":"2023-12-13T22:54:18.052609+0000","last_fullsized":"2023-12-13T22:54:18.052609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503199+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:35.503199+0000","last_peered":"2023-12-13T22:55:35.503199+0000","last_clean":"2023-12-13T22:55:35.503199+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:35.503199+0000","last_undegraded":"2023-12-13T22:55:35.503199+0000","last_fullsized":"2023-12-13T22:55:35.503199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:55.399144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'264","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.920406+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:55:22.920406+0000","last_peered":"2023-12-13T22:55:22.920406+0000","last_clean":"2023-12-13T22:55:22.920406+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:22.920406+0000","last_undegraded":"2023-12-13T22:55:22.920406+0000","last_fullsized":"2023-12-13T22:55:22.920406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.022796+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:54:18.022796+0000","last_peered":"2023-12-13T22:54:18.022796+0000","last_clean":"2023-12-13T22:54:18.022796+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:54:18.022796+0000","last_undegraded":"2023-12-13T22:54:18.022796+0000","last_fullsized":"2023-12-13T22:54:18.022796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.533484+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:55:35.533484+0000","last_peered":"2023-12-13T22:55:35.533484+0000","last_clean":"2023-12-13T22:55:35.533484+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:35.533484+0000","last_undegraded":"2023-12-13T22:55:35.533484+0000","last_fullsized":"2023-12-13T22:55:35.533484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'260","reported_seq":293,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:25.440283+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:55:25.440283+0000","last_peered":"2023-12-13T22:55:25.440283+0000","last_clean":"2023-12-13T22:55:25.440283+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:55:25.440283+0000","last_undegraded":"2023-12-13T22:55:25.440283+0000","last_fullsized":"2023-12-13T22:55:25.440283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.030638+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:54:23.030638+0000","last_peered":"2023-12-13T22:54:23.030638+0000","last_clean":"2023-12-13T22:54:23.030638+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:54:23.030638+0000","last_undegraded":"2023-12-13T22:54:23.030638+0000","last_fullsized":"2023-12-13T22:54:23.030638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.610726+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:55:35.610726+0000","last_peered":"2023-12-13T22:55:35.610726+0000","last_clean":"2023-12-13T22:55:35.610726+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:55:35.610726+0000","last_undegraded":"2023-12-13T22:55:35.610726+0000","last_fullsized":"2023-12-13T22:55:35.610726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1019","reported_seq":1052,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:57.939384+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:53:57.939384+0000","last_peered":"2023-12-13T22:53:57.939384+0000","last_clean":"2023-12-13T22:53:57.939384+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:53:57.939384+0000","last_undegraded":"2023-12-13T22:53:57.939384+0000","last_fullsized":"2023-12-13T22:53:57.939384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.328801+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:54:24.328801+0000","last_peered":"2023-12-13T22:54:24.328801+0000","last_clean":"2023-12-13T22:54:24.328801+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:54:24.328801+0000","last_undegraded":"2023-12-13T22:54:24.328801+0000","last_fullsized":"2023-12-13T22:54:24.328801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.545966+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:55:35.545966+0000","last_peered":"2023-12-13T22:55:35.545966+0000","last_clean":"2023-12-13T22:55:35.545966+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:55:35.545966+0000","last_undegraded":"2023-12-13T22:55:35.545966+0000","last_fullsized":"2023-12-13T22:55:35.545966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:14.228671+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:55:14.228671+0000","last_peered":"2023-12-13T22:55:14.228671+0000","last_clean":"2023-12-13T22:55:14.228671+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:14.228671+0000","last_undegraded":"2023-12-13T22:55:14.228671+0000","last_fullsized":"2023-12-13T22:55:14.228671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.331661+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.331661+0000","last_peered":"2023-12-13T22:54:24.331661+0000","last_clean":"2023-12-13T22:54:24.331661+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.331661+0000","last_undegraded":"2023-12-13T22:54:24.331661+0000","last_fullsized":"2023-12-13T22:54:24.331661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:06:15.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.554959+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:55:35.554959+0000","last_peered":"2023-12-13T22:55:35.554959+0000","last_clean":"2023-12-13T22:55:35.554959+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:35.554959+0000","last_undegraded":"2023-12-13T22:55:35.554959+0000","last_fullsized":"2023-12-13T22:55:35.554959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:47.245339+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:54:47.245339+0000","last_peered":"2023-12-13T22:54:47.245339+0000","last_clean":"2023-12-13T22:54:47.245339+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:54:47.245339+0000","last_undegraded":"2023-12-13T22:54:47.245339+0000","last_fullsized":"2023-12-13T22:54:47.245339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.332888+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:54:24.332888+0000","last_peered":"2023-12-13T22:54:24.332888+0000","last_clean":"2023-12-13T22:54:24.332888+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:54:24.332888+0000","last_undegraded":"2023-12-13T22:54:24.332888+0000","last_fullsized":"2023-12-13T22:54:24.332888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.544167+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:55:35.544167+0000","last_peered":"2023-12-13T22:55:35.544167+0000","last_clean":"2023-12-13T22:55:35.544167+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:55:35.544167+0000","last_undegraded":"2023-12-13T22:55:35.544167+0000","last_fullsized":"2023-12-13T22:55:35.544167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1182","reported_seq":1215,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.639368+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:55:22.639368+0000","last_peered":"2023-12-13T22:55:22.639368+0000","last_clean":"2023-12-13T22:55:22.639368+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:22.639368+0000","last_undegraded":"2023-12-13T22:55:22.639368+0000","last_fullsized":"2023-12-13T22:55:22.639368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.912710+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:54:15.912710+0000","last_peered":"2023-12-13T22:54:15.912710+0000","last_clean":"2023-12-13T22:54:15.912710+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:54:15.912710+0000","last_undegraded":"2023-12-13T22:54:15.912710+0000","last_fullsized":"2023-12-13T22:54:15.912710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.598358+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:55:35.598358+0000","last_peered":"2023-12-13T22:55:35.598358+0000","last_clean":"2023-12-13T22:55:35.598358+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:35.598358+0000","last_undegraded":"2023-12-13T22:55:35.598358+0000","last_fullsized":"2023-12-13T22:55:35.598358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'128","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:26.942676+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:55:26.942676+0000","last_peered":"2023-12-13T22:55:26.942676+0000","last_clean":"2023-12-13T22:55:26.942676+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:26.942676+0000","last_undegraded":"2023-12-13T22:55:26.942676+0000","last_fullsized":"2023-12-13T22:55:26.942676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.050642+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:54:23.050642+0000","last_peered":"2023-12-13T22:54:23.050642+0000","last_clean":"2023-12-13T22:54:23.050642+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:54:23.050642+0000","last_undegraded":"2023-12-13T22:54:23.050642+0000","last_fullsized":"2023-12-13T22:54:23.050642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579291+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:55:35.579291+0000","last_peered":"2023-12-13T22:55:35.579291+0000","last_clean":"2023-12-13T22:55:35.579291+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:55:35.579291+0000","last_undegraded":"2023-12-13T22:55:35.579291+0000","last_fullsized":"2023-12-13T22:55:35.579291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:23.361395+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:55:23.361395+0000","last_peered":"2023-12-13T22:55:23.361395+0000","last_clean":"2023-12-13T22:55:23.361395+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:23.361395+0000","last_undegraded":"2023-12-13T22:55:23.361395+0000","last_fullsized":"2023-12-13T22:55:23.361395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.142382+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:54:12.142382+0000","last_peered":"2023-12-13T22:54:12.142382+0000","last_clean":"2023-12-13T22:54:12.142382+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:54:12.142382+0000","last_undegraded":"2023-12-13T22:54:12.142382+0000","last_fullsized":"2023-12-13T22:54:12.142382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.584248+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:55:35.584248+0000","last_peered":"2023-12-13T22:55:35.584248+0000","last_clean":"2023-12-13T22:55:35.584248+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:55:35.584248+0000","last_undegraded":"2023-12-13T22:55:35.584248+0000","last_fullsized":"2023-12-13T22:55:35.584248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'90","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.672608+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:55:18.672608+0000","last_peered":"2023-12-13T22:55:18.672608+0000","last_clean":"2023-12-13T22:55:18.672608+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:55:18.672608+0000","last_undegraded":"2023-12-13T22:55:18.672608+0000","last_fullsized":"2023-12-13T22:55:18.672608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721120+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:54:14.721120+0000","last_peered":"2023-12-13T22:54:14.721120+0000","last_clean":"2023-12-13T22:54:14.721120+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:54:14.721120+0000","last_undegraded":"2023-12-13T22:54:14.721120+0000","last_fullsized":"2023-12-13T22:54:14.721120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.792380+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:54:09.792380+0000","last_peered":"2023-12-13T22:54:09.792380+0000","last_clean":"2023-12-13T22:54:09.792380+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:54:09.792380+0000","last_undegraded":"2023-12-13T22:54:09.792380+0000","last_fullsized":"2023-12-13T22:54:09.792380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501460+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:55:35.501460+0000","last_peered":"2023-12-13T22:55:35.501460+0000","last_clean":"2023-12-13T22:55:35.501460+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:35.501460+0000","last_undegraded":"2023-12-13T22:55:35.501460+0000","last_fullsized":"2023-12-13T22:55:35.501460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.837794+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:54:58.837794+0000","last_peered":"2023-12-13T22:54:58.837794+0000","last_clean":"2023-12-13T22:54:58.837794+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:54:58.837794+0000","last_undegraded":"2023-12-13T22:54:58.837794+0000","last_fullsized":"2023-12-13T22:54:58.837794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.771593+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:54:08.771593+0000","last_peered":"2023-12-13T22:54:08.771593+0000","last_clean":"2023-12-13T22:54:08.771593+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:54:08.771593+0000","last_undegraded":"2023-12-13T22:54:08.771593+0000","last_fullsized":"2023-12-13T22:54:08.771593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694904+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:55:35.694904+0000","last_peered":"2023-12-13T22:55:35.694904+0000","last_clean":"2023-12-13T22:55:35.694904+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:55:35.694904+0000","last_undegraded":"2023-12-13T22:55:35.694904+0000","last_fullsized":"2023-12-13T22:55:35.694904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'209","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.336981+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:55:13.336981+0000","last_peered":"2023-12-13T22:55:13.336981+0000","last_clean":"2023-12-13T22:55:13.336981+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:55:13.336981+0000","last_undegraded":"2023-12-13T22:55:13.336981+0000","last_fullsized":"2023-12-13T22:55:13.336981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'305","reported_seq":633,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.379923+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:55:24.379923+0000","last_peered":"2023-12-13T22:55:24.379923+0000","last_clean":"2023-12-13T22:55:24.379923+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:55:24.379923+0000","last_undegraded":"2023-12-13T22:55:24.379923+0000","last_fullsized":"2023-12-13T22:55:24.379923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571431+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:55:35.571431+0000","last_peered":"2023-12-13T22:55:35.571431+0000","last_clean":"2023-12-13T22:55:35.571431+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:35.571431+0000","last_undegraded":"2023-12-13T22:55:35.571431+0000","last_fullsized":"2023-12-13T22:55:35.571431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:02.447391+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:54:02.447391+0000","last_peered":"2023-12-13T22:54:02.447391+0000","last_clean":"2023-12-13T22:54:02.447391+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:54:02.447391+0000","last_undegraded":"2023-12-13T22:54:02.447391+0000","last_fullsized":"2023-12-13T22:54:02.447391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2402","reported_seq":2434,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.131126+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:55:35.131126+0000","last_peered":"2023-12-13T22:55:35.131126+0000","last_clean":"2023-12-13T22:55:35.131126+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:55:35.131126+0000","last_undegraded":"2023-12-13T22:55:35.131126+0000","last_fullsized":"2023-12-13T22:55:35.131126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596583+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:55:35.596583+0000","last_peered":"2023-12-13T22:55:35.596583+0000","last_clean":"2023-12-13T22:55:35.596583+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:35.596583+0000","last_undegraded":"2023-12-13T22:55:35.596583+0000","last_fullsized":"2023-12-13T22:55:35.596583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:10.035655+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:54:10.035655+0000","last_peered":"2023-12-13T22:54:10.035655+0000","last_clean":"2023-12-13T22:54:10.035655+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:54:10.035655+0000","last_undegraded":"2023-12-13T22:54:10.035655+0000","last_fullsized":"2023-12-13T22:54:10.035655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624544+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:55:35.624544+0000","last_peered":"2023-12-13T22:55:35.624544+0000","last_clean":"2023-12-13T22:55:35.624544+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:55:35.624544+0000","last_undegraded":"2023-12-13T22:55:35.624544+0000","last_fullsized":"2023-12-13T22:55:35.624544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760964+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:55:35.760964+0000","last_peered":"2023-12-13T22:55:35.760964+0000","last_clean":"2023-12-13T22:55:35.760964+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:55:35.760964+0000","last_undegraded":"2023-12-13T22:55:35.760964+0000","last_fullsized":"2023-12-13T22:55:35.760964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629446+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:55:35.629446+0000","last_peered":"2023-12-13T22:55:35.629446+0000","last_clean":"2023-12-13T22:55:35.629446+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:55:35.629446+0000","last_undegraded":"2023-12-13T22:55:35.629446+0000","last_fullsized":"2023-12-13T22:55:35.629446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571494+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:55:35.571494+0000","last_peered":"2023-12-13T22:55:35.571494+0000","last_clean":"2023-12-13T22:55:35.571494+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:55:35.571494+0000","last_undegraded":"2023-12-13T22:55:35.571494+0000","last_fullsized":"2023-12-13T22:55:35.571494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.682166+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:55:35.682166+0000","last_peered":"2023-12-13T22:55:35.682166+0000","last_clean":"2023-12-13T22:55:35.682166+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:35.682166+0000","last_undegraded":"2023-12-13T22:55:35.682166+0000","last_fullsized":"2023-12-13T22:55:35.682166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501565+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:35.501565+0000","last_peered":"2023-12-13T22:55:35.501565+0000","last_clean":"2023-12-13T22:55:35.501565+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:35.501565+0000","last_undegraded":"2023-12-13T22:55:35.501565+0000","last_fullsized":"2023-12-13T22:55:35.501565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:50:11.725466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631004+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:35.631004+0000","last_peered":"2023-12-13T22:55:35.631004+0000","last_clean":"2023-12-13T22:55:35.631004+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:35.631004+0000","last_undegraded":"2023-12-13T22:55:35.631004+0000","last_fullsized":"2023-12-13T22:55:35.631004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.692125+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:55:35.692125+0000","last_peered":"2023-12-13T22:55:35.692125+0000","last_clean":"2023-12-13T22:55:35.692125+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:35.692125+0000","last_undegraded":"2023-12-13T22:55:35.692125+0000","last_fullsized":"2023-12-13T22:55:35.692125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632243+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:55:35.632243+0000","last_peered":"2023-12-13T22:55:35.632243+0000","last_clean":"2023-12-13T22:55:35.632243+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:55:35.632243+0000","last_undegraded":"2023-12-13T22:55:35.632243+0000","last_fullsized":"2023-12-13T22:55:35.632243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698720+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:55:35.698720+0000","last_peered":"2023-12-13T22:55:35.698720+0000","last_clean":"2023-12-13T22:55:35.698720+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698720+0000","last_undegraded":"2023-12-13T22:55:35.698720+0000","last_fullsized":"2023-12-13T22:55:35.698720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.630133+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:55:35.630133+0000","last_peered":"2023-12-13T22:55:35.630133+0000","last_clean":"2023-12-13T22:55:35.630133+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:55:35.630133+0000","last_undegraded":"2023-12-13T22:55:35.630133+0000","last_fullsized":"2023-12-13T22:55:35.630133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.572832+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:55:35.572832+0000","last_peered":"2023-12-13T22:55:35.572832+0000","last_clean":"2023-12-13T22:55:35.572832+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:55:35.572832+0000","last_undegraded":"2023-12-13T22:55:35.572832+0000","last_fullsized":"2023-12-13T22:55:35.572832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624383+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:55:35.624383+0000","last_peered":"2023-12-13T22:55:35.624383+0000","last_clean":"2023-12-13T22:55:35.624383+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:55:35.624383+0000","last_undegraded":"2023-12-13T22:55:35.624383+0000","last_fullsized":"2023-12-13T22:55:35.624383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543937+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.543937+0000","last_peered":"2023-12-13T22:55:35.543937+0000","last_clean":"2023-12-13T22:55:35.543937+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.543937+0000","last_undegraded":"2023-12-13T22:55:35.543937+0000","last_fullsized":"2023-12-13T22:55:35.543937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.761801+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:55:35.761801+0000","last_peered":"2023-12-13T22:55:35.761801+0000","last_clean":"2023-12-13T22:55:35.761801+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:55:35.761801+0000","last_undegraded":"2023-12-13T22:55:35.761801+0000","last_fullsized":"2023-12-13T22:55:35.761801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.758757+0000","last_change":"2023-12-13T22:27:03.509440+0000","last_active":"2023-12-13T22:55:35.758757+0000","last_peered":"2023-12-13T22:55:35.758757+0000","last_clean":"2023-12-13T22:55:35.758757+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:55:35.758757+0000","last_undegraded":"2023-12-13T22:55:35.758757+0000","last_fullsized":"2023-12-13T22:55:35.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632293+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:55:35.632293+0000","last_peered":"2023-12-13T22:55:35.632293+0000","last_clean":"2023-12-13T22:55:35.632293+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:55:35.632293+0000","last_undegraded":"2023-12-13T22:55:35.632293+0000","last_fullsized":"2023-12-13T22:55:35.632293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.502094+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:55:35.502094+0000","last_peered":"2023-12-13T22:55:35.502094+0000","last_clean":"2023-12-13T22:55:35.502094+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:55:35.502094+0000","last_undegraded":"2023-12-13T22:55:35.502094+0000","last_fullsized":"2023-12-13T22:55:35.502094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555981+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:55:35.555981+0000","last_peered":"2023-12-13T22:55:35.555981+0000","last_clean":"2023-12-13T22:55:35.555981+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:35.555981+0000","last_undegraded":"2023-12-13T22:55:35.555981+0000","last_fullsized":"2023-12-13T22:55:35.555981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698035+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:55:35.698035+0000","last_peered":"2023-12-13T22:55:35.698035+0000","last_clean":"2023-12-13T22:55:35.698035+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:35.698035+0000","last_undegraded":"2023-12-13T22:55:35.698035+0000","last_fullsized":"2023-12-13T22:55:35.698035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614921+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:55:35.614921+0000","last_peered":"2023-12-13T22:55:35.614921+0000","last_clean":"2023-12-13T22:55:35.614921+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:55:35.614921+0000","last_undegraded":"2023-12-13T22:55:35.614921+0000","last_fullsized":"2023-12-13T22:55:35.614921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.635444+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:55:35.635444+0000","last_peered":"2023-12-13T22:55:35.635444+0000","last_clean":"2023-12-13T22:55:35.635444+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:55:35.635444+0000","last_undegraded":"2023-12-13T22:55:35.635444+0000","last_fullsized":"2023-12-13T22:55:35.635444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631587+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631587+0000","last_peered":"2023-12-13T22:55:35.631587+0000","last_clean":"2023-12-13T22:55:35.631587+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631587+0000","last_undegraded":"2023-12-13T22:55:35.631587+0000","last_fullsized":"2023-12-13T22:55:35.631587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580534+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580534+0000","last_peered":"2023-12-13T22:55:35.580534+0000","last_clean":"2023-12-13T22:55:35.580534+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580534+0000","last_undegraded":"2023-12-13T22:55:35.580534+0000","last_fullsized":"2023-12-13T22:55:35.580534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698947+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:55:35.698947+0000","last_peered":"2023-12-13T22:55:35.698947+0000","last_clean":"2023-12-13T22:55:35.698947+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698947+0000","last_undegraded":"2023-12-13T22:55:35.698947+0000","last_fullsized":"2023-12-13T22:55:35.698947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.532526+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:55:35.532526+0000","last_peered":"2023-12-13T22:55:35.532526+0000","last_clean":"2023-12-13T22:55:35.532526+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:55:35.532526+0000","last_undegraded":"2023-12-13T22:55:35.532526+0000","last_fullsized":"2023-12-13T22:55:35.532526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760342+0000","last_change":"2023-12-13T22:27:03.070128+0000","last_active":"2023-12-13T22:55:35.760342+0000","last_peered":"2023-12-13T22:55:35.760342+0000","last_clean":"2023-12-13T22:55:35.760342+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:55:35.760342+0000","last_undegraded":"2023-12-13T22:55:35.760342+0000","last_fullsized":"2023-12-13T22:55:35.760342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539165+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:55:35.539165+0000","last_peered":"2023-12-13T22:55:35.539165+0000","last_clean":"2023-12-13T22:55:35.539165+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:55:35.539165+0000","last_undegraded":"2023-12-13T22:55:35.539165+0000","last_fullsized":"2023-12-13T22:55:35.539165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631457+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:55:35.631457+0000","last_peered":"2023-12-13T22:55:35.631457+0000","last_clean":"2023-12-13T22:55:35.631457+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:55:35.631457+0000","last_undegraded":"2023-12-13T22:55:35.631457+0000","last_fullsized":"2023-12-13T22:55:35.631457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555896+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:55:35.555896+0000","last_peered":"2023-12-13T22:55:35.555896+0000","last_clean":"2023-12-13T22:55:35.555896+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:55:35.555896+0000","last_undegraded":"2023-12-13T22:55:35.555896+0000","last_fullsized":"2023-12-13T22:55:35.555896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503529+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:55:35.503529+0000","last_peered":"2023-12-13T22:55:35.503529+0000","last_clean":"2023-12-13T22:55:35.503529+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:55:35.503529+0000","last_undegraded":"2023-12-13T22:55:35.503529+0000","last_fullsized":"2023-12-13T22:55:35.503529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.538999+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.538999+0000","last_peered":"2023-12-13T22:55:35.538999+0000","last_clean":"2023-12-13T22:55:35.538999+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.538999+0000","last_undegraded":"2023-12-13T22:55:35.538999+0000","last_fullsized":"2023-12-13T22:55:35.538999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8033,"ondisk_log_size":8033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477106,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.38100000000000001},"max":{"1min":1.3180000000000001,"5min":1.73,"15min":1.7689999999999999},"last":1.294},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.65100000000000002,"5min":0.55900000000000005,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.628,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.2350000000000001,"5min":2.165,"15min":2.165},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.022,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.63300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.369,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.036}]},{"osd":2,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97299999999999998,"15min":0.97699999999999998},"min":{"1min":0.66000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.361,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.383,"5min":1.649,"15min":2.1269999999999998},"last":1.472}]},{"osd":3,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.76700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.792,"15min":1.792},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0069999999999999,"15min":1.032},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.3700000000000001,"5min":1.496,"15min":2.996},"last":1.373}]},{"osd":4,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.6819999999999999,"5min":1.847,"15min":1.8480000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.8120000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.04},"min":{"1min":0.68100000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6339999999999999,"15min":2.21},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.111,"15min":1.107},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.591,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.335}]},{"osd":6,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.145,"15min":1.143},"min":{"1min":0.77100000000000002,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.506,"5min":2.056,"15min":2.0590000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.133,"15min":1.129},"min":{"1min":0.60599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.73,"5min":1.798,"15min":2.169},"last":1.2669999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477106,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.67400000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.272,"5min":1.575,"15min":2.1970000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.3109999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.008}]},{"osd":1,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.873,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.319,"15min":1.5109999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.0289999999999999,"15min":1.0129999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":1.1519999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4650000000000001,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.04,"15min":1.014},"min":{"1min":0.79100000000000004,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.506,"5min":1.506,"15min":1.8540000000000001},"last":1.1180000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0700000000000001,"15min":1.0649999999999999},"min":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.44800000000000001},"max":{"1min":1.4930000000000001,"5min":1.587,"15min":1.841},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.3320000000000001,"5min":1.405,"15min":1.784},"last":1.044}]},{"osd":4,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.755,"5min":0.47499999999999998,"15min":0.375},"max":{"1min":1.6279999999999999,"5min":1.7350000000000001,"15min":2.504},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.72799999999999998,"5min":0.47099999999999997,"15min":0.33000000000000002},"max":{"1min":1.5569999999999999,"5min":1.708,"15min":2.044},"last":0.72499999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.63200000000000001,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.9239999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1879999999999999,"15min":1.2010000000000001},"min":{"1min":0.72499999999999998,"5min":0.52200000000000002,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.093}]},{"osd":7,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.21,"15min":1.2},"min":{"1min":0.69799999999999995,"5min":0.45000000000000001,"15min":0.42299999999999999},"max":{"1min":1.6339999999999999,"5min":1.766,"15min":2.956},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.99399999999999999,"5min":0.495,"15min":0.442},"max":{"1min":1.6779999999999999,"5min":1.788,"15min":1.9350000000000001},"last":0.88300000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477106,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.264,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.494},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.75800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.667},"last":2.157},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93999999999999995,"15min":0.96899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.123},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.69099999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.4350000000000001,"15min":1.5009999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.57499999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.599},"last":0.755},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3360000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89400000000000002,"15min":0.92500000000000004},"min":{"1min":0.57199999999999995,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3779999999999999,"5min":1.482,"15min":1.53},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":2.2959999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.024,"15min":1.0680000000000001},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.63300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.466,"5min":1.552,"15min":1.8480000000000001},"last":1.0189999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.1459999999999999},"min":{"1min":0.60199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.9339999999999999},"last":2.2469999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.24}]}]},{"osd":4,"up_from":16,"seq":68719477107,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.879,"15min":0.91200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90700000000000003,"15min":0.90200000000000002},"min":{"1min":0.64200000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3220000000000001,"5min":1.3759999999999999,"15min":1.488},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95099999999999996},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.242,"5min":1.75,"15min":1.75},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.997,"15min":1.002},"min":{"1min":0.71399999999999997,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.22,"5min":1.4299999999999999,"15min":1.831},"last":0.871}]},{"osd":2,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.65200000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.2470000000000001,"5min":1.371,"15min":1.645},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.0309999999999999,"15min":1.04},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.423,"5min":1.5149999999999999,"15min":1.75},"last":1.012}]},{"osd":3,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.96299999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.194,"5min":1.639,"15min":1.639},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.103,"5min":1.097,"15min":1.1220000000000001},"min":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.3899999999999999,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.63400000000000001,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.51,"5min":2.218,"15min":2.218},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0349999999999999},"min":{"1min":0.63600000000000001,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.464,"5min":1.5,"15min":1.643},"last":0.81000000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":1.0680000000000001},"min":{"1min":0.60999999999999999,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.595,"5min":2.137,"15min":2.137},"last":1.0580000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1020000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.61599999999999999,"15min":0.504},"max":{"1min":1.585,"5min":1.8049999999999999,"15min":1.857},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.1879999999999999,"15min":1.2070000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.833,"5min":1.927,"15min":2.3079999999999998},"last":0.77600000000000002}]}]},{"osd":3,"up_from":16,"seq":68719477106,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.628},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.081,"5min":1.3149999999999999,"15min":1.524},"last":0.81699999999999995}]},{"osd":1,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88200000000000001,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3859999999999999,"15min":1.4379999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.86699999999999999},"min":{"1min":0.61599999999999999,"5min":0.373,"15min":0.34200000000000003},"max":{"1min":1.085,"5min":1.3029999999999999,"15min":5.085},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95099999999999996,"15min":0.92900000000000005},"min":{"1min":0.63600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.84799999999999998}]},{"osd":4,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.81599999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3069999999999999,"5min":1.6359999999999999,"15min":1.77},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3180000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":1.1879999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0800000000000001,"15min":1.091},"min":{"1min":0.76800000000000002,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.3919999999999999,"5min":1.532,"15min":1.8400000000000001},"last":1.085},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1830000000000001,"15min":1.177},"min":{"1min":0.84999999999999998,"5min":0.63200000000000001,"15min":0.38200000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.069}]},{"osd":6,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.23,"15min":1.204},"min":{"1min":0.98999999999999999,"5min":0.60299999999999998,"15min":0.47199999999999998},"max":{"1min":1.5720000000000001,"5min":1.8149999999999999,"15min":2.181},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.96399999999999997,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.407,"5min":1.742,"15min":2.1230000000000002},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.81699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4870000000000001,"5min":1.841,"15min":2.1779999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0189999999999999,"5min":0.65200000000000002,"15min":0.55600000000000005},"max":{"1min":1.5169999999999999,"5min":1.7909999999999999,"15min":1.948},"last":1.2809999999999999}]}]},{"osd":1,"up_from":16,"seq":68719477107,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53000000000000003,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":1.054,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1559999999999999,"5min":1.401,"15min":1.5580000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.397,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.874}]},{"osd":3,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1160000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.872,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.308,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0049999999999999,"15min":1.0089999999999999},"min":{"1min":0.746,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.3169999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.60299999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3260000000000001,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0609999999999999,"15min":1.089},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.6599999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.181,"15min":1.1799999999999999},"min":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"max":{"1min":1.4710000000000001,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.528}]},{"osd":6,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.117},"min":{"1min":0.79000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.468,"5min":1.706,"15min":1.7649999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.66400000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.4339999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.585}]},{"osd":7,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.88500000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.409,"5min":1.8,"15min":1.8520000000000001},"last":1.131},{"interface":"front","average":{"1min":1.095,"5min":1.1519999999999999,"15min":1.173},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4239999999999999,"5min":2.774,"15min":2.774},"last":1.0369999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509809,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.24,"5min":1.24,"15min":2.8730000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.964},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.97399999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.873,"15min":0.86599999999999999},"min":{"1min":0.57099999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93600000000000005},"min":{"1min":0.51600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93300000000000005,"15min":0.94899999999999995},"min":{"1min":0.70899999999999996,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.718,"5min":1.718,"15min":1.869},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0509999999999999,"15min":1.0620000000000001},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.635,"5min":1.722,"15min":1.8340000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.625,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.6699999999999999,"5min":1.772,"15min":2.1030000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0629999999999999,"15min":1.0860000000000001},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.635,"5min":1.635,"15min":2.0779999999999998},"last":1.1339999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.147,"15min":1.153},"min":{"1min":0.79800000000000004,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.5640000000000001,"5min":1.776,"15min":1.835},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.129,"15min":1.1459999999999999},"min":{"1min":0.66900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.754,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.0860000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.80700000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6899999999999999,"5min":1.704,"15min":2.5640000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.179,"15min":1.214},"min":{"1min":0.89900000000000002,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.573,"5min":1.986,"15min":5.3310000000000004},"last":1.0369999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542513,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":1.048,"5min":1.897,"15min":1.897},"last":0.754},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.77000000000000002},"min":{"1min":0.51700000000000002,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.099,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Dec 13 22:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89400000000000002,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.872,"15min":0.874},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.79,"5min":1.79,"15min":1.9099999999999999},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":0.91900000000000004},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.0680000000000001,"5min":1.867,"15min":2.6320000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92400000000000004,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":2.0659999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.71199999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.4490000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1850000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.099,"15min":1.0760000000000001},"min":{"1min":0.70999999999999996,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.5309999999999999,"5min":1.554,"15min":1.625},"last":1.268},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.53000000000000003,"15min":0.46800000000000003},"max":{"1min":1.5049999999999999,"5min":2.0259999999999998,"15min":2.1539999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.139,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.8420000000000001,"15min":2.2250000000000001},"last":1.151},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.232,"15min":1.212},"min":{"1min":0.93799999999999994,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5669999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.91800000000000004,"5min":0.56899999999999995,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.504},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.232,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6419999999999999,"5min":2.1259999999999999,"15min":2.339},"last":1.232}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:55:42.204 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:55:42.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 Processor -- start 2023-12-13T22:55:42.356 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 -- start start 2023-12-13T22:55:42.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff3200c4630 0x7ff3200c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff3200c4a10 0x7ff3201596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200c72b0 con 0x7ff320159c00 2023-12-13T22:55:42.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200c4f40 con 0x7ff3200c4a10 2023-12-13T22:55:42.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff32738b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32015a6c0 con 0x7ff3200c4630 2023-12-13T22:55:42.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff324926640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff3200c4a10 0x7ff3201596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff325127640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff3200c4630 0x7ff3200c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.358 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff324926640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff3200c4a10 0x7ff3201596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57142/0 (socket says 172.21.15.91:57142) 2023-12-13T22:55:42.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.359+0000 7ff324926640 1 -- 172.21.15.91:0/1874277644 learned_addr learned my addr 172.21.15.91:0/1874277644 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:42.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.363+0000 7ff324926640 1 -- 172.21.15.91:0/1874277644 >> v2:172.21.15.152:3300/0 conn(0x7ff3200c4630 msgr2=0x7ff3200c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:42.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.363+0000 7ff324926640 1 --2- 172.21.15.91:0/1874277644 >> v2:172.21.15.152:3300/0 conn(0x7ff3200c4630 0x7ff3200c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.363+0000 7ff324926640 1 -- 172.21.15.91:0/1874277644 >> v1:172.21.15.91:6789/0 conn(0x7ff320159c00 legacy=0x7ff32014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.362 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.363+0000 7ff324926640 1 -- 172.21.15.91:0/1874277644 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32015a100 con 0x7ff3200c4a10 2023-12-13T22:55:42.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.367+0000 7ff324926640 1 --2- 172.21.15.91:0/1874277644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201596c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff32006f8a0 tx=0x7ff31001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ef6b10832a172 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:42.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff317fff640 1 -- 172.21.15.91:0/1874277644 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100a89f0 con 0x7ff3200c4a10 2023-12-13T22:55:42.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff317fff640 1 -- 172.21.15.91:0/1874277644 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100a8b50 con 0x7ff3200c4a10 2023-12-13T22:55:42.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff317fff640 1 -- 172.21.15.91:0/1874277644 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100b0440 con 0x7ff3200c4a10 2023-12-13T22:55:42.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 -- 172.21.15.91:0/1874277644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 msgr2=0x7ff3201596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 --2- 172.21.15.91:0/1874277644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201596c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff32006f8a0 tx=0x7ff31001ecf0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 -- 172.21.15.91:0/1874277644 shutdown_connections 2023-12-13T22:55:42.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 --2- 172.21.15.91:0/1874277644 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201596c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 --2- 172.21.15.91:0/1874277644 >> v2:172.21.15.152:3300/0 conn(0x7ff3200c4630 0x7ff3200c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 -- 172.21.15.91:0/1874277644 >> 172.21.15.91:0/1874277644 conn(0x7ff32006c6a0 msgr2=0x7ff32006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 -- 172.21.15.91:0/1874277644 shutdown_connections 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.371+0000 7ff32738b640 1 -- 172.21.15.91:0/1874277644 wait complete. 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 Processor -- start 2023-12-13T22:55:42.372 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 -- start start 2023-12-13T22:55:42.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200c4630 0x7ff3201415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.373 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 0x7ff320154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320072a40 con 0x7ff3200c4a10 2023-12-13T22:55:42.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320141b00 con 0x7ff3200c4630 2023-12-13T22:55:42.374 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff32738b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff320071b00 con 0x7ff320159c00 2023-12-13T22:55:42.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff325928640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 0x7ff320154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff324926640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff325928640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 0x7ff320154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:34796/0 (socket says 172.21.15.91:34796) 2023-12-13T22:55:42.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff325928640 1 -- 172.21.15.91:0/1119944002 learned_addr learned my addr 172.21.15.91:0/1119944002 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:42.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.375+0000 7ff325127640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200c4630 0x7ff3201415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.379+0000 7ff324926640 1 -- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 msgr2=0x7ff320154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.379+0000 7ff324926640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 0x7ff320154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.379 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.379+0000 7ff324926640 1 -- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200c4630 msgr2=0x7ff3201415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.379+0000 7ff324926640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200c4630 0x7ff3201415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.380 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.379+0000 7ff324926640 1 -- 172.21.15.91:0/1119944002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100094d0 con 0x7ff3200c4a10 2023-12-13T22:55:42.382 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.383+0000 7ff324926640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201558d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3100af000 tx=0x7ff31001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100be070 con 0x7ff3200c4a10 2023-12-13T22:55:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100b1b00 con 0x7ff3200c4a10 2023-12-13T22:55:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100b1e70 con 0x7ff3200c4a10 2023-12-13T22:55:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff320071dc0 con 0x7ff3200c4a10 2023-12-13T22:55:42.386 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff320072380 con 0x7ff3200c4a10 2023-12-13T22:55:42.387 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.387+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff320067520 con 0x7ff3200c4a10 2023-12-13T22:55:42.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.407+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff3100b7070 con 0x7ff3200c4a10 2023-12-13T22:55:42.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.411+0000 7ff315ffb640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 0x7ff304068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:42.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.411+0000 7ff325127640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 0x7ff304068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:42.408 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.411+0000 7ff325127640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 0x7ff304068d00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009ac0 tx=0x7ff31c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:42.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.683+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3100f2fc0 con 0x7ff3200c4a10 2023-12-13T22:55:42.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.683+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff3100ef300 con 0x7ff3200c4a10 2023-12-13T22:55:42.853 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.855+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3201565c0 con 0x7ff304066840 2023-12-13T22:55:42.869 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.871+0000 7ff315ffb640 1 -- 172.21.15.91:0/1119944002 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368860 (secure 0 0 0) 0x7ff31c0119e0 con 0x7ff304066840 2023-12-13T22:55:42.873 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:42.875 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:55:42.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 msgr2=0x7ff304068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 0x7ff304068d00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009ac0 tx=0x7ff31c009190 comp rx=0 tx=0).stop 2023-12-13T22:55:42.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 msgr2=0x7ff3201558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:42.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201558d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3100af000 tx=0x7ff31001ba90 comp rx=0 tx=0).stop 2023-12-13T22:55:42.876 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 shutdown_connections 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff304066840 0x7ff304068d00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff320159c00 0x7ff320154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff3200c4a10 0x7ff3201558d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 --2- 172.21.15.91:0/1119944002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3200c4630 0x7ff3201415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 >> 172.21.15.91:0/1119944002 conn(0x7ff32006c6a0 msgr2=0x7ff32006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 shutdown_connections 2023-12-13T22:55:42.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:42.875+0000 7ff32738b640 1 -- 172.21.15.91:0/1119944002 wait complete. 2023-12-13T22:55:42.893 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":941,"stamp":"2023-12-13T22:55:41.346937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13422,"ondisk_log_size":13422,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10974,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":22,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005013"},"pg_stats":[{"pgid":"2.1f","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.805619+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:55:09.805619+0000","last_peered":"2023-12-13T22:55:09.805619+0000","last_clean":"2023-12-13T22:55:09.805619+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:09.805619+0000","last_undegraded":"2023-12-13T22:55:09.805619+0000","last_fullsized":"2023-12-13T22:55:09.805619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.688943+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:55:35.688943+0000","last_peered":"2023-12-13T22:55:35.688943+0000","last_clean":"2023-12-13T22:55:35.688943+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:35.688943+0000","last_undegraded":"2023-12-13T22:55:35.688943+0000","last_fullsized":"2023-12-13T22:55:35.688943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.696675+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:54:15.696675+0000","last_peered":"2023-12-13T22:54:15.696675+0000","last_clean":"2023-12-13T22:54:15.696675+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:54:15.696675+0000","last_undegraded":"2023-12-13T22:54:15.696675+0000","last_fullsized":"2023-12-13T22:54:15.696675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.112249+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:55:35.112249+0000","last_peered":"2023-12-13T22:55:35.112249+0000","last_clean":"2023-12-13T22:55:35.112249+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:55:35.112249+0000","last_undegraded":"2023-12-13T22:55:35.112249+0000","last_fullsized":"2023-12-13T22:55:35.112249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579225+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:55:35.579225+0000","last_peered":"2023-12-13T22:55:35.579225+0000","last_clean":"2023-12-13T22:55:35.579225+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:35.579225+0000","last_undegraded":"2023-12-13T22:55:35.579225+0000","last_fullsized":"2023-12-13T22:55:35.579225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.333132+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:54:24.333132+0000","last_peered":"2023-12-13T22:54:24.333132+0000","last_clean":"2023-12-13T22:54:24.333132+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:54:24.333132+0000","last_undegraded":"2023-12-13T22:54:24.333132+0000","last_fullsized":"2023-12-13T22:54:24.333132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'12","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.221109+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:55:13.221109+0000","last_peered":"2023-12-13T22:55:13.221109+0000","last_clean":"2023-12-13T22:55:13.221109+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:55:13.221109+0000","last_undegraded":"2023-12-13T22:55:13.221109+0000","last_fullsized":"2023-12-13T22:55:13.221109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631543+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:55:35.631543+0000","last_peered":"2023-12-13T22:55:35.631543+0000","last_clean":"2023-12-13T22:55:35.631543+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:55:35.631543+0000","last_undegraded":"2023-12-13T22:55:35.631543+0000","last_fullsized":"2023-12-13T22:55:35.631543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:06.394820+0000","last_change":"2023-12-13T22:27:03.108442+0000","last_active":"2023-12-13T22:54:06.394820+0000","last_peered":"2023-12-13T22:54:06.394820+0000","last_clean":"2023-12-13T22:54:06.394820+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:54:06.394820+0000","last_undegraded":"2023-12-13T22:54:06.394820+0000","last_fullsized":"2023-12-13T22:54:06.394820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:43.918776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.539803+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:54:58.539803+0000","last_peered":"2023-12-13T22:54:58.539803+0000","last_clean":"2023-12-13T22:54:58.539803+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:54:58.539803+0000","last_undegraded":"2023-12-13T22:54:58.539803+0000","last_fullsized":"2023-12-13T22:54:58.539803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638381+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:55:35.638381+0000","last_peered":"2023-12-13T22:55:35.638381+0000","last_clean":"2023-12-13T22:55:35.638381+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:55:35.638381+0000","last_undegraded":"2023-12-13T22:55:35.638381+0000","last_fullsized":"2023-12-13T22:55:35.638381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.679608+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:54:15.679608+0000","last_peered":"2023-12-13T22:54:15.679608+0000","last_clean":"2023-12-13T22:54:15.679608+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:54:15.679608+0000","last_undegraded":"2023-12-13T22:54:15.679608+0000","last_fullsized":"2023-12-13T22:54:15.679608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624367+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:55:35.624367+0000","last_peered":"2023-12-13T22:55:35.624367+0000","last_clean":"2023-12-13T22:55:35.624367+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:55:35.624367+0000","last_undegraded":"2023-12-13T22:55:35.624367+0000","last_fullsized":"2023-12-13T22:55:35.624367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'671","reported_seq":705,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.116962+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:55:35.116962+0000","last_peered":"2023-12-13T22:55:35.116962+0000","last_clean":"2023-12-13T22:55:35.116962+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:55:35.116962+0000","last_undegraded":"2023-12-13T22:55:35.116962+0000","last_fullsized":"2023-12-13T22:55:35.116962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.953445+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:54:15.953445+0000","last_peered":"2023-12-13T22:54:15.953445+0000","last_clean":"2023-12-13T22:54:15.953445+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:54:15.953445+0000","last_undegraded":"2023-12-13T22:54:15.953445+0000","last_fullsized":"2023-12-13T22:54:15.953445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.697096+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:55:35.697096+0000","last_peered":"2023-12-13T22:55:35.697096+0000","last_clean":"2023-12-13T22:55:35.697096+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:55:35.697096+0000","last_undegraded":"2023-12-13T22:55:35.697096+0000","last_fullsized":"2023-12-13T22:55:35.697096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'230","reported_seq":264,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.535151+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:55:13.535151+0000","last_peered":"2023-12-13T22:55:13.535151+0000","last_clean":"2023-12-13T22:55:13.535151+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:13.535151+0000","last_undegraded":"2023-12-13T22:55:13.535151+0000","last_fullsized":"2023-12-13T22:55:13.535151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:16.899782+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:54:16.899782+0000","last_peered":"2023-12-13T22:54:16.899782+0000","last_clean":"2023-12-13T22:54:16.899782+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:54:16.899782+0000","last_undegraded":"2023-12-13T22:54:16.899782+0000","last_fullsized":"2023-12-13T22:54:16.899782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698820+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:55:35.698820+0000","last_peered":"2023-12-13T22:55:35.698820+0000","last_clean":"2023-12-13T22:55:35.698820+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:55:35.698820+0000","last_undegraded":"2023-12-13T22:55:35.698820+0000","last_fullsized":"2023-12-13T22:55:35.698820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'165","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.241562+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:55:13.241562+0000","last_peered":"2023-12-13T22:55:13.241562+0000","last_clean":"2023-12-13T22:55:13.241562+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:55:13.241562+0000","last_undegraded":"2023-12-13T22:55:13.241562+0000","last_fullsized":"2023-12-13T22:55:13.241562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.078027+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:54:15.078027+0000","last_peered":"2023-12-13T22:54:15.078027+0000","last_clean":"2023-12-13T22:54:15.078027+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:54:15.078027+0000","last_undegraded":"2023-12-13T22:54:15.078027+0000","last_fullsized":"2023-12-13T22:54:15.078027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.457436+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:55:35.457436+0000","last_peered":"2023-12-13T22:55:35.457436+0000","last_clean":"2023-12-13T22:55:35.457436+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:35.457436+0000","last_undegraded":"2023-12-13T22:55:35.457436+0000","last_fullsized":"2023-12-13T22:55:35.457436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.867630+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:55:09.867630+0000","last_peered":"2023-12-13T22:55:09.867630+0000","last_clean":"2023-12-13T22:55:09.867630+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:09.867630+0000","last_undegraded":"2023-12-13T22:55:09.867630+0000","last_fullsized":"2023-12-13T22:55:09.867630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.389221+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:54:24.389221+0000","last_peered":"2023-12-13T22:54:24.389221+0000","last_clean":"2023-12-13T22:54:24.389221+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:54:24.389221+0000","last_undegraded":"2023-12-13T22:54:24.389221+0000","last_fullsized":"2023-12-13T22:54:24.389221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555941+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:55:35.555941+0000","last_peered":"2023-12-13T22:55:35.555941+0000","last_clean":"2023-12-13T22:55:35.555941+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:35.555941+0000","last_undegraded":"2023-12-13T22:55:35.555941+0000","last_fullsized":"2023-12-13T22:55:35.555941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.637577+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:55:12.637577+0000","last_peered":"2023-12-13T22:55:12.637577+0000","last_clean":"2023-12-13T22:55:12.637577+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:12.637577+0000","last_undegraded":"2023-12-13T22:55:12.637577+0000","last_fullsized":"2023-12-13T22:55:12.637577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.399554+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:54:24.399554+0000","last_peered":"2023-12-13T22:54:24.399554+0000","last_clean":"2023-12-13T22:54:24.399554+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:54:24.399554+0000","last_undegraded":"2023-12-13T22:54:24.399554+0000","last_fullsized":"2023-12-13T22:54:24.399554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694184+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:55:35.694184+0000","last_peered":"2023-12-13T22:55:35.694184+0000","last_clean":"2023-12-13T22:55:35.694184+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:55:35.694184+0000","last_undegraded":"2023-12-13T22:55:35.694184+0000","last_fullsized":"2023-12-13T22:55:35.694184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'188","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:29.793234+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:55:29.793234+0000","last_peered":"2023-12-13T22:55:29.793234+0000","last_clean":"2023-12-13T22:55:29.793234+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:55:29.793234+0000","last_undegraded":"2023-12-13T22:55:29.793234+0000","last_fullsized":"2023-12-13T22:55:29.793234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.864556+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:54:12.864556+0000","last_peered":"2023-12-13T22:54:12.864556+0000","last_clean":"2023-12-13T22:54:12.864556+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:54:12.864556+0000","last_undegraded":"2023-12-13T22:54:12.864556+0000","last_fullsized":"2023-12-13T22:54:12.864556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501731+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:55:35.501731+0000","last_peered":"2023-12-13T22:55:35.501731+0000","last_clean":"2023-12-13T22:55:35.501731+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:55:35.501731+0000","last_undegraded":"2023-12-13T22:55:35.501731+0000","last_fullsized":"2023-12-13T22:55:35.501731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:31.335556+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:54:31.335556+0000","last_peered":"2023-12-13T22:54:31.335556+0000","last_clean":"2023-12-13T22:54:31.335556+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:54:31.335556+0000","last_undegraded":"2023-12-13T22:54:31.335556+0000","last_fullsized":"2023-12-13T22:54:31.335556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.279383+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:54:24.279383+0000","last_peered":"2023-12-13T22:54:24.279383+0000","last_clean":"2023-12-13T22:54:24.279383+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:54:24.279383+0000","last_undegraded":"2023-12-13T22:54:24.279383+0000","last_fullsized":"2023-12-13T22:54:24.279383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638034+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:55:35.638034+0000","last_peered":"2023-12-13T22:55:35.638034+0000","last_clean":"2023-12-13T22:55:35.638034+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:55:35.638034+0000","last_undegraded":"2023-12-13T22:55:35.638034+0000","last_fullsized":"2023-12-13T22:55:35.638034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.641222+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:55:18.641222+0000","last_peered":"2023-12-13T22:55:18.641222+0000","last_clean":"2023-12-13T22:55:18.641222+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:55:18.641222+0000","last_undegraded":"2023-12-13T22:55:18.641222+0000","last_fullsized":"2023-12-13T22:55:18.641222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.467825+0000","last_change":"2023-12-13T22:27:03.566251+0000","last_active":"2023-12-13T22:54:09.467825+0000","last_peered":"2023-12-13T22:54:09.467825+0000","last_clean":"2023-12-13T22:54:09.467825+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:54:09.467825+0000","last_undegraded":"2023-12-13T22:54:09.467825+0000","last_fullsized":"2023-12-13T22:54:09.467825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596787+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:55:35.596787+0000","last_peered":"2023-12-13T22:55:35.596787+0000","last_clean":"2023-12-13T22:55:35.596787+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:35.596787+0000","last_undegraded":"2023-12-13T22:55:35.596787+0000","last_fullsized":"2023-12-13T22:55:35.596787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.064015+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:55:08.064015+0000","last_peered":"2023-12-13T22:55:08.064015+0000","last_clean":"2023-12-13T22:55:08.064015+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:08.064015+0000","last_undegraded":"2023-12-13T22:55:08.064015+0000","last_fullsized":"2023-12-13T22:55:08.064015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.871697+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:54:12.871697+0000","last_peered":"2023-12-13T22:54:12.871697+0000","last_clean":"2023-12-13T22:54:12.871697+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:54:12.871697+0000","last_undegraded":"2023-12-13T22:54:12.871697+0000","last_fullsized":"2023-12-13T22:54:12.871697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501224+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:55:35.501224+0000","last_peered":"2023-12-13T22:55:35.501224+0000","last_clean":"2023-12-13T22:55:35.501224+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:55:35.501224+0000","last_undegraded":"2023-12-13T22:55:35.501224+0000","last_fullsized":"2023-12-13T22:55:35.501224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'252","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.009575+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:55:32.009575+0000","last_peered":"2023-12-13T22:55:32.009575+0000","last_clean":"2023-12-13T22:55:32.009575+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:32.009575+0000","last_undegraded":"2023-12-13T22:55:32.009575+0000","last_fullsized":"2023-12-13T22:55:32.009575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721359+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:54:14.721359+0000","last_peered":"2023-12-13T22:54:14.721359+0000","last_clean":"2023-12-13T22:54:14.721359+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:54:14.721359+0000","last_undegraded":"2023-12-13T22:54:14.721359+0000","last_fullsized":"2023-12-13T22:54:14.721359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.567799+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:55:35.567799+0000","last_peered":"2023-12-13T22:55:35.567799+0000","last_clean":"2023-12-13T22:55:35.567799+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:35.567799+0000","last_undegraded":"2023-12-13T22:55:35.567799+0000","last_fullsized":"2023-12-13T22:55:35.567799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.540014+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:54:58.540014+0000","last_peered":"2023-12-13T22:54:58.540014+0000","last_clean":"2023-12-13T22:54:58.540014+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:54:58.540014+0000","last_undegraded":"2023-12-13T22:54:58.540014+0000","last_fullsized":"2023-12-13T22:54:58.540014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.793578+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:54:14.793578+0000","last_peered":"2023-12-13T22:54:14.793578+0000","last_clean":"2023-12-13T22:54:14.793578+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:54:14.793578+0000","last_undegraded":"2023-12-13T22:54:14.793578+0000","last_fullsized":"2023-12-13T22:54:14.793578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.696626+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:55:35.696626+0000","last_peered":"2023-12-13T22:55:35.696626+0000","last_clean":"2023-12-13T22:55:35.696626+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:55:35.696626+0000","last_undegraded":"2023-12-13T22:55:35.696626+0000","last_fullsized":"2023-12-13T22:55:35.696626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.639382+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:55:18.639382+0000","last_peered":"2023-12-13T22:55:18.639382+0000","last_clean":"2023-12-13T22:55:18.639382+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:18.639382+0000","last_undegraded":"2023-12-13T22:55:18.639382+0000","last_fullsized":"2023-12-13T22:55:18.639382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:23.067917+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:53:23.067917+0000","last_peered":"2023-12-13T22:53:23.067917+0000","last_clean":"2023-12-13T22:53:23.067917+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:53:23.067917+0000","last_undegraded":"2023-12-13T22:53:23.067917+0000","last_fullsized":"2023-12-13T22:53:23.067917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.054977+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:54:23.054977+0000","last_peered":"2023-12-13T22:54:23.054977+0000","last_clean":"2023-12-13T22:54:23.054977+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:54:23.054977+0000","last_undegraded":"2023-12-13T22:54:23.054977+0000","last_fullsized":"2023-12-13T22:54:23.054977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629343+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:55:35.629343+0000","last_peered":"2023-12-13T22:55:35.629343+0000","last_clean":"2023-12-13T22:55:35.629343+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:55:35.629343+0000","last_undegraded":"2023-12-13T22:55:35.629343+0000","last_fullsized":"2023-12-13T22:55:35.629343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.561518+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:55:18.561518+0000","last_peered":"2023-12-13T22:55:18.561518+0000","last_clean":"2023-12-13T22:55:18.561518+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:55:18.561518+0000","last_undegraded":"2023-12-13T22:55:18.561518+0000","last_fullsized":"2023-12-13T22:55:18.561518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.943447+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:54:17.943447+0000","last_peered":"2023-12-13T22:54:17.943447+0000","last_clean":"2023-12-13T22:54:17.943447+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:54:17.943447+0000","last_undegraded":"2023-12-13T22:54:17.943447+0000","last_fullsized":"2023-12-13T22:54:17.943447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631055+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:55:35.631055+0000","last_peered":"2023-12-13T22:55:35.631055+0000","last_clean":"2023-12-13T22:55:35.631055+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:35.631055+0000","last_undegraded":"2023-12-13T22:55:35.631055+0000","last_fullsized":"2023-12-13T22:55:35.631055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'6","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:57.259703+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:54:57.259703+0000","last_peered":"2023-12-13T22:54:57.259703+0000","last_clean":"2023-12-13T22:54:57.259703+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:54:57.259703+0000","last_undegraded":"2023-12-13T22:54:57.259703+0000","last_fullsized":"2023-12-13T22:54:57.259703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.777096+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:54:08.777096+0000","last_peered":"2023-12-13T22:54:08.777096+0000","last_clean":"2023-12-13T22:54:08.777096+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:54:08.777096+0000","last_undegraded":"2023-12-13T22:54:08.777096+0000","last_fullsized":"2023-12-13T22:54:08.777096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.542756+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.542756+0000","last_peered":"2023-12-13T22:55:35.542756+0000","last_clean":"2023-12-13T22:55:35.542756+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.542756+0000","last_undegraded":"2023-12-13T22:55:35.542756+0000","last_fullsized":"2023-12-13T22:55:35.542756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:54.567074+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:54:54.567074+0000","last_peered":"2023-12-13T22:54:54.567074+0000","last_clean":"2023-12-13T22:54:54.567074+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:54:54.567074+0000","last_undegraded":"2023-12-13T22:54:54.567074+0000","last_fullsized":"2023-12-13T22:54:54.567074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.052609+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:54:18.052609+0000","last_peered":"2023-12-13T22:54:18.052609+0000","last_clean":"2023-12-13T22:54:18.052609+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:54:18.052609+0000","last_undegraded":"2023-12-13T22:54:18.052609+0000","last_fullsized":"2023-12-13T22:54:18.052609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503199+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:35.503199+0000","last_peered":"2023-12-13T22:55:35.503199+0000","last_clean":"2023-12-13T22:55:35.503199+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:35.503199+0000","last_undegraded":"2023-12-13T22:55:35.503199+0000","last_fullsized":"2023-12-13T22:55:35.503199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:55.399144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'264","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.920406+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:55:22.920406+0000","last_peered":"2023-12-13T22:55:22.920406+0000","last_clean":"2023-12-13T22:55:22.920406+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:22.920406+0000","last_undegraded":"2023-12-13T22:55:22.920406+0000","last_fullsized":"2023-12-13T22:55:22.920406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.022796+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:54:18.022796+0000","last_peered":"2023-12-13T22:54:18.022796+0000","last_clean":"2023-12-13T22:54:18.022796+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:54:18.022796+0000","last_undegraded":"2023-12-13T22:54:18.022796+0000","last_fullsized":"2023-12-13T22:54:18.022796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.533484+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:55:35.533484+0000","last_peered":"2023-12-13T22:55:35.533484+0000","last_clean":"2023-12-13T22:55:35.533484+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:35.533484+0000","last_undegraded":"2023-12-13T22:55:35.533484+0000","last_fullsized":"2023-12-13T22:55:35.533484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'260","reported_seq":293,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:25.440283+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:55:25.440283+0000","last_peered":"2023-12-13T22:55:25.440283+0000","last_clean":"2023-12-13T22:55:25.440283+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:55:25.440283+0000","last_undegraded":"2023-12-13T22:55:25.440283+0000","last_fullsized":"2023-12-13T22:55:25.440283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.030638+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:54:23.030638+0000","last_peered":"2023-12-13T22:54:23.030638+0000","last_clean":"2023-12-13T22:54:23.030638+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:54:23.030638+0000","last_undegraded":"2023-12-13T22:54:23.030638+0000","last_fullsized":"2023-12-13T22:54:23.030638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.610726+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:55:35.610726+0000","last_peered":"2023-12-13T22:55:35.610726+0000","last_clean":"2023-12-13T22:55:35.610726+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:55:35.610726+0000","last_undegraded":"2023-12-13T22:55:35.610726+0000","last_fullsized":"2023-12-13T22:55:35.610726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1019","reported_seq":1052,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:57.939384+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:53:57.939384+0000","last_peered":"2023-12-13T22:53:57.939384+0000","last_clean":"2023-12-13T22:53:57.939384+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:53:57.939384+0000","last_undegraded":"2023-12-13T22:53:57.939384+0000","last_fullsized":"2023-12-13T22:53:57.939384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.328801+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:54:24.328801+0000","last_peered":"2023-12-13T22:54:24.328801+0000","last_clean":"2023-12-13T22:54:24.328801+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:54:24.328801+0000","last_undegraded":"2023-12-13T22:54:24.328801+0000","last_fullsized":"2023-12-13T22:54:24.328801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.545966+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:55:35.545966+0000","last_peered":"2023-12-13T22:55:35.545966+0000","last_clean":"2023-12-13T22:55:35.545966+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:55:35.545966+0000","last_undegraded":"2023-12-13T22:55:35.545966+0000","last_fullsized":"2023-12-13T22:55:35.545966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:14.228671+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:55:14.228671+0000","last_peered":"2023-12-13T22:55:14.228671+0000","last_clean":"2023-12-13T22:55:14.228671+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:14.228671+0000","last_undegraded":"2023-12-13T22:55:14.228671+0000","last_fullsized":"2023-12-13T22:55:14.228671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.331661+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.331661+0000","last_peered":"2023-12-13T22:54:24.331661+0000","last_clean":"2023-12-13T22:54:24.331661+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.331661+0000","last_undegraded":"2023-12-13T22:54:24.331661+0000","last_fullsized":"2023-12-13T22:54:24.331661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:06:15.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.554959+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:55:35.554959+0000","last_peered":"2023-12-13T22:55:35.554959+0000","last_clean":"2023-12-13T22:55:35.554959+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:35.554959+0000","last_undegraded":"2023-12-13T22:55:35.554959+0000","last_fullsized":"2023-12-13T22:55:35.554959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:47.245339+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:54:47.245339+0000","last_peered":"2023-12-13T22:54:47.245339+0000","last_clean":"2023-12-13T22:54:47.245339+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:54:47.245339+0000","last_undegraded":"2023-12-13T22:54:47.245339+0000","last_fullsized":"2023-12-13T22:54:47.245339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.332888+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:54:24.332888+0000","last_peered":"2023-12-13T22:54:24.332888+0000","last_clean":"2023-12-13T22:54:24.332888+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:54:24.332888+0000","last_undegraded":"2023-12-13T22:54:24.332888+0000","last_fullsized":"2023-12-13T22:54:24.332888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.544167+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:55:35.544167+0000","last_peered":"2023-12-13T22:55:35.544167+0000","last_clean":"2023-12-13T22:55:35.544167+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:55:35.544167+0000","last_undegraded":"2023-12-13T22:55:35.544167+0000","last_fullsized":"2023-12-13T22:55:35.544167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1182","reported_seq":1215,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.639368+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:55:22.639368+0000","last_peered":"2023-12-13T22:55:22.639368+0000","last_clean":"2023-12-13T22:55:22.639368+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:22.639368+0000","last_undegraded":"2023-12-13T22:55:22.639368+0000","last_fullsized":"2023-12-13T22:55:22.639368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.912710+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:54:15.912710+0000","last_peered":"2023-12-13T22:54:15.912710+0000","last_clean":"2023-12-13T22:54:15.912710+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:54:15.912710+0000","last_undegraded":"2023-12-13T22:54:15.912710+0000","last_fullsized":"2023-12-13T22:54:15.912710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.598358+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:55:35.598358+0000","last_peered":"2023-12-13T22:55:35.598358+0000","last_clean":"2023-12-13T22:55:35.598358+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:35.598358+0000","last_undegraded":"2023-12-13T22:55:35.598358+0000","last_fullsized":"2023-12-13T22:55:35.598358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'128","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:26.942676+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:55:26.942676+0000","last_peered":"2023-12-13T22:55:26.942676+0000","last_clean":"2023-12-13T22:55:26.942676+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:26.942676+0000","last_undegraded":"2023-12-13T22:55:26.942676+0000","last_fullsized":"2023-12-13T22:55:26.942676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.050642+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:54:23.050642+0000","last_peered":"2023-12-13T22:54:23.050642+0000","last_clean":"2023-12-13T22:54:23.050642+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:54:23.050642+0000","last_undegraded":"2023-12-13T22:54:23.050642+0000","last_fullsized":"2023-12-13T22:54:23.050642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579291+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:55:35.579291+0000","last_peered":"2023-12-13T22:55:35.579291+0000","last_clean":"2023-12-13T22:55:35.579291+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:55:35.579291+0000","last_undegraded":"2023-12-13T22:55:35.579291+0000","last_fullsized":"2023-12-13T22:55:35.579291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:23.361395+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:55:23.361395+0000","last_peered":"2023-12-13T22:55:23.361395+0000","last_clean":"2023-12-13T22:55:23.361395+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:23.361395+0000","last_undegraded":"2023-12-13T22:55:23.361395+0000","last_fullsized":"2023-12-13T22:55:23.361395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.142382+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:54:12.142382+0000","last_peered":"2023-12-13T22:54:12.142382+0000","last_clean":"2023-12-13T22:54:12.142382+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:54:12.142382+0000","last_undegraded":"2023-12-13T22:54:12.142382+0000","last_fullsized":"2023-12-13T22:54:12.142382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.584248+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:55:35.584248+0000","last_peered":"2023-12-13T22:55:35.584248+0000","last_clean":"2023-12-13T22:55:35.584248+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:55:35.584248+0000","last_undegraded":"2023-12-13T22:55:35.584248+0000","last_fullsized":"2023-12-13T22:55:35.584248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'90","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.672608+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:55:18.672608+0000","last_peered":"2023-12-13T22:55:18.672608+0000","last_clean":"2023-12-13T22:55:18.672608+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:55:18.672608+0000","last_undegraded":"2023-12-13T22:55:18.672608+0000","last_fullsized":"2023-12-13T22:55:18.672608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721120+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:54:14.721120+0000","last_peered":"2023-12-13T22:54:14.721120+0000","last_clean":"2023-12-13T22:54:14.721120+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:54:14.721120+0000","last_undegraded":"2023-12-13T22:54:14.721120+0000","last_fullsized":"2023-12-13T22:54:14.721120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.792380+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:54:09.792380+0000","last_peered":"2023-12-13T22:54:09.792380+0000","last_clean":"2023-12-13T22:54:09.792380+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:54:09.792380+0000","last_undegraded":"2023-12-13T22:54:09.792380+0000","last_fullsized":"2023-12-13T22:54:09.792380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501460+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:55:35.501460+0000","last_peered":"2023-12-13T22:55:35.501460+0000","last_clean":"2023-12-13T22:55:35.501460+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:35.501460+0000","last_undegraded":"2023-12-13T22:55:35.501460+0000","last_fullsized":"2023-12-13T22:55:35.501460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.837794+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:54:58.837794+0000","last_peered":"2023-12-13T22:54:58.837794+0000","last_clean":"2023-12-13T22:54:58.837794+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:54:58.837794+0000","last_undegraded":"2023-12-13T22:54:58.837794+0000","last_fullsized":"2023-12-13T22:54:58.837794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.771593+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:54:08.771593+0000","last_peered":"2023-12-13T22:54:08.771593+0000","last_clean":"2023-12-13T22:54:08.771593+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:54:08.771593+0000","last_undegraded":"2023-12-13T22:54:08.771593+0000","last_fullsized":"2023-12-13T22:54:08.771593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694904+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:55:35.694904+0000","last_peered":"2023-12-13T22:55:35.694904+0000","last_clean":"2023-12-13T22:55:35.694904+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:55:35.694904+0000","last_undegraded":"2023-12-13T22:55:35.694904+0000","last_fullsized":"2023-12-13T22:55:35.694904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'209","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.336981+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:55:13.336981+0000","last_peered":"2023-12-13T22:55:13.336981+0000","last_clean":"2023-12-13T22:55:13.336981+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:55:13.336981+0000","last_undegraded":"2023-12-13T22:55:13.336981+0000","last_fullsized":"2023-12-13T22:55:13.336981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'305","reported_seq":633,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.379923+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:55:24.379923+0000","last_peered":"2023-12-13T22:55:24.379923+0000","last_clean":"2023-12-13T22:55:24.379923+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:55:24.379923+0000","last_undegraded":"2023-12-13T22:55:24.379923+0000","last_fullsized":"2023-12-13T22:55:24.379923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571431+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:55:35.571431+0000","last_peered":"2023-12-13T22:55:35.571431+0000","last_clean":"2023-12-13T22:55:35.571431+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:35.571431+0000","last_undegraded":"2023-12-13T22:55:35.571431+0000","last_fullsized":"2023-12-13T22:55:35.571431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:02.447391+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:54:02.447391+0000","last_peered":"2023-12-13T22:54:02.447391+0000","last_clean":"2023-12-13T22:54:02.447391+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:54:02.447391+0000","last_undegraded":"2023-12-13T22:54:02.447391+0000","last_fullsized":"2023-12-13T22:54:02.447391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2402","reported_seq":2434,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.131126+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:55:35.131126+0000","last_peered":"2023-12-13T22:55:35.131126+0000","last_clean":"2023-12-13T22:55:35.131126+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:55:35.131126+0000","last_undegraded":"2023-12-13T22:55:35.131126+0000","last_fullsized":"2023-12-13T22:55:35.131126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596583+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:55:35.596583+0000","last_peered":"2023-12-13T22:55:35.596583+0000","last_clean":"2023-12-13T22:55:35.596583+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:35.596583+0000","last_undegraded":"2023-12-13T22:55:35.596583+0000","last_fullsized":"2023-12-13T22:55:35.596583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:10.035655+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:54:10.035655+0000","last_peered":"2023-12-13T22:54:10.035655+0000","last_clean":"2023-12-13T22:54:10.035655+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:54:10.035655+0000","last_undegraded":"2023-12-13T22:54:10.035655+0000","last_fullsized":"2023-12-13T22:54:10.035655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624544+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:55:35.624544+0000","last_peered":"2023-12-13T22:55:35.624544+0000","last_clean":"2023-12-13T22:55:35.624544+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:55:35.624544+0000","last_undegraded":"2023-12-13T22:55:35.624544+0000","last_fullsized":"2023-12-13T22:55:35.624544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760964+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:55:35.760964+0000","last_peered":"2023-12-13T22:55:35.760964+0000","last_clean":"2023-12-13T22:55:35.760964+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:55:35.760964+0000","last_undegraded":"2023-12-13T22:55:35.760964+0000","last_fullsized":"2023-12-13T22:55:35.760964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629446+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:55:35.629446+0000","last_peered":"2023-12-13T22:55:35.629446+0000","last_clean":"2023-12-13T22:55:35.629446+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:55:35.629446+0000","last_undegraded":"2023-12-13T22:55:35.629446+0000","last_fullsized":"2023-12-13T22:55:35.629446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571494+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:55:35.571494+0000","last_peered":"2023-12-13T22:55:35.571494+0000","last_clean":"2023-12-13T22:55:35.571494+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:55:35.571494+0000","last_undegraded":"2023-12-13T22:55:35.571494+0000","last_fullsized":"2023-12-13T22:55:35.571494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.682166+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:55:35.682166+0000","last_peered":"2023-12-13T22:55:35.682166+0000","last_clean":"2023-12-13T22:55:35.682166+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:35.682166+0000","last_undegraded":"2023-12-13T22:55:35.682166+0000","last_fullsized":"2023-12-13T22:55:35.682166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501565+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:35.501565+0000","last_peered":"2023-12-13T22:55:35.501565+0000","last_clean":"2023-12-13T22:55:35.501565+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:35.501565+0000","last_undegraded":"2023-12-13T22:55:35.501565+0000","last_fullsized":"2023-12-13T22:55:35.501565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:50:11.725466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631004+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:35.631004+0000","last_peered":"2023-12-13T22:55:35.631004+0000","last_clean":"2023-12-13T22:55:35.631004+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:35.631004+0000","last_undegraded":"2023-12-13T22:55:35.631004+0000","last_fullsized":"2023-12-13T22:55:35.631004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.692125+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:55:35.692125+0000","last_peered":"2023-12-13T22:55:35.692125+0000","last_clean":"2023-12-13T22:55:35.692125+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:35.692125+0000","last_undegraded":"2023-12-13T22:55:35.692125+0000","last_fullsized":"2023-12-13T22:55:35.692125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632243+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:55:35.632243+0000","last_peered":"2023-12-13T22:55:35.632243+0000","last_clean":"2023-12-13T22:55:35.632243+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:55:35.632243+0000","last_undegraded":"2023-12-13T22:55:35.632243+0000","last_fullsized":"2023-12-13T22:55:35.632243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698720+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:55:35.698720+0000","last_peered":"2023-12-13T22:55:35.698720+0000","last_clean":"2023-12-13T22:55:35.698720+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698720+0000","last_undegraded":"2023-12-13T22:55:35.698720+0000","last_fullsized":"2023-12-13T22:55:35.698720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.630133+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:55:35.630133+0000","last_peered":"2023-12-13T22:55:35.630133+0000","last_clean":"2023-12-13T22:55:35.630133+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:55:35.630133+0000","last_undegraded":"2023-12-13T22:55:35.630133+0000","last_fullsized":"2023-12-13T22:55:35.630133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.572832+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:55:35.572832+0000","last_peered":"2023-12-13T22:55:35.572832+0000","last_clean":"2023-12-13T22:55:35.572832+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:55:35.572832+0000","last_undegraded":"2023-12-13T22:55:35.572832+0000","last_fullsized":"2023-12-13T22:55:35.572832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624383+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:55:35.624383+0000","last_peered":"2023-12-13T22:55:35.624383+0000","last_clean":"2023-12-13T22:55:35.624383+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:55:35.624383+0000","last_undegraded":"2023-12-13T22:55:35.624383+0000","last_fullsized":"2023-12-13T22:55:35.624383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543937+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.543937+0000","last_peered":"2023-12-13T22:55:35.543937+0000","last_clean":"2023-12-13T22:55:35.543937+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.543937+0000","last_undegraded":"2023-12-13T22:55:35.543937+0000","last_fullsized":"2023-12-13T22:55:35.543937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.761801+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:55:35.761801+0000","last_peered":"2023-12-13T22:55:35.761801+0000","last_clean":"2023-12-13T22:55:35.761801+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:55:35.761801+0000","last_undegraded":"2023-12-13T22:55:35.761801+0000","last_fullsized":"2023-12-13T22:55:35.761801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.758757+0000","last_change":"2023-12-13T22:27:03.509440+0000","last_active":"2023-12-13T22:55:35.758757+0000","last_peered":"2023-12-13T22:55:35.758757+0000","last_clean":"2023-12-13T22:55:35.758757+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:55:35.758757+0000","last_undegraded":"2023-12-13T22:55:35.758757+0000","last_fullsized":"2023-12-13T22:55:35.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632293+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:55:35.632293+0000","last_peered":"2023-12-13T22:55:35.632293+0000","last_clean":"2023-12-13T22:55:35.632293+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:55:35.632293+0000","last_undegraded":"2023-12-13T22:55:35.632293+0000","last_fullsized":"2023-12-13T22:55:35.632293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.502094+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:55:35.502094+0000","last_peered":"2023-12-13T22:55:35.502094+0000","last_clean":"2023-12-13T22:55:35.502094+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:55:35.502094+0000","last_undegraded":"2023-12-13T22:55:35.502094+0000","last_fullsized":"2023-12-13T22:55:35.502094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555981+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:55:35.555981+0000","last_peered":"2023-12-13T22:55:35.555981+0000","last_clean":"2023-12-13T22:55:35.555981+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:35.555981+0000","last_undegraded":"2023-12-13T22:55:35.555981+0000","last_fullsized":"2023-12-13T22:55:35.555981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698035+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:55:35.698035+0000","last_peered":"2023-12-13T22:55:35.698035+0000","last_clean":"2023-12-13T22:55:35.698035+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:35.698035+0000","last_undegraded":"2023-12-13T22:55:35.698035+0000","last_fullsized":"2023-12-13T22:55:35.698035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614921+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:55:35.614921+0000","last_peered":"2023-12-13T22:55:35.614921+0000","last_clean":"2023-12-13T22:55:35.614921+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:55:35.614921+0000","last_undegraded":"2023-12-13T22:55:35.614921+0000","last_fullsized":"2023-12-13T22:55:35.614921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.635444+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:55:35.635444+0000","last_peered":"2023-12-13T22:55:35.635444+0000","last_clean":"2023-12-13T22:55:35.635444+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:55:35.635444+0000","last_undegraded":"2023-12-13T22:55:35.635444+0000","last_fullsized":"2023-12-13T22:55:35.635444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631587+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631587+0000","last_peered":"2023-12-13T22:55:35.631587+0000","last_clean":"2023-12-13T22:55:35.631587+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631587+0000","last_undegraded":"2023-12-13T22:55:35.631587+0000","last_fullsized":"2023-12-13T22:55:35.631587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580534+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580534+0000","last_peered":"2023-12-13T22:55:35.580534+0000","last_clean":"2023-12-13T22:55:35.580534+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580534+0000","last_undegraded":"2023-12-13T22:55:35.580534+0000","last_fullsized":"2023-12-13T22:55:35.580534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698947+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:55:35.698947+0000","last_peered":"2023-12-13T22:55:35.698947+0000","last_clean":"2023-12-13T22:55:35.698947+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698947+0000","last_undegraded":"2023-12-13T22:55:35.698947+0000","last_fullsized":"2023-12-13T22:55:35.698947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.532526+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:55:35.532526+0000","last_peered":"2023-12-13T22:55:35.532526+0000","last_clean":"2023-12-13T22:55:35.532526+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:55:35.532526+0000","last_undegraded":"2023-12-13T22:55:35.532526+0000","last_fullsized":"2023-12-13T22:55:35.532526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760342+0000","last_change":"2023-12-13T22:27:03.070128+0000","last_active":"2023-12-13T22:55:35.760342+0000","last_peered":"2023-12-13T22:55:35.760342+0000","last_clean":"2023-12-13T22:55:35.760342+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:55:35.760342+0000","last_undegraded":"2023-12-13T22:55:35.760342+0000","last_fullsized":"2023-12-13T22:55:35.760342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539165+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:55:35.539165+0000","last_peered":"2023-12-13T22:55:35.539165+0000","last_clean":"2023-12-13T22:55:35.539165+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:55:35.539165+0000","last_undegraded":"2023-12-13T22:55:35.539165+0000","last_fullsized":"2023-12-13T22:55:35.539165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631457+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:55:35.631457+0000","last_peered":"2023-12-13T22:55:35.631457+0000","last_clean":"2023-12-13T22:55:35.631457+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:55:35.631457+0000","last_undegraded":"2023-12-13T22:55:35.631457+0000","last_fullsized":"2023-12-13T22:55:35.631457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555896+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:55:35.555896+0000","last_peered":"2023-12-13T22:55:35.555896+0000","last_clean":"2023-12-13T22:55:35.555896+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:55:35.555896+0000","last_undegraded":"2023-12-13T22:55:35.555896+0000","last_fullsized":"2023-12-13T22:55:35.555896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503529+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:55:35.503529+0000","last_peered":"2023-12-13T22:55:35.503529+0000","last_clean":"2023-12-13T22:55:35.503529+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:55:35.503529+0000","last_undegraded":"2023-12-13T22:55:35.503529+0000","last_fullsized":"2023-12-13T22:55:35.503529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.538999+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.538999+0000","last_peered":"2023-12-13T22:55:35.538999+0000","last_clean":"2023-12-13T22:55:35.538999+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.538999+0000","last_undegraded":"2023-12-13T22:55:35.538999+0000","last_fullsized":"2023-12-13T22:55:35.538999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8033,"ondisk_log_size":8033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477106,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.38100000000000001},"max":{"1min":1.3180000000000001,"5min":1.73,"15min":1.7689999999999999},"last":1.294},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.65100000000000002,"5min":0.55900000000000005,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.2150000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.628,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.2350000000000001,"5min":2.165,"15min":2.165},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.022,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.63300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.369,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.036}]},{"osd":2,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97299999999999998,"15min":0.97699999999999998},"min":{"1min":0.66000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.361,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.383,"5min":1.649,"15min":2.1269999999999998},"last":1.472}]},{"osd":3,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.76700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.792,"15min":1.792},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0069999999999999,"15min":1.032},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.3700000000000001,"5min":1.496,"15min":2.996},"last":1.373}]},{"osd":4,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.6819999999999999,"5min":1.847,"15min":1.8480000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.8120000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.04},"min":{"1min":0.68100000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6339999999999999,"15min":2.21},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.111,"15min":1.107},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.591,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.335}]},{"osd":6,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.145,"15min":1.143},"min":{"1min":0.77100000000000002,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.506,"5min":2.056,"15min":2.0590000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.133,"15min":1.129},"min":{"1min":0.60599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.73,"5min":1.798,"15min":2.169},"last":1.2669999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477106,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.67400000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.272,"5min":1.575,"15min":2.1970000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.3109999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.008}]},{"osd":1,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.873,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.319,"15min":1.5109999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.0289999999999999,"15min":1.0129999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":1.1519999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4650000000000001,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.04,"15min":1.014},"min":{"1min":0.79100000000000004,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.506,"5min":1.506,"15min":1.8540000000000001},"last":1.1180000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0700000000000001,"15min":1.0649999999999999},"min":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.44800000000000001},"max":{"1min":1.4930000000000001,"5min":1.587,"15min":1.841},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.3320000000000001,"5min":1.405,"15min":1.784},"last":1.044}]},{"osd":4,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.755,"5min":0.47499999999999998,"15min":0.375},"max":{"1min":1.6279999999999999,"5min":1.7350000000000001,"15min":2.504},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.72799999999999998,"5min":0.47099999999999997,"15min":0.33000000000000002},"max":{"1min":1.5569999999999999,"5min":1.708,"15min":2.044},"last":0.72499999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.63200000000000001,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.9239999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1879999999999999,"15min":1.2010000000000001},"min":{"1min":0.72499999999999998,"5min":0.52200000000000002,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.093}]},{"osd":7,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.21,"15min":1.2},"min":{"1min":0.69799999999999995,"5min":0.45000000000000001,"15min":0.42299999999999999},"max":{"1min":1.6339999999999999,"5min":1.766,"15min":2.956},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.99399999999999999,"5min":0.495,"15min":0.442},"max":{"1min":1.6779999999999999,"5min":1.788,"15min":1.9350000000000001},"last":0.88300000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477106,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.264,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.494},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.75800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.667},"last":2.157},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93999999999999995,"15min":0.96899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.123},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.69099999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.4350000000000001,"15min":1.5009999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.57499999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.599},"last":0.755},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3360000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89400000000000002,"15min":0.92500000000000004},"min":{"1min":0.57199999999999995,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3779999999999999,"5min":1.482,"15min":1.53},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":2.2959999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.024,"15min":1.0680000000000001},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.63300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.466,"5min":1.552,"15min":1.8480000000000001},"last":1.0189999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.1459999999999999},"min":{"1min":0.60199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.9339999999999999},"last":2.2469999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.24}]}]},{"osd":4,"up_from":16,"seq":68719477107,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.879,"15min":0.91200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90700000000000003,"15min":0.90200000000000002},"min":{"1min":0.64200000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3220000000000001,"5min":1.3759999999999999,"15min":1.488},"last":0.61499999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95099999999999996},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.242,"5min":1.75,"15min":1.75},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.997,"15min":1.002},"min":{"1min":0.71399999999999997,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.22,"5min":1.4299999999999999,"15min":1.831},"last":0.871}]},{"osd":2,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.65200000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.2470000000000001,"5min":1.371,"15min":1.645},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.0309999999999999,"15min":1.04},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.423,"5min":1.5149999999999999,"15min":1.75},"last":1.012}]},{"osd":3,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.96299999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.194,"5min":1.639,"15min":1.639},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.103,"5min":1.097,"15min":1.1220000000000001},"min":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.3899999999999999,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.63400000000000001,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.51,"5min":2.218,"15min":2.218},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0349999999999999},"min":{"1min":0.63600000000000001,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.464,"5min":1.5,"15min":1.643},"last":0.81000000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":1.0680000000000001},"min":{"1min":0.60999999999999999,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.595,"5min":2.137,"15min":2.137},"last":1.0580000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1020000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.61599999999999999,"15min":0.504},"max":{"1min":1.585,"5min":1.8049999999999999,"15min":1.857},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.171,"5min":1.1879999999999999,"15min":1.2070000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.833,"5min":1.927,"15min":2.3079999999999998},"last":0.77600000000000002}]}]},{"osd":3,"up_from":16,"seq":68719477106,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.628},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.081,"5min":1.3149999999999999,"15min":1.524},"last":0.81699999999999995}]},{"osd":1,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88200000000000001,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3859999999999999,"15min":1.4379999999999999},"last":0.94199999999999995}]},{"osd":2,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.86699999999999999},"min":{"1min":0.61599999999999999,"5min":0.373,"15min":0.34200000000000003},"max":{"1min":1.085,"5min":1.3029999999999999,"15min":5.085},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95099999999999996,"15min":0.92900000000000005},"min":{"1min":0.63600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.84799999999999998}]},{"osd":4,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.81599999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3069999999999999,"5min":1.6359999999999999,"15min":1.77},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3180000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":1.1879999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0800000000000001,"15min":1.091},"min":{"1min":0.76800000000000002,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.3919999999999999,"5min":1.532,"15min":1.8400000000000001},"last":1.085},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1830000000000001,"15min":1.177},"min":{"1min":0.84999999999999998,"5min":0.63200000000000001,"15min":0.38200000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.069}]},{"osd":6,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.23,"15min":1.204},"min":{"1min":0.98999999999999999,"5min":0.60299999999999998,"15min":0.47199999999999998},"max":{"1min":1.5720000000000001,"5min":1.8149999999999999,"15min":2.181},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.96399999999999997,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.407,"5min":1.742,"15min":2.1230000000000002},"last":1.1419999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.81699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4870000000000001,"5min":1.841,"15min":2.1779999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0189999999999999,"5min":0.65200000000000002,"15min":0.55600000000000005},"max":{"1min":1.5169999999999999,"5min":1.7909999999999999,"15min":1.948},"last":1.2809999999999999}]}]},{"osd":1,"up_from":16,"seq":68719477107,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53000000000000003,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":1.054,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.67400000000000004}]},{"osd":2,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1559999999999999,"5min":1.401,"15min":1.5580000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.397,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.874}]},{"osd":3,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1160000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.872,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.308,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0049999999999999,"15min":1.0089999999999999},"min":{"1min":0.746,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.3169999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.60299999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3260000000000001,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":0.95399999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0609999999999999,"15min":1.089},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.6599999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.181,"15min":1.1799999999999999},"min":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"max":{"1min":1.4710000000000001,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.528}]},{"osd":6,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.117},"min":{"1min":0.79000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.468,"5min":1.706,"15min":1.7649999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.66400000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.4339999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.585}]},{"osd":7,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.88500000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.409,"5min":1.8,"15min":1.8520000000000001},"last":1.131},{"interface":"front","average":{"1min":1.095,"5min":1.1519999999999999,"15min":1.173},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4239999999999999,"5min":2.774,"15min":2.774},"last":1.0369999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509809,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.24,"5min":1.24,"15min":2.8730000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80400000000000005,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.964},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.97399999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.873,"15min":0.86599999999999999},"min":{"1min":0.57099999999999995,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93600000000000005},"min":{"1min":0.51600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93300000000000005,"15min":0.94899999999999995},"min":{"1min":0.70899999999999996,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.718,"5min":1.718,"15min":1.869},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0509999999999999,"15min":1.0620000000000001},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.635,"5min":1.722,"15min":1.8340000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.625,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.6699999999999999,"5min":1.772,"15min":2.1030000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0629999999999999,"15min":1.0860000000000001},"min":{"1min":0.66800000000000004,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.635,"5min":1.635,"15min":2.0779999999999998},"last":1.1339999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.147,"15min":1.153},"min":{"1min":0.79800000000000004,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.5640000000000001,"5min":1.776,"15min":1.835},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.121,"5min":1.129,"15min":1.1459999999999999},"min":{"1min":0.66900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.754,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.0860000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1819999999999999,"15min":1.1919999999999999},"min":{"1min":0.80700000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6899999999999999,"5min":1.704,"15min":2.5640000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.179,"15min":1.214},"min":{"1min":0.89900000000000002,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.573,"5min":1.986,"15min":5.3310000000000004},"last":1.0369999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542513,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":1.048,"5min":1.897,"15min":1.897},"last":0.754},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.77000000000000002},"min":{"1min":0.51700000000000002,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.099,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Dec 13 22:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89400000000000002,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.872,"15min":0.874},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.79,"5min":1.79,"15min":1.9099999999999999},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":0.91900000000000004},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.0680000000000001,"5min":1.867,"15min":2.6320000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92400000000000004,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":2.0659999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.71199999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.4490000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1850000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.099,"15min":1.0760000000000001},"min":{"1min":0.70999999999999996,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.5309999999999999,"5min":1.554,"15min":1.625},"last":1.268},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.53000000000000003,"15min":0.46800000000000003},"max":{"1min":1.5049999999999999,"5min":2.0259999999999998,"15min":2.1539999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.139,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.8420000000000001,"15min":2.2250000000000001},"last":1.151},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.232,"15min":1.212},"min":{"1min":0.93799999999999994,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5669999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.91800000000000004,"5min":0.56899999999999995,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.504},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.232,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6419999999999999,"5min":2.1259999999999999,"15min":2.339},"last":1.232}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:55:42.899 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-13T22:55:42.899 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:55:43.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.055+0000 7f2a1b844640 1 Processor -- start 2023-12-13T22:55:43.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.055+0000 7f2a1b844640 1 -- start start 2023-12-13T22:55:43.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a1b844640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2a140c4630 0x7f2a140c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a1b844640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a14156dc0 0x7f2a1414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.056 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a1b844640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140c72b0 con 0x7f2a140c4a10 2023-12-13T22:55:43.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a1b844640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a140c4f40 con 0x7f2a140c4630 2023-12-13T22:55:43.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a1b844640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1415a6c0 con 0x7f2a14156dc0 2023-12-13T22:55:43.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a18ddf640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f2a140c4a10 0x7f2a141596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56226/0 (socket says 172.21.15.91:56226) 2023-12-13T22:55:43.057 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a18ddf640 1 -- 172.21.15.91:0/136504511 learned_addr learned my addr 172.21.15.91:0/136504511 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:43.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a195e0640 1 --2- 172.21.15.91:0/136504511 >> v2:172.21.15.91:3300/0 conn(0x7f2a140c4630 0x7f2a140c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.058 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.059+0000 7f2a19de1640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a14156dc0 0x7f2a1414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.063+0000 7f2a195e0640 1 -- 172.21.15.91:0/136504511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a14156dc0 msgr2=0x7f2a1414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.063+0000 7f2a195e0640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a14156dc0 0x7f2a1414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.063+0000 7f2a195e0640 1 -- 172.21.15.91:0/136504511 >> v1:172.21.15.91:6789/0 conn(0x7f2a140c4a10 legacy=0x7f2a141596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.063+0000 7f2a195e0640 1 -- 172.21.15.91:0/136504511 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1415a100 con 0x7f2a140c4630 2023-12-13T22:55:43.066 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.067+0000 7f2a195e0640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a140c4630 0x7f2a140c6d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a100097c0 tx=0x7f2a1001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a908f7227657a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a0bfff640 1 -- 172.21.15.91:0/136504511 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100a8970 con 0x7f2a140c4630 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a0bfff640 1 -- 172.21.15.91:0/136504511 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a100a8ad0 con 0x7f2a140c4630 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a0bfff640 1 -- 172.21.15.91:0/136504511 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100a8e60 con 0x7f2a140c4630 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 -- 172.21.15.91:0/136504511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a140c4630 msgr2=0x7f2a140c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a140c4630 0x7f2a140c6d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a100097c0 tx=0x7f2a1001ec70 comp rx=0 tx=0).stop 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 -- 172.21.15.91:0/136504511 shutdown_connections 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a14156dc0 0x7f2a1414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 --2- 172.21.15.91:0/136504511 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a140c4630 0x7f2a140c6d70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 -- 172.21.15.91:0/136504511 >> 172.21.15.91:0/136504511 conn(0x7f2a1406c6a0 msgr2=0x7f2a1406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 -- 172.21.15.91:0/136504511 shutdown_connections 2023-12-13T22:55:43.072 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.071+0000 7f2a1b844640 1 -- 172.21.15.91:0/136504511 wait complete. 2023-12-13T22:55:43.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 Processor -- start 2023-12-13T22:55:43.073 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 -- start start 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a140c4630 0x7f2a140c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a140c4a10 0x7f2a14155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140c9070 con 0x7f2a14156dc0 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140724e0 con 0x7f2a140c4a10 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a1b844640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14070c50 con 0x7f2a140c4630 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a19de1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a19de1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57164/0 (socket says 172.21.15.91:57164) 2023-12-13T22:55:43.074 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a19de1640 1 -- 172.21.15.91:0/2608725692 learned_addr learned my addr 172.21.15.91:0/2608725692 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:43.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.075+0000 7f2a18ddf640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a140c4a10 0x7f2a14155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a195e0640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a140c4630 0x7f2a140c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a19de1640 1 -- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a140c4630 msgr2=0x7f2a140c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a19de1640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a140c4630 0x7f2a140c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a19de1640 1 -- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a140c4a10 msgr2=0x7f2a14155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a19de1640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a140c4a10 0x7f2a14155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.078 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.079+0000 7f2a19de1640 1 -- 172.21.15.91:0/2608725692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10009420 con 0x7f2a14156dc0 2023-12-13T22:55:43.080 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.083+0000 7f2a19de1640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00efc0 tx=0x7f2a0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:43.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c009ba0 con 0x7f2a14156dc0 2023-12-13T22:55:43.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00f040 con 0x7f2a14156dc0 2023-12-13T22:55:43.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0146c0 con 0x7f2a14156dc0 2023-12-13T22:55:43.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a14155c40 con 0x7f2a14156dc0 2023-12-13T22:55:43.084 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a14154f00 con 0x7f2a14156dc0 2023-12-13T22:55:43.085 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.087+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a14067520 con 0x7f2a14156dc0 2023-12-13T22:55:43.104 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.107+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2a0c014820 con 0x7f2a14156dc0 2023-12-13T22:55:43.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.107+0000 7f2a09ffb640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 0x7f29f8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.107+0000 7f2a195e0640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 0x7f29f8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.107+0000 7f2a195e0640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 0x7f29f8068d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a100b2000 tx=0x7f2a10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:43.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.347+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a0c056200 con 0x7f2a14156dc0 2023-12-13T22:55:43.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.347+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2a0c052540 con 0x7f2a14156dc0 2023-12-13T22:55:43.517 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.519+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a141565c0 con 0x7f29f8066840 2023-12-13T22:55:43.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.535+0000 7f2a09ffb640 1 -- 172.21.15.91:0/2608725692 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368681 (secure 0 0 0) 0x7f2a100b04c0 con 0x7f29f8066840 2023-12-13T22:55:43.536 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:43.538 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 msgr2=0x7f29f8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 0x7f29f8068d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a100b2000 tx=0x7f2a10008040 comp rx=0 tx=0).stop 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 msgr2=0x7f2a141e0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00efc0 tx=0x7f2a0c00c490 comp rx=0 tx=0).stop 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 shutdown_connections 2023-12-13T22:55:43.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f29f8066840 0x7f29f8068d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f2a14156dc0 0x7f2a141e0900 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a140c4a10 0x7f2a14155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 --2- 172.21.15.91:0/2608725692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a140c4630 0x7f2a140c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 >> 172.21.15.91:0/2608725692 conn(0x7f2a1406c6a0 msgr2=0x7f2a140c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 shutdown_connections 2023-12-13T22:55:43.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.539+0000 7f2a1b844640 1 -- 172.21.15.91:0/2608725692 wait complete. 2023-12-13T22:55:43.554 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":942,"stamp":"2023-12-13T22:55:43.347645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13422,"ondisk_log_size":13422,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10974,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":22,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004706"},"pg_stats":[{"pgid":"2.1f","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.805619+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:55:09.805619+0000","last_peered":"2023-12-13T22:55:09.805619+0000","last_clean":"2023-12-13T22:55:09.805619+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:09.805619+0000","last_undegraded":"2023-12-13T22:55:09.805619+0000","last_fullsized":"2023-12-13T22:55:09.805619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:51:40.105635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.688943+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:55:35.688943+0000","last_peered":"2023-12-13T22:55:35.688943+0000","last_clean":"2023-12-13T22:55:35.688943+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:35.688943+0000","last_undegraded":"2023-12-13T22:55:35.688943+0000","last_fullsized":"2023-12-13T22:55:35.688943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.696675+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:54:15.696675+0000","last_peered":"2023-12-13T22:54:15.696675+0000","last_clean":"2023-12-13T22:54:15.696675+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:54:15.696675+0000","last_undegraded":"2023-12-13T22:54:15.696675+0000","last_fullsized":"2023-12-13T22:54:15.696675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:33:08.620758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":592,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.112249+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:55:35.112249+0000","last_peered":"2023-12-13T22:55:35.112249+0000","last_clean":"2023-12-13T22:55:35.112249+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:55:35.112249+0000","last_undegraded":"2023-12-13T22:55:35.112249+0000","last_fullsized":"2023-12-13T22:55:35.112249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579225+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:55:35.579225+0000","last_peered":"2023-12-13T22:55:35.579225+0000","last_clean":"2023-12-13T22:55:35.579225+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:35.579225+0000","last_undegraded":"2023-12-13T22:55:35.579225+0000","last_fullsized":"2023-12-13T22:55:35.579225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:05:11.989995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.333132+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:54:24.333132+0000","last_peered":"2023-12-13T22:54:24.333132+0000","last_clean":"2023-12-13T22:54:24.333132+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:54:24.333132+0000","last_undegraded":"2023-12-13T22:54:24.333132+0000","last_fullsized":"2023-12-13T22:54:24.333132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:33.136491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'12","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.221109+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:55:13.221109+0000","last_peered":"2023-12-13T22:55:13.221109+0000","last_clean":"2023-12-13T22:55:13.221109+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:55:13.221109+0000","last_undegraded":"2023-12-13T22:55:13.221109+0000","last_fullsized":"2023-12-13T22:55:13.221109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631543+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:55:35.631543+0000","last_peered":"2023-12-13T22:55:35.631543+0000","last_clean":"2023-12-13T22:55:35.631543+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:55:35.631543+0000","last_undegraded":"2023-12-13T22:55:35.631543+0000","last_fullsized":"2023-12-13T22:55:35.631543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:01.514801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:06.394820+0000","last_change":"2023-12-13T22:27:03.108442+0000","last_active":"2023-12-13T22:54:06.394820+0000","last_peered":"2023-12-13T22:54:06.394820+0000","last_clean":"2023-12-13T22:54:06.394820+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:54:06.394820+0000","last_undegraded":"2023-12-13T22:54:06.394820+0000","last_fullsized":"2023-12-13T22:54:06.394820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:43.918776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.539803+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:54:58.539803+0000","last_peered":"2023-12-13T22:54:58.539803+0000","last_clean":"2023-12-13T22:54:58.539803+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:54:58.539803+0000","last_undegraded":"2023-12-13T22:54:58.539803+0000","last_fullsized":"2023-12-13T22:54:58.539803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638381+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:55:35.638381+0000","last_peered":"2023-12-13T22:55:35.638381+0000","last_clean":"2023-12-13T22:55:35.638381+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:55:35.638381+0000","last_undegraded":"2023-12-13T22:55:35.638381+0000","last_fullsized":"2023-12-13T22:55:35.638381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.679608+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:54:15.679608+0000","last_peered":"2023-12-13T22:54:15.679608+0000","last_clean":"2023-12-13T22:54:15.679608+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:54:15.679608+0000","last_undegraded":"2023-12-13T22:54:15.679608+0000","last_fullsized":"2023-12-13T22:54:15.679608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:59.009538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624367+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:55:35.624367+0000","last_peered":"2023-12-13T22:55:35.624367+0000","last_clean":"2023-12-13T22:55:35.624367+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:55:35.624367+0000","last_undegraded":"2023-12-13T22:55:35.624367+0000","last_fullsized":"2023-12-13T22:55:35.624367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'671","reported_seq":705,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.116962+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:55:35.116962+0000","last_peered":"2023-12-13T22:55:35.116962+0000","last_clean":"2023-12-13T22:55:35.116962+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:55:35.116962+0000","last_undegraded":"2023-12-13T22:55:35.116962+0000","last_fullsized":"2023-12-13T22:55:35.116962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.953445+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:54:15.953445+0000","last_peered":"2023-12-13T22:54:15.953445+0000","last_clean":"2023-12-13T22:54:15.953445+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:54:15.953445+0000","last_undegraded":"2023-12-13T22:54:15.953445+0000","last_fullsized":"2023-12-13T22:54:15.953445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.697096+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:55:35.697096+0000","last_peered":"2023-12-13T22:55:35.697096+0000","last_clean":"2023-12-13T22:55:35.697096+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:55:35.697096+0000","last_undegraded":"2023-12-13T22:55:35.697096+0000","last_fullsized":"2023-12-13T22:55:35.697096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:43.414397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'230","reported_seq":264,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.535151+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:55:13.535151+0000","last_peered":"2023-12-13T22:55:13.535151+0000","last_clean":"2023-12-13T22:55:13.535151+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:13.535151+0000","last_undegraded":"2023-12-13T22:55:13.535151+0000","last_fullsized":"2023-12-13T22:55:13.535151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:16.899782+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:54:16.899782+0000","last_peered":"2023-12-13T22:54:16.899782+0000","last_clean":"2023-12-13T22:54:16.899782+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:54:16.899782+0000","last_undegraded":"2023-12-13T22:54:16.899782+0000","last_fullsized":"2023-12-13T22:54:16.899782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698820+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:55:35.698820+0000","last_peered":"2023-12-13T22:55:35.698820+0000","last_clean":"2023-12-13T22:55:35.698820+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:55:35.698820+0000","last_undegraded":"2023-12-13T22:55:35.698820+0000","last_fullsized":"2023-12-13T22:55:35.698820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'165","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.241562+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:55:13.241562+0000","last_peered":"2023-12-13T22:55:13.241562+0000","last_clean":"2023-12-13T22:55:13.241562+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:55:13.241562+0000","last_undegraded":"2023-12-13T22:55:13.241562+0000","last_fullsized":"2023-12-13T22:55:13.241562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:47:42.302607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.078027+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:54:15.078027+0000","last_peered":"2023-12-13T22:54:15.078027+0000","last_clean":"2023-12-13T22:54:15.078027+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:54:15.078027+0000","last_undegraded":"2023-12-13T22:54:15.078027+0000","last_fullsized":"2023-12-13T22:54:15.078027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:20.392469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.457436+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:55:35.457436+0000","last_peered":"2023-12-13T22:55:35.457436+0000","last_clean":"2023-12-13T22:55:35.457436+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:35.457436+0000","last_undegraded":"2023-12-13T22:55:35.457436+0000","last_fullsized":"2023-12-13T22:55:35.457436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:37:44.369032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.867630+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:55:09.867630+0000","last_peered":"2023-12-13T22:55:09.867630+0000","last_clean":"2023-12-13T22:55:09.867630+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:09.867630+0000","last_undegraded":"2023-12-13T22:55:09.867630+0000","last_fullsized":"2023-12-13T22:55:09.867630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.389221+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:54:24.389221+0000","last_peered":"2023-12-13T22:54:24.389221+0000","last_clean":"2023-12-13T22:54:24.389221+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:54:24.389221+0000","last_undegraded":"2023-12-13T22:54:24.389221+0000","last_fullsized":"2023-12-13T22:54:24.389221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555941+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:55:35.555941+0000","last_peered":"2023-12-13T22:55:35.555941+0000","last_clean":"2023-12-13T22:55:35.555941+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:35.555941+0000","last_undegraded":"2023-12-13T22:55:35.555941+0000","last_fullsized":"2023-12-13T22:55:35.555941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:50:16.182862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'9","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.637577+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:55:12.637577+0000","last_peered":"2023-12-13T22:55:12.637577+0000","last_clean":"2023-12-13T22:55:12.637577+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:12.637577+0000","last_undegraded":"2023-12-13T22:55:12.637577+0000","last_fullsized":"2023-12-13T22:55:12.637577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.399554+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:54:24.399554+0000","last_peered":"2023-12-13T22:54:24.399554+0000","last_clean":"2023-12-13T22:54:24.399554+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:54:24.399554+0000","last_undegraded":"2023-12-13T22:54:24.399554+0000","last_fullsized":"2023-12-13T22:54:24.399554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:55.939019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694184+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:55:35.694184+0000","last_peered":"2023-12-13T22:55:35.694184+0000","last_clean":"2023-12-13T22:55:35.694184+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:55:35.694184+0000","last_undegraded":"2023-12-13T22:55:35.694184+0000","last_fullsized":"2023-12-13T22:55:35.694184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'188","reported_seq":222,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:29.793234+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:55:29.793234+0000","last_peered":"2023-12-13T22:55:29.793234+0000","last_clean":"2023-12-13T22:55:29.793234+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:55:29.793234+0000","last_undegraded":"2023-12-13T22:55:29.793234+0000","last_fullsized":"2023-12-13T22:55:29.793234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.864556+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:54:12.864556+0000","last_peered":"2023-12-13T22:54:12.864556+0000","last_clean":"2023-12-13T22:54:12.864556+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:54:12.864556+0000","last_undegraded":"2023-12-13T22:54:12.864556+0000","last_fullsized":"2023-12-13T22:54:12.864556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:40:51.174187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501731+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:55:35.501731+0000","last_peered":"2023-12-13T22:55:35.501731+0000","last_clean":"2023-12-13T22:55:35.501731+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:55:35.501731+0000","last_undegraded":"2023-12-13T22:55:35.501731+0000","last_fullsized":"2023-12-13T22:55:35.501731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:31.335556+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:54:31.335556+0000","last_peered":"2023-12-13T22:54:31.335556+0000","last_clean":"2023-12-13T22:54:31.335556+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:54:31.335556+0000","last_undegraded":"2023-12-13T22:54:31.335556+0000","last_fullsized":"2023-12-13T22:54:31.335556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.279383+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:54:24.279383+0000","last_peered":"2023-12-13T22:54:24.279383+0000","last_clean":"2023-12-13T22:54:24.279383+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:54:24.279383+0000","last_undegraded":"2023-12-13T22:54:24.279383+0000","last_fullsized":"2023-12-13T22:54:24.279383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:06:57.952201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638034+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:55:35.638034+0000","last_peered":"2023-12-13T22:55:35.638034+0000","last_clean":"2023-12-13T22:55:35.638034+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:55:35.638034+0000","last_undegraded":"2023-12-13T22:55:35.638034+0000","last_fullsized":"2023-12-13T22:55:35.638034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.641222+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:55:18.641222+0000","last_peered":"2023-12-13T22:55:18.641222+0000","last_clean":"2023-12-13T22:55:18.641222+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:55:18.641222+0000","last_undegraded":"2023-12-13T22:55:18.641222+0000","last_fullsized":"2023-12-13T22:55:18.641222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:51.482445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.467825+0000","last_change":"2023-12-13T22:27:03.566251+0000","last_active":"2023-12-13T22:54:09.467825+0000","last_peered":"2023-12-13T22:54:09.467825+0000","last_clean":"2023-12-13T22:54:09.467825+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:54:09.467825+0000","last_undegraded":"2023-12-13T22:54:09.467825+0000","last_fullsized":"2023-12-13T22:54:09.467825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596787+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:55:35.596787+0000","last_peered":"2023-12-13T22:55:35.596787+0000","last_clean":"2023-12-13T22:55:35.596787+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:35.596787+0000","last_undegraded":"2023-12-13T22:55:35.596787+0000","last_fullsized":"2023-12-13T22:55:35.596787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:03.208601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.064015+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:55:08.064015+0000","last_peered":"2023-12-13T22:55:08.064015+0000","last_clean":"2023-12-13T22:55:08.064015+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:08.064015+0000","last_undegraded":"2023-12-13T22:55:08.064015+0000","last_fullsized":"2023-12-13T22:55:08.064015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:50.631984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.871697+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:54:12.871697+0000","last_peered":"2023-12-13T22:54:12.871697+0000","last_clean":"2023-12-13T22:54:12.871697+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:54:12.871697+0000","last_undegraded":"2023-12-13T22:54:12.871697+0000","last_fullsized":"2023-12-13T22:54:12.871697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:57.761196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501224+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:55:35.501224+0000","last_peered":"2023-12-13T22:55:35.501224+0000","last_clean":"2023-12-13T22:55:35.501224+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:55:35.501224+0000","last_undegraded":"2023-12-13T22:55:35.501224+0000","last_fullsized":"2023-12-13T22:55:35.501224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'252","reported_seq":440,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.009575+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:55:32.009575+0000","last_peered":"2023-12-13T22:55:32.009575+0000","last_clean":"2023-12-13T22:55:32.009575+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:32.009575+0000","last_undegraded":"2023-12-13T22:55:32.009575+0000","last_fullsized":"2023-12-13T22:55:32.009575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721359+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:54:14.721359+0000","last_peered":"2023-12-13T22:54:14.721359+0000","last_clean":"2023-12-13T22:54:14.721359+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:54:14.721359+0000","last_undegraded":"2023-12-13T22:54:14.721359+0000","last_fullsized":"2023-12-13T22:54:14.721359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:10:02.304802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.567799+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:55:35.567799+0000","last_peered":"2023-12-13T22:55:35.567799+0000","last_clean":"2023-12-13T22:55:35.567799+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:35.567799+0000","last_undegraded":"2023-12-13T22:55:35.567799+0000","last_fullsized":"2023-12-13T22:55:35.567799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:49:11.686498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.540014+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:54:58.540014+0000","last_peered":"2023-12-13T22:54:58.540014+0000","last_clean":"2023-12-13T22:54:58.540014+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:54:58.540014+0000","last_undegraded":"2023-12-13T22:54:58.540014+0000","last_fullsized":"2023-12-13T22:54:58.540014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.793578+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:54:14.793578+0000","last_peered":"2023-12-13T22:54:14.793578+0000","last_clean":"2023-12-13T22:54:14.793578+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:54:14.793578+0000","last_undegraded":"2023-12-13T22:54:14.793578+0000","last_fullsized":"2023-12-13T22:54:14.793578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:12:10.995912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.696626+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:55:35.696626+0000","last_peered":"2023-12-13T22:55:35.696626+0000","last_clean":"2023-12-13T22:55:35.696626+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:55:35.696626+0000","last_undegraded":"2023-12-13T22:55:35.696626+0000","last_fullsized":"2023-12-13T22:55:35.696626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.639382+0000","last_change":"2023-12-13T22:25:57.857796+0000","last_active":"2023-12-13T22:55:18.639382+0000","last_peered":"2023-12-13T22:55:18.639382+0000","last_clean":"2023-12-13T22:55:18.639382+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:18.639382+0000","last_undegraded":"2023-12-13T22:55:18.639382+0000","last_fullsized":"2023-12-13T22:55:18.639382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:30.769094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:23.067917+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:53:23.067917+0000","last_peered":"2023-12-13T22:53:23.067917+0000","last_clean":"2023-12-13T22:53:23.067917+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:53:23.067917+0000","last_undegraded":"2023-12-13T22:53:23.067917+0000","last_fullsized":"2023-12-13T22:53:23.067917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.054977+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:54:23.054977+0000","last_peered":"2023-12-13T22:54:23.054977+0000","last_clean":"2023-12-13T22:54:23.054977+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:54:23.054977+0000","last_undegraded":"2023-12-13T22:54:23.054977+0000","last_fullsized":"2023-12-13T22:54:23.054977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:13.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629343+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:55:35.629343+0000","last_peered":"2023-12-13T22:55:35.629343+0000","last_clean":"2023-12-13T22:55:35.629343+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:55:35.629343+0000","last_undegraded":"2023-12-13T22:55:35.629343+0000","last_fullsized":"2023-12-13T22:55:35.629343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'8","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.561518+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:55:18.561518+0000","last_peered":"2023-12-13T22:55:18.561518+0000","last_clean":"2023-12-13T22:55:18.561518+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:55:18.561518+0000","last_undegraded":"2023-12-13T22:55:18.561518+0000","last_fullsized":"2023-12-13T22:55:18.561518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.943447+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:54:17.943447+0000","last_peered":"2023-12-13T22:54:17.943447+0000","last_clean":"2023-12-13T22:54:17.943447+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:54:17.943447+0000","last_undegraded":"2023-12-13T22:54:17.943447+0000","last_fullsized":"2023-12-13T22:54:17.943447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631055+0000","last_change":"2023-12-13T22:26:00.409370+0000","last_active":"2023-12-13T22:55:35.631055+0000","last_peered":"2023-12-13T22:55:35.631055+0000","last_clean":"2023-12-13T22:55:35.631055+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:35.631055+0000","last_undegraded":"2023-12-13T22:55:35.631055+0000","last_fullsized":"2023-12-13T22:55:35.631055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'6","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:57.259703+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:54:57.259703+0000","last_peered":"2023-12-13T22:54:57.259703+0000","last_clean":"2023-12-13T22:54:57.259703+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:54:57.259703+0000","last_undegraded":"2023-12-13T22:54:57.259703+0000","last_fullsized":"2023-12-13T22:54:57.259703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.777096+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:54:08.777096+0000","last_peered":"2023-12-13T22:54:08.777096+0000","last_clean":"2023-12-13T22:54:08.777096+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:54:08.777096+0000","last_undegraded":"2023-12-13T22:54:08.777096+0000","last_fullsized":"2023-12-13T22:54:08.777096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:19:57.687005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.542756+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.542756+0000","last_peered":"2023-12-13T22:55:35.542756+0000","last_clean":"2023-12-13T22:55:35.542756+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.542756+0000","last_undegraded":"2023-12-13T22:55:35.542756+0000","last_fullsized":"2023-12-13T22:55:35.542756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:54.567074+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:54:54.567074+0000","last_peered":"2023-12-13T22:54:54.567074+0000","last_clean":"2023-12-13T22:54:54.567074+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:54:54.567074+0000","last_undegraded":"2023-12-13T22:54:54.567074+0000","last_fullsized":"2023-12-13T22:54:54.567074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:39.952473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.052609+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:54:18.052609+0000","last_peered":"2023-12-13T22:54:18.052609+0000","last_clean":"2023-12-13T22:54:18.052609+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:54:18.052609+0000","last_undegraded":"2023-12-13T22:54:18.052609+0000","last_fullsized":"2023-12-13T22:54:18.052609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:27:07.801559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503199+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:35.503199+0000","last_peered":"2023-12-13T22:55:35.503199+0000","last_clean":"2023-12-13T22:55:35.503199+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:35.503199+0000","last_undegraded":"2023-12-13T22:55:35.503199+0000","last_fullsized":"2023-12-13T22:55:35.503199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:55.399144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'264","reported_seq":298,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.920406+0000","last_change":"2023-12-13T22:25:57.855397+0000","last_active":"2023-12-13T22:55:22.920406+0000","last_peered":"2023-12-13T22:55:22.920406+0000","last_clean":"2023-12-13T22:55:22.920406+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:22.920406+0000","last_undegraded":"2023-12-13T22:55:22.920406+0000","last_fullsized":"2023-12-13T22:55:22.920406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:12:37.842733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:18.022796+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:54:18.022796+0000","last_peered":"2023-12-13T22:54:18.022796+0000","last_clean":"2023-12-13T22:54:18.022796+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:54:18.022796+0000","last_undegraded":"2023-12-13T22:54:18.022796+0000","last_fullsized":"2023-12-13T22:54:18.022796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:43:08.362369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.533484+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:55:35.533484+0000","last_peered":"2023-12-13T22:55:35.533484+0000","last_clean":"2023-12-13T22:55:35.533484+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:35.533484+0000","last_undegraded":"2023-12-13T22:55:35.533484+0000","last_fullsized":"2023-12-13T22:55:35.533484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'260","reported_seq":293,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:25.440283+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:55:25.440283+0000","last_peered":"2023-12-13T22:55:25.440283+0000","last_clean":"2023-12-13T22:55:25.440283+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:55:25.440283+0000","last_undegraded":"2023-12-13T22:55:25.440283+0000","last_fullsized":"2023-12-13T22:55:25.440283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:59:02.096811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.030638+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:54:23.030638+0000","last_peered":"2023-12-13T22:54:23.030638+0000","last_clean":"2023-12-13T22:54:23.030638+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:54:23.030638+0000","last_undegraded":"2023-12-13T22:54:23.030638+0000","last_fullsized":"2023-12-13T22:54:23.030638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:44:57.539460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.610726+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:55:35.610726+0000","last_peered":"2023-12-13T22:55:35.610726+0000","last_clean":"2023-12-13T22:55:35.610726+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:55:35.610726+0000","last_undegraded":"2023-12-13T22:55:35.610726+0000","last_fullsized":"2023-12-13T22:55:35.610726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1019","reported_seq":1052,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:57.939384+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:53:57.939384+0000","last_peered":"2023-12-13T22:53:57.939384+0000","last_clean":"2023-12-13T22:53:57.939384+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:53:57.939384+0000","last_undegraded":"2023-12-13T22:53:57.939384+0000","last_fullsized":"2023-12-13T22:53:57.939384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:21:53.509441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.328801+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:54:24.328801+0000","last_peered":"2023-12-13T22:54:24.328801+0000","last_clean":"2023-12-13T22:54:24.328801+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:54:24.328801+0000","last_undegraded":"2023-12-13T22:54:24.328801+0000","last_fullsized":"2023-12-13T22:54:24.328801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:32:56.309085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.545966+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:55:35.545966+0000","last_peered":"2023-12-13T22:55:35.545966+0000","last_clean":"2023-12-13T22:55:35.545966+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:55:35.545966+0000","last_undegraded":"2023-12-13T22:55:35.545966+0000","last_fullsized":"2023-12-13T22:55:35.545966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:14.228671+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:55:14.228671+0000","last_peered":"2023-12-13T22:55:14.228671+0000","last_clean":"2023-12-13T22:55:14.228671+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:14.228671+0000","last_undegraded":"2023-12-13T22:55:14.228671+0000","last_fullsized":"2023-12-13T22:55:14.228671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.331661+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.331661+0000","last_peered":"2023-12-13T22:54:24.331661+0000","last_clean":"2023-12-13T22:54:24.331661+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.331661+0000","last_undegraded":"2023-12-13T22:54:24.331661+0000","last_fullsized":"2023-12-13T22:54:24.331661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:06:15.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.554959+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:55:35.554959+0000","last_peered":"2023-12-13T22:55:35.554959+0000","last_clean":"2023-12-13T22:55:35.554959+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:35.554959+0000","last_undegraded":"2023-12-13T22:55:35.554959+0000","last_fullsized":"2023-12-13T22:55:35.554959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:21:13.932479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'8","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:47.245339+0000","last_change":"2023-12-13T22:25:57.856245+0000","last_active":"2023-12-13T22:54:47.245339+0000","last_peered":"2023-12-13T22:54:47.245339+0000","last_clean":"2023-12-13T22:54:47.245339+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:54:47.245339+0000","last_undegraded":"2023-12-13T22:54:47.245339+0000","last_fullsized":"2023-12-13T22:54:47.245339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:41:28.638265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.332888+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:54:24.332888+0000","last_peered":"2023-12-13T22:54:24.332888+0000","last_clean":"2023-12-13T22:54:24.332888+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:54:24.332888+0000","last_undegraded":"2023-12-13T22:54:24.332888+0000","last_fullsized":"2023-12-13T22:54:24.332888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:38:01.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.544167+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:55:35.544167+0000","last_peered":"2023-12-13T22:55:35.544167+0000","last_clean":"2023-12-13T22:55:35.544167+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:55:35.544167+0000","last_undegraded":"2023-12-13T22:55:35.544167+0000","last_fullsized":"2023-12-13T22:55:35.544167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1182","reported_seq":1215,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.639368+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:55:22.639368+0000","last_peered":"2023-12-13T22:55:22.639368+0000","last_clean":"2023-12-13T22:55:22.639368+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:22.639368+0000","last_undegraded":"2023-12-13T22:55:22.639368+0000","last_fullsized":"2023-12-13T22:55:22.639368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.912710+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:54:15.912710+0000","last_peered":"2023-12-13T22:54:15.912710+0000","last_clean":"2023-12-13T22:54:15.912710+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:54:15.912710+0000","last_undegraded":"2023-12-13T22:54:15.912710+0000","last_fullsized":"2023-12-13T22:54:15.912710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:27.726956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.598358+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:55:35.598358+0000","last_peered":"2023-12-13T22:55:35.598358+0000","last_clean":"2023-12-13T22:55:35.598358+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:35.598358+0000","last_undegraded":"2023-12-13T22:55:35.598358+0000","last_fullsized":"2023-12-13T22:55:35.598358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:56.521580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'128","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:26.942676+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:55:26.942676+0000","last_peered":"2023-12-13T22:55:26.942676+0000","last_clean":"2023-12-13T22:55:26.942676+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:26.942676+0000","last_undegraded":"2023-12-13T22:55:26.942676+0000","last_fullsized":"2023-12-13T22:55:26.942676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.050642+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:54:23.050642+0000","last_peered":"2023-12-13T22:54:23.050642+0000","last_clean":"2023-12-13T22:54:23.050642+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:54:23.050642+0000","last_undegraded":"2023-12-13T22:54:23.050642+0000","last_fullsized":"2023-12-13T22:54:23.050642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:40.661003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579291+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:55:35.579291+0000","last_peered":"2023-12-13T22:55:35.579291+0000","last_clean":"2023-12-13T22:55:35.579291+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:55:35.579291+0000","last_undegraded":"2023-12-13T22:55:35.579291+0000","last_fullsized":"2023-12-13T22:55:35.579291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:21:29.165728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'7","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:23.361395+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:55:23.361395+0000","last_peered":"2023-12-13T22:55:23.361395+0000","last_clean":"2023-12-13T22:55:23.361395+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:23.361395+0000","last_undegraded":"2023-12-13T22:55:23.361395+0000","last_fullsized":"2023-12-13T22:55:23.361395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:12.142382+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:54:12.142382+0000","last_peered":"2023-12-13T22:54:12.142382+0000","last_clean":"2023-12-13T22:54:12.142382+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:54:12.142382+0000","last_undegraded":"2023-12-13T22:54:12.142382+0000","last_fullsized":"2023-12-13T22:54:12.142382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:38:13.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.584248+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:55:35.584248+0000","last_peered":"2023-12-13T22:55:35.584248+0000","last_clean":"2023-12-13T22:55:35.584248+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:55:35.584248+0000","last_undegraded":"2023-12-13T22:55:35.584248+0000","last_fullsized":"2023-12-13T22:55:35.584248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'90","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.672608+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:55:18.672608+0000","last_peered":"2023-12-13T22:55:18.672608+0000","last_clean":"2023-12-13T22:55:18.672608+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:55:18.672608+0000","last_undegraded":"2023-12-13T22:55:18.672608+0000","last_fullsized":"2023-12-13T22:55:18.672608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:36:55.409790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.721120+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:54:14.721120+0000","last_peered":"2023-12-13T22:54:14.721120+0000","last_clean":"2023-12-13T22:54:14.721120+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:54:14.721120+0000","last_undegraded":"2023-12-13T22:54:14.721120+0000","last_fullsized":"2023-12-13T22:54:14.721120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:24.529721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:09.792380+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:54:09.792380+0000","last_peered":"2023-12-13T22:54:09.792380+0000","last_clean":"2023-12-13T22:54:09.792380+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:54:09.792380+0000","last_undegraded":"2023-12-13T22:54:09.792380+0000","last_fullsized":"2023-12-13T22:54:09.792380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:29:43.976129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501460+0000","last_change":"2023-12-13T22:26:00.411808+0000","last_active":"2023-12-13T22:55:35.501460+0000","last_peered":"2023-12-13T22:55:35.501460+0000","last_clean":"2023-12-13T22:55:35.501460+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:35.501460+0000","last_undegraded":"2023-12-13T22:55:35.501460+0000","last_fullsized":"2023-12-13T22:55:35.501460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:44.991386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.837794+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:54:58.837794+0000","last_peered":"2023-12-13T22:54:58.837794+0000","last_clean":"2023-12-13T22:54:58.837794+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:54:58.837794+0000","last_undegraded":"2023-12-13T22:54:58.837794+0000","last_fullsized":"2023-12-13T22:54:58.837794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:43.600379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.771593+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:54:08.771593+0000","last_peered":"2023-12-13T22:54:08.771593+0000","last_clean":"2023-12-13T22:54:08.771593+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:54:08.771593+0000","last_undegraded":"2023-12-13T22:54:08.771593+0000","last_fullsized":"2023-12-13T22:54:08.771593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:21.173968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694904+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:55:35.694904+0000","last_peered":"2023-12-13T22:55:35.694904+0000","last_clean":"2023-12-13T22:55:35.694904+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:55:35.694904+0000","last_undegraded":"2023-12-13T22:55:35.694904+0000","last_fullsized":"2023-12-13T22:55:35.694904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'209","reported_seq":442,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.336981+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:55:13.336981+0000","last_peered":"2023-12-13T22:55:13.336981+0000","last_clean":"2023-12-13T22:55:13.336981+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:55:13.336981+0000","last_undegraded":"2023-12-13T22:55:13.336981+0000","last_fullsized":"2023-12-13T22:55:13.336981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:23:01.456311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'305","reported_seq":633,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.379923+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:55:24.379923+0000","last_peered":"2023-12-13T22:55:24.379923+0000","last_clean":"2023-12-13T22:55:24.379923+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:55:24.379923+0000","last_undegraded":"2023-12-13T22:55:24.379923+0000","last_fullsized":"2023-12-13T22:55:24.379923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571431+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:55:35.571431+0000","last_peered":"2023-12-13T22:55:35.571431+0000","last_clean":"2023-12-13T22:55:35.571431+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:35.571431+0000","last_undegraded":"2023-12-13T22:55:35.571431+0000","last_fullsized":"2023-12-13T22:55:35.571431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:56:14.217269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:02.447391+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:54:02.447391+0000","last_peered":"2023-12-13T22:54:02.447391+0000","last_clean":"2023-12-13T22:54:02.447391+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:54:02.447391+0000","last_undegraded":"2023-12-13T22:54:02.447391+0000","last_fullsized":"2023-12-13T22:54:02.447391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:59.441803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2402","reported_seq":2434,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.131126+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:55:35.131126+0000","last_peered":"2023-12-13T22:55:35.131126+0000","last_clean":"2023-12-13T22:55:35.131126+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:55:35.131126+0000","last_undegraded":"2023-12-13T22:55:35.131126+0000","last_fullsized":"2023-12-13T22:55:35.131126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:28:46.332331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596583+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:55:35.596583+0000","last_peered":"2023-12-13T22:55:35.596583+0000","last_clean":"2023-12-13T22:55:35.596583+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:35.596583+0000","last_undegraded":"2023-12-13T22:55:35.596583+0000","last_fullsized":"2023-12-13T22:55:35.596583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:15.364011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:10.035655+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:54:10.035655+0000","last_peered":"2023-12-13T22:54:10.035655+0000","last_clean":"2023-12-13T22:54:10.035655+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:54:10.035655+0000","last_undegraded":"2023-12-13T22:54:10.035655+0000","last_fullsized":"2023-12-13T22:54:10.035655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:21:37.016113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624544+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:55:35.624544+0000","last_peered":"2023-12-13T22:55:35.624544+0000","last_clean":"2023-12-13T22:55:35.624544+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:55:35.624544+0000","last_undegraded":"2023-12-13T22:55:35.624544+0000","last_fullsized":"2023-12-13T22:55:35.624544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760964+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:55:35.760964+0000","last_peered":"2023-12-13T22:55:35.760964+0000","last_clean":"2023-12-13T22:55:35.760964+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:55:35.760964+0000","last_undegraded":"2023-12-13T22:55:35.760964+0000","last_fullsized":"2023-12-13T22:55:35.760964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:44.712169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629446+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:55:35.629446+0000","last_peered":"2023-12-13T22:55:35.629446+0000","last_clean":"2023-12-13T22:55:35.629446+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:55:35.629446+0000","last_undegraded":"2023-12-13T22:55:35.629446+0000","last_fullsized":"2023-12-13T22:55:35.629446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.571494+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:55:35.571494+0000","last_peered":"2023-12-13T22:55:35.571494+0000","last_clean":"2023-12-13T22:55:35.571494+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:55:35.571494+0000","last_undegraded":"2023-12-13T22:55:35.571494+0000","last_fullsized":"2023-12-13T22:55:35.571494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:14.059505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.682166+0000","last_change":"2023-12-13T22:26:00.411780+0000","last_active":"2023-12-13T22:55:35.682166+0000","last_peered":"2023-12-13T22:55:35.682166+0000","last_clean":"2023-12-13T22:55:35.682166+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:35.682166+0000","last_undegraded":"2023-12-13T22:55:35.682166+0000","last_fullsized":"2023-12-13T22:55:35.682166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501565+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:35.501565+0000","last_peered":"2023-12-13T22:55:35.501565+0000","last_clean":"2023-12-13T22:55:35.501565+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:35.501565+0000","last_undegraded":"2023-12-13T22:55:35.501565+0000","last_fullsized":"2023-12-13T22:55:35.501565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:50:11.725466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631004+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:35.631004+0000","last_peered":"2023-12-13T22:55:35.631004+0000","last_clean":"2023-12-13T22:55:35.631004+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:35.631004+0000","last_undegraded":"2023-12-13T22:55:35.631004+0000","last_fullsized":"2023-12-13T22:55:35.631004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:30.691205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.692125+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:55:35.692125+0000","last_peered":"2023-12-13T22:55:35.692125+0000","last_clean":"2023-12-13T22:55:35.692125+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:35.692125+0000","last_undegraded":"2023-12-13T22:55:35.692125+0000","last_fullsized":"2023-12-13T22:55:35.692125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632243+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:55:35.632243+0000","last_peered":"2023-12-13T22:55:35.632243+0000","last_clean":"2023-12-13T22:55:35.632243+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:55:35.632243+0000","last_undegraded":"2023-12-13T22:55:35.632243+0000","last_fullsized":"2023-12-13T22:55:35.632243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698720+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:55:35.698720+0000","last_peered":"2023-12-13T22:55:35.698720+0000","last_clean":"2023-12-13T22:55:35.698720+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698720+0000","last_undegraded":"2023-12-13T22:55:35.698720+0000","last_fullsized":"2023-12-13T22:55:35.698720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:11:51.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.630133+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:55:35.630133+0000","last_peered":"2023-12-13T22:55:35.630133+0000","last_clean":"2023-12-13T22:55:35.630133+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:55:35.630133+0000","last_undegraded":"2023-12-13T22:55:35.630133+0000","last_fullsized":"2023-12-13T22:55:35.630133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:05:38.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.572832+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:55:35.572832+0000","last_peered":"2023-12-13T22:55:35.572832+0000","last_clean":"2023-12-13T22:55:35.572832+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:55:35.572832+0000","last_undegraded":"2023-12-13T22:55:35.572832+0000","last_fullsized":"2023-12-13T22:55:35.572832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:31:04.991523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624383+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:55:35.624383+0000","last_peered":"2023-12-13T22:55:35.624383+0000","last_clean":"2023-12-13T22:55:35.624383+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:55:35.624383+0000","last_undegraded":"2023-12-13T22:55:35.624383+0000","last_fullsized":"2023-12-13T22:55:35.624383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:24.583890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543937+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.543937+0000","last_peered":"2023-12-13T22:55:35.543937+0000","last_clean":"2023-12-13T22:55:35.543937+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.543937+0000","last_undegraded":"2023-12-13T22:55:35.543937+0000","last_fullsized":"2023-12-13T22:55:35.543937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.761801+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:55:35.761801+0000","last_peered":"2023-12-13T22:55:35.761801+0000","last_clean":"2023-12-13T22:55:35.761801+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:55:35.761801+0000","last_undegraded":"2023-12-13T22:55:35.761801+0000","last_fullsized":"2023-12-13T22:55:35.761801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:56.031401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.758757+0000","last_change":"2023-12-13T22:27:03.509440+0000","last_active":"2023-12-13T22:55:35.758757+0000","last_peered":"2023-12-13T22:55:35.758757+0000","last_clean":"2023-12-13T22:55:35.758757+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:55:35.758757+0000","last_undegraded":"2023-12-13T22:55:35.758757+0000","last_fullsized":"2023-12-13T22:55:35.758757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632293+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:55:35.632293+0000","last_peered":"2023-12-13T22:55:35.632293+0000","last_clean":"2023-12-13T22:55:35.632293+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:55:35.632293+0000","last_undegraded":"2023-12-13T22:55:35.632293+0000","last_fullsized":"2023-12-13T22:55:35.632293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.502094+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:55:35.502094+0000","last_peered":"2023-12-13T22:55:35.502094+0000","last_clean":"2023-12-13T22:55:35.502094+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:55:35.502094+0000","last_undegraded":"2023-12-13T22:55:35.502094+0000","last_fullsized":"2023-12-13T22:55:35.502094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555981+0000","last_change":"2023-12-13T22:26:00.283852+0000","last_active":"2023-12-13T22:55:35.555981+0000","last_peered":"2023-12-13T22:55:35.555981+0000","last_clean":"2023-12-13T22:55:35.555981+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:35.555981+0000","last_undegraded":"2023-12-13T22:55:35.555981+0000","last_fullsized":"2023-12-13T22:55:35.555981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:46:25.678883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698035+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:55:35.698035+0000","last_peered":"2023-12-13T22:55:35.698035+0000","last_clean":"2023-12-13T22:55:35.698035+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:35.698035+0000","last_undegraded":"2023-12-13T22:55:35.698035+0000","last_fullsized":"2023-12-13T22:55:35.698035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:41:52.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614921+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:55:35.614921+0000","last_peered":"2023-12-13T22:55:35.614921+0000","last_clean":"2023-12-13T22:55:35.614921+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:55:35.614921+0000","last_undegraded":"2023-12-13T22:55:35.614921+0000","last_fullsized":"2023-12-13T22:55:35.614921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:21:41.064264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.635444+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:55:35.635444+0000","last_peered":"2023-12-13T22:55:35.635444+0000","last_clean":"2023-12-13T22:55:35.635444+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:55:35.635444+0000","last_undegraded":"2023-12-13T22:55:35.635444+0000","last_fullsized":"2023-12-13T22:55:35.635444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:16:19.289861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631587+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631587+0000","last_peered":"2023-12-13T22:55:35.631587+0000","last_clean":"2023-12-13T22:55:35.631587+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631587+0000","last_undegraded":"2023-12-13T22:55:35.631587+0000","last_fullsized":"2023-12-13T22:55:35.631587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580534+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580534+0000","last_peered":"2023-12-13T22:55:35.580534+0000","last_clean":"2023-12-13T22:55:35.580534+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580534+0000","last_undegraded":"2023-12-13T22:55:35.580534+0000","last_fullsized":"2023-12-13T22:55:35.580534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698947+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:55:35.698947+0000","last_peered":"2023-12-13T22:55:35.698947+0000","last_clean":"2023-12-13T22:55:35.698947+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.698947+0000","last_undegraded":"2023-12-13T22:55:35.698947+0000","last_fullsized":"2023-12-13T22:55:35.698947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:09.789451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.532526+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:55:35.532526+0000","last_peered":"2023-12-13T22:55:35.532526+0000","last_clean":"2023-12-13T22:55:35.532526+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:55:35.532526+0000","last_undegraded":"2023-12-13T22:55:35.532526+0000","last_fullsized":"2023-12-13T22:55:35.532526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760342+0000","last_change":"2023-12-13T22:27:03.070128+0000","last_active":"2023-12-13T22:55:35.760342+0000","last_peered":"2023-12-13T22:55:35.760342+0000","last_clean":"2023-12-13T22:55:35.760342+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:55:35.760342+0000","last_undegraded":"2023-12-13T22:55:35.760342+0000","last_fullsized":"2023-12-13T22:55:35.760342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:20:07.152403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539165+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:55:35.539165+0000","last_peered":"2023-12-13T22:55:35.539165+0000","last_clean":"2023-12-13T22:55:35.539165+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:55:35.539165+0000","last_undegraded":"2023-12-13T22:55:35.539165+0000","last_fullsized":"2023-12-13T22:55:35.539165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631457+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:55:35.631457+0000","last_peered":"2023-12-13T22:55:35.631457+0000","last_clean":"2023-12-13T22:55:35.631457+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:55:35.631457+0000","last_undegraded":"2023-12-13T22:55:35.631457+0000","last_fullsized":"2023-12-13T22:55:35.631457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:44:15.630975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555896+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:55:35.555896+0000","last_peered":"2023-12-13T22:55:35.555896+0000","last_clean":"2023-12-13T22:55:35.555896+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:55:35.555896+0000","last_undegraded":"2023-12-13T22:55:35.555896+0000","last_fullsized":"2023-12-13T22:55:35.555896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:37:37.354883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503529+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:55:35.503529+0000","last_peered":"2023-12-13T22:55:35.503529+0000","last_clean":"2023-12-13T22:55:35.503529+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:55:35.503529+0000","last_undegraded":"2023-12-13T22:55:35.503529+0000","last_fullsized":"2023-12-13T22:55:35.503529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:16:41.949528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.538999+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.538999+0000","last_peered":"2023-12-13T22:55:35.538999+0000","last_clean":"2023-12-13T22:55:35.538999+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.538999+0000","last_undegraded":"2023-12-13T22:55:35.538999+0000","last_fullsized":"2023-12-13T22:55:35.538999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8033,"ondisk_log_size":8033,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477107,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.38100000000000001},"max":{"1min":1.3180000000000001,"5min":1.73,"15min":1.7689999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.65100000000000002,"5min":0.55900000000000005,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.002}]},{"osd":1,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.628,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.2350000000000001,"5min":2.165,"15min":2.165},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.022,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.63300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.369,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.93400000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97299999999999998,"15min":0.97699999999999998},"min":{"1min":0.66000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.361,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.383,"5min":1.649,"15min":2.1269999999999998},"last":1.2909999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.76700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.792,"15min":1.792},"last":1.032},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0069999999999999,"15min":1.032},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.3700000000000001,"5min":1.496,"15min":2.996},"last":1.0580000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.6819999999999999,"5min":1.847,"15min":1.8480000000000001},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.8120000000000001},"last":1.25}]},{"osd":5,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.04},"min":{"1min":0.68100000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6339999999999999,"15min":2.21},"last":1.177},{"interface":"front","average":{"1min":1.159,"5min":1.111,"15min":1.107},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.591,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.145,"15min":1.143},"min":{"1min":0.77100000000000002,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.506,"5min":2.056,"15min":2.0590000000000002},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.133,"15min":1.129},"min":{"1min":0.60599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.73,"5min":1.798,"15min":2.169},"last":1.1259999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477107,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.67400000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.272,"5min":1.575,"15min":2.1970000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.3109999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.242}]},{"osd":1,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.873,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.319,"15min":1.5109999999999999},"last":0.745},{"interface":"front","average":{"1min":1.032,"5min":1.0289999999999999,"15min":1.0129999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4650000000000001,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.04,"15min":1.014},"min":{"1min":0.79100000000000004,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.506,"5min":1.506,"15min":1.8540000000000001},"last":1.29}]},{"osd":3,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0700000000000001,"15min":1.0649999999999999},"min":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.44800000000000001},"max":{"1min":1.4930000000000001,"5min":1.587,"15min":1.841},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.3320000000000001,"5min":1.405,"15min":1.784},"last":0.872}]},{"osd":4,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.755,"5min":0.47499999999999998,"15min":0.375},"max":{"1min":1.6279999999999999,"5min":1.7350000000000001,"15min":2.504},"last":1.083},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.72799999999999998,"5min":0.47099999999999997,"15min":0.33000000000000002},"max":{"1min":1.5569999999999999,"5min":1.708,"15min":2.044},"last":1.3380000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.63200000000000001,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.9239999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1879999999999999,"15min":1.2010000000000001},"min":{"1min":0.72499999999999998,"5min":0.52200000000000002,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.21,"15min":1.2},"min":{"1min":0.69799999999999995,"5min":0.45000000000000001,"15min":0.42299999999999999},"max":{"1min":1.6339999999999999,"5min":1.766,"15min":2.956},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.99399999999999999,"5min":0.495,"15min":0.442},"max":{"1min":1.6779999999999999,"5min":1.788,"15min":1.9350000000000001},"last":1.1200000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477107,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.264,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.494},"last":1.149}]},{"osd":1,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.75800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.667},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93999999999999995,"15min":0.96899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.226}]},{"osd":2,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.3},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.69099999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.4350000000000001,"15min":1.5009999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.57499999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.599},"last":1.333},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3360000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.006}]},{"osd":4,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89400000000000002,"15min":0.92500000000000004},"min":{"1min":0.57199999999999995,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3779999999999999,"5min":1.482,"15min":1.53},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.4490000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.024,"15min":1.0680000000000001},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.387},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.63300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.466,"5min":1.552,"15min":1.8480000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.1459999999999999},"min":{"1min":0.60199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.9339999999999999},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.49}]}]},{"osd":4,"up_from":16,"seq":68719477108,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.879,"15min":0.91200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90700000000000003,"15min":0.90200000000000002},"min":{"1min":0.64200000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3220000000000001,"5min":1.3759999999999999,"15min":1.488},"last":1.089}]},{"osd":1,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95099999999999996},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.242,"5min":1.75,"15min":1.75},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.997,"15min":1.002},"min":{"1min":0.71399999999999997,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.22,"5min":1.4299999999999999,"15min":1.831},"last":1.149}]},{"osd":2,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.65200000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.2470000000000001,"5min":1.371,"15min":1.645},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.0309999999999999,"15min":1.04},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.423,"5min":1.5149999999999999,"15min":1.75},"last":0.86499999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.96299999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.194,"5min":1.639,"15min":1.639},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.103,"5min":1.097,"15min":1.1220000000000001},"min":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.3899999999999999,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":1.2090000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.63400000000000001,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.51,"5min":2.218,"15min":2.218},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0349999999999999},"min":{"1min":0.63600000000000001,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.464,"5min":1.5,"15min":1.643},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":1.0680000000000001},"min":{"1min":0.60999999999999999,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.119},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.595,"5min":2.137,"15min":2.137},"last":0.96899999999999997}]},{"osd":7,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1020000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.61599999999999999,"15min":0.504},"max":{"1min":1.585,"5min":1.8049999999999999,"15min":1.857},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1879999999999999,"15min":1.2070000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.833,"5min":1.927,"15min":2.3079999999999998},"last":0.995}]}]},{"osd":3,"up_from":16,"seq":68719477107,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.081,"5min":1.3149999999999999,"15min":1.524},"last":0.77300000000000002}]},{"osd":1,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88200000000000001,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3859999999999999,"15min":1.4379999999999999},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.86699999999999999},"min":{"1min":0.61599999999999999,"5min":0.373,"15min":0.34200000000000003},"max":{"1min":1.085,"5min":1.3029999999999999,"15min":5.085},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95099999999999996,"15min":0.92900000000000005},"min":{"1min":0.63600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.95199999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.81599999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3069999999999999,"5min":1.6359999999999999,"15min":1.77},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3180000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0800000000000001,"15min":1.091},"min":{"1min":0.76800000000000002,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.3919999999999999,"5min":1.532,"15min":1.8400000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1830000000000001,"15min":1.177},"min":{"1min":0.84999999999999998,"5min":0.63200000000000001,"15min":0.38200000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.133}]},{"osd":6,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.23,"15min":1.204},"min":{"1min":0.98999999999999999,"5min":0.60299999999999998,"15min":0.47199999999999998},"max":{"1min":1.5720000000000001,"5min":1.8149999999999999,"15min":2.181},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.96399999999999997,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.407,"5min":1.742,"15min":2.1230000000000002},"last":1.177}]},{"osd":7,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.81699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4870000000000001,"5min":1.841,"15min":2.1779999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0189999999999999,"5min":0.65200000000000002,"15min":0.55600000000000005},"max":{"1min":1.5169999999999999,"5min":1.7909999999999999,"15min":1.948},"last":0.92900000000000005}]}]},{"osd":1,"up_from":16,"seq":68719477108,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53000000000000003,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":1.054,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1559999999999999,"5min":1.401,"15min":1.5580000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.397,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.86699999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1160000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.872,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.308,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0049999999999999,"15min":1.0089999999999999},"min":{"1min":0.746,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.3169999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.60299999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3260000000000001,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0609999999999999,"15min":1.089},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.6599999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.181,"15min":1.1799999999999999},"min":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"max":{"1min":1.4710000000000001,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.117},"min":{"1min":0.79000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.468,"5min":1.706,"15min":1.7649999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.66400000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.4339999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.115}]},{"osd":7,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.88500000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.409,"5min":1.8,"15min":1.8520000000000001},"last":1.008},{"interface":"front","average":{"1min":1.095,"5min":1.1519999999999999,"15min":1.173},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4239999999999999,"5min":2.774,"15min":2.774},"last":0.84099999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509810,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.24,"5min":1.24,"15min":2.8730000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.042,"5min":1.47,"15min":1.964},"last":0.755},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.2609999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.503,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1619999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1759999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.63400000000000001,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.105,"5min":1.718,"15min":1.869},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.034,"15min":1.0669999999999999},"min":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":1.8340000000000001},"last":1.0820000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.091},"min":{"1min":0.71999999999999997,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.573,"5min":1.772,"15min":2.1030000000000002},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":2.0779999999999998},"last":1.0660000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.1499999999999999},"min":{"1min":0.80300000000000005,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.518,"5min":1.764,"15min":1.835},"last":0.996},{"interface":"front","average":{"1min":1.085,"5min":1.1060000000000001,"15min":1.1419999999999999},"min":{"1min":0.72999999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.319,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.034}]},{"osd":7,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1599999999999999,"15min":1.1910000000000001},"min":{"1min":0.83199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.704,"15min":2.5640000000000001},"last":1.159},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1479999999999999,"15min":1.2050000000000001},"min":{"1min":0.81200000000000006,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":1.986,"15min":5.3310000000000004},"last":0.84799999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542513,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":1.048,"5min":1.897,"15min":1.897},"last":0.754},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.77000000000000002},"min":{"1min":0.51700000000000002,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.099,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Dec 13 22:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89400000000000002,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.872,"15min":0.874},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.79,"5min":1.79,"15min":1.9099999999999999},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":0.91900000000000004},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.0680000000000001,"5min":1.867,"15min":2.6320000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92400000000000004,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":2.0659999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.71199999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.4490000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1850000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.099,"15min":1.0760000000000001},"min":{"1min":0.70999999999999996,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.5309999999999999,"5min":1.554,"15min":1.625},"last":1.268},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.53000000000000003,"15min":0.46800000000000003},"max":{"1min":1.5049999999999999,"5min":2.0259999999999998,"15min":2.1539999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.139,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.8420000000000001,"15min":2.2250000000000001},"last":1.151},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.232,"15min":1.212},"min":{"1min":0.93799999999999994,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5669999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3100000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.91800000000000004,"5min":0.56899999999999995,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.504},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.232,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6419999999999999,"5min":2.1259999999999999,"15min":2.339},"last":1.232}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:55:43.560 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:55:43.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 Processor -- start 2023-12-13T22:55:43.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 -- start start 2023-12-13T22:55:43.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a1c151600 0x7f5a1c157200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c7020 0x7f5a1c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c15b120 con 0x7f5a1c0c9310 2023-12-13T22:55:43.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1c06aa40 con 0x7f5a1c151600 2023-12-13T22:55:43.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a22488640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c06ad00 con 0x7f5a1c0c7020 2023-12-13T22:55:43.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a1bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a1c151600 0x7f5a1c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a1bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5a1c151600 0x7f5a1c157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57178/0 (socket says 172.21.15.91:57178) 2023-12-13T22:55:43.718 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a1bfff640 1 -- 172.21.15.91:0/278602128 learned_addr learned my addr 172.21.15.91:0/278602128 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:43.719 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.719+0000 7f5a1b7fe640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c7020 0x7f5a1c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.723+0000 7f5a1bfff640 1 -- 172.21.15.91:0/278602128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c7020 msgr2=0x7f5a1c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:43.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.723+0000 7f5a1bfff640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c7020 0x7f5a1c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.723+0000 7f5a1bfff640 1 -- 172.21.15.91:0/278602128 >> v1:172.21.15.91:6789/0 conn(0x7f5a1c0c9310 legacy=0x7f5a1c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.723 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.723+0000 7f5a1bfff640 1 -- 172.21.15.91:0/278602128 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c06afe0 con 0x7f5a1c151600 2023-12-13T22:55:43.728 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.731+0000 7f5a1bfff640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c157200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009870 tx=0x7f5a0c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04553662dbab39b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:43.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a1affd640 1 -- 172.21.15.91:0/278602128 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0a8a30 con 0x7f5a1c151600 2023-12-13T22:55:43.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a1affd640 1 -- 172.21.15.91:0/278602128 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0a8b90 con 0x7f5a1c151600 2023-12-13T22:55:43.734 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a1affd640 1 -- 172.21.15.91:0/278602128 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0b0440 con 0x7f5a1c151600 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 -- 172.21.15.91:0/278602128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 msgr2=0x7f5a1c157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c157200 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009870 tx=0x7f5a0c01ed30 comp rx=0 tx=0).stop 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 -- 172.21.15.91:0/278602128 shutdown_connections 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c7020 0x7f5a1c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 --2- 172.21.15.91:0/278602128 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c157200 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 -- 172.21.15.91:0/278602128 >> 172.21.15.91:0/278602128 conn(0x7f5a1c070160 msgr2=0x7f5a1c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 -- 172.21.15.91:0/278602128 shutdown_connections 2023-12-13T22:55:43.735 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.735+0000 7f5a22488640 1 -- 172.21.15.91:0/278602128 wait complete. 2023-12-13T22:55:43.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 Processor -- start 2023-12-13T22:55:43.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 -- start start 2023-12-13T22:55:43.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a1c0c7020 0x7f5a1c154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.736 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c9310 0x7f5a1c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c4da0 con 0x7f5a1c151600 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c1522b0 con 0x7f5a1c0c7020 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a22488640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c1efed0 con 0x7f5a1c0c9310 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a20a25640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a20a25640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57188/0 (socket says 172.21.15.91:57188) 2023-12-13T22:55:43.737 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a20a25640 1 -- 172.21.15.91:0/2010166183 learned_addr learned my addr 172.21.15.91:0/2010166183 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:43.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a1bfff640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a1c0c7020 0x7f5a1c154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.738 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.739+0000 7f5a1b7fe640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c9310 0x7f5a1c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:43.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.743+0000 7f5a20a25640 1 -- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c9310 msgr2=0x7f5a1c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.743+0000 7f5a20a25640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c9310 0x7f5a1c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.743+0000 7f5a20a25640 1 -- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a1c0c7020 msgr2=0x7f5a1c154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:43.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.743+0000 7f5a20a25640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a1c0c7020 0x7f5a1c154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:43.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.743+0000 7f5a20a25640 1 -- 172.21.15.91:0/2010166183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c0094d0 con 0x7f5a1c151600 2023-12-13T22:55:43.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.747+0000 7f5a20a25640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c700 tx=0x7f5a1400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:43.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14003b80 con 0x7f5a1c151600 2023-12-13T22:55:43.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14003ce0 con 0x7f5a1c151600 2023-12-13T22:55:43.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400aa90 con 0x7f5a1c151600 2023-12-13T22:55:43.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1c151cf0 con 0x7f5a1c151600 2023-12-13T22:55:43.748 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c0c49c0 con 0x7f5a1c151600 2023-12-13T22:55:43.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:43.751+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1c0c7840 con 0x7f5a1c151600 2023-12-13T22:55:44.023 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.023+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5a1400abf0 con 0x7f5a1c151600 2023-12-13T22:55:44.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.027+0000 7f5a18ff9640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 0x7f5a08068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:44.024 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.027+0000 7f5a1bfff640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 0x7f5a08068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:44.025 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.027+0000 7f5a1bfff640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 0x7f5a08068d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b2000 tx=0x7f5a0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:44.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.063+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a14055f60 con 0x7f5a1c151600 2023-12-13T22:55:44.063 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.063+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5a14051ba0 con 0x7f5a1c151600 2023-12-13T22:55:44.223 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.223+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a1c15b590 con 0x7f5a1c151600 2023-12-13T22:55:44.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.291+0000 7f5a18ff9640 1 -- 172.21.15.91:0/2010166183 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18712 (secure 0 0 0) 0x7f5a1c15b590 con 0x7f5a1c151600 2023-12-13T22:55:44.292 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:44.292 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":31,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:27:02.661258+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 msgr2=0x7f5a08068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 0x7f5a08068d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0b2000 tx=0x7f5a0c009040 comp rx=0 tx=0).stop 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 msgr2=0x7f5a1c152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c700 tx=0x7f5a1400cbc0 comp rx=0 tx=0).stop 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 shutdown_connections 2023-12-13T22:55:44.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5a08066840 0x7f5a08068d00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5a1c151600 0x7f5a1c152d50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5a1c0c9310 0x7f5a1c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 --2- 172.21.15.91:0/2010166183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a1c0c7020 0x7f5a1c154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 >> 172.21.15.91:0/2010166183 conn(0x7f5a1c070160 msgr2=0x7f5a1c071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 shutdown_connections 2023-12-13T22:55:44.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:44.295+0000 7f5a22488640 1 -- 172.21.15.91:0/2010166183 wait complete. 2023-12-13T22:55:45.312 INFO:tasks.ceph:Scrubbing osd.0 2023-12-13T22:55:45.313 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:45.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 Processor -- start 2023-12-13T22:55:45.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 -- start start 2023-12-13T22:55:45.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 0x7feba0159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7feba00c8aa0 0x7feba01423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba015a450 con 0x7feba00c8660 2023-12-13T22:55:45.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0070390 con 0x7feba00c8aa0 2023-12-13T22:55:45.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.459+0000 7feba4933640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba006f6b0 con 0x7feba006ebc0 2023-12-13T22:55:45.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.467+0000 7feb9e59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 0x7feba0159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.467+0000 7feb9e59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 0x7feba0159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:34834/0 (socket says 172.21.15.91:34834) 2023-12-13T22:55:45.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.467+0000 7feb9e59c640 1 -- 172.21.15.91:0/2061021085 learned_addr learned my addr 172.21.15.91:0/2061021085 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:45.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.535+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/2061021085 >> v2:172.21.15.91:3300/0 conn(0x7feba00c8aa0 0x7feba01423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.543+0000 7feb9ed9d640 1 -- 172.21.15.91:0/2061021085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 msgr2=0x7feba0159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:45.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.543+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/2061021085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 0x7feba0159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.543+0000 7feb9ed9d640 1 -- 172.21.15.91:0/2061021085 >> v1:172.21.15.91:6789/0 conn(0x7feba00c8660 legacy=0x7feba006efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:45.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.543+0000 7feb9ed9d640 1 -- 172.21.15.91:0/2061021085 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00700b0 con 0x7feba00c8aa0 2023-12-13T22:55:45.552 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.555+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/2061021085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba01423f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b636698283bbd45 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feb9d59a640 1 -- 172.21.15.91:0/2061021085 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980a5790 con 0x7feba00c8aa0 2023-12-13T22:55:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feb9d59a640 1 -- 172.21.15.91:0/2061021085 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb980a58f0 con 0x7feba00c8aa0 2023-12-13T22:55:45.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feb9d59a640 1 -- 172.21.15.91:0/2061021085 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980a5c80 con 0x7feba00c8aa0 2023-12-13T22:55:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- 172.21.15.91:0/2061021085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 msgr2=0x7feba01423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 --2- 172.21.15.91:0/2061021085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba01423f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9801c910 comp rx=0 tx=0).stop 2023-12-13T22:55:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- 172.21.15.91:0/2061021085 shutdown_connections 2023-12-13T22:55:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 --2- 172.21.15.91:0/2061021085 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba01423f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 --2- 172.21.15.91:0/2061021085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba006ebc0 0x7feba0159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- 172.21.15.91:0/2061021085 >> 172.21.15.91:0/2061021085 conn(0x7feba00616e0 msgr2=0x7feba0070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- 172.21.15.91:0/2061021085 shutdown_connections 2023-12-13T22:55:45.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- 172.21.15.91:0/2061021085 wait complete. 2023-12-13T22:55:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 Processor -- start 2023-12-13T22:55:45.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.563+0000 7feba4933640 1 -- start start 2023-12-13T22:55:45.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba006ebc0 0x7feba013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba00c8660 0x7feba01369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba0152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0135f70 con 0x7feba00c8aa0 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f60a0 con 0x7feba006ebc0 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feba4933640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba0158050 con 0x7feba00c8660 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feb9ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba0152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feb9ed9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba0152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57214/0 (socket says 172.21.15.91:57214) 2023-12-13T22:55:45.565 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.567+0000 7feb9ed9d640 1 -- 172.21.15.91:0/3158886869 learned_addr learned my addr 172.21.15.91:0/3158886869 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.571+0000 7feb9ed9d640 1 -- 172.21.15.91:0/3158886869 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba00c8660 msgr2=0x7feba01369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.571+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feba00c8660 0x7feba01369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.571+0000 7feb9ed9d640 1 -- 172.21.15.91:0/3158886869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba006ebc0 msgr2=0x7feba013f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.571+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba006ebc0 0x7feba013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.571+0000 7feb9ed9d640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009a70 con 0x7feba00c8aa0 2023-12-13T22:55:45.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.575+0000 7feb9ed9d640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba0152530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb9801d1b0 tx=0x7feb980196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980ad640 con 0x7feba00c8aa0 2023-12-13T22:55:45.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb980ad7a0 con 0x7feba00c8aa0 2023-12-13T22:55:45.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba01582f0 con 0x7feba00c8aa0 2023-12-13T22:55:45.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980adb30 con 0x7feba00c8aa0 2023-12-13T22:55:45.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba01f59e0 con 0x7feba00c8aa0 2023-12-13T22:55:45.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.583+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba006c040 con 0x7feba00c8aa0 2023-12-13T22:55:45.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.627+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7feb980b4070 con 0x7feba00c8aa0 2023-12-13T22:55:45.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.627+0000 7feb96ffd640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feb80066840 0x7feb80068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.631+0000 7feb9e59c640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feb80066840 0x7feb80068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.631+0000 7feb9e59c640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feb80066840 0x7feb80068d00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb90006f50 tx=0x7feb90006ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.635+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb980f0960 con 0x7feba00c8aa0 2023-12-13T22:55:45.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.635+0000 7feb96ffd640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7feb80070120 0x7feb800725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.635+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb80072c90 con 0x7feb80070120 2023-12-13T22:55:45.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.635+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb980ec5a0 con 0x7feba00c8aa0 2023-12-13T22:55:45.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.639+0000 7feb9dd9b640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7feb80070120 0x7feb800725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.639+0000 7feb9dd9b640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7feb80070120 0x7feb800725c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.639+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== osd.0 v2:172.21.15.91:6818/2717992016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb80072c90 con 0x7feb80070120 2023-12-13T22:55:45.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 --> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feba01f5840 con 0x7feb80070120 2023-12-13T22:55:45.657 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feb96ffd640 1 -- 172.21.15.91:0/3158886869 <== osd.0 v2:172.21.15.91:6818/2717992016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feba01f5840 con 0x7feb80070120 2023-12-13T22:55:45.657 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:45.657 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:45.657 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7feb80070120 msgr2=0x7feb800725c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6818/2717992016,v1:172.21.15.91:6819/2717992016] conn(0x7feb80070120 0x7feb800725c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feb80066840 msgr2=0x7feb80068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7feb80066840 0x7feb80068d00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb90006f50 tx=0x7feb90006ea0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.658 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 msgr2=0x7feba0152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 --2- 172.21.15.91:0/3158886869 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7feba00c8aa0 0x7feba0152530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb9801d1b0 tx=0x7feb980196b0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feb9ed9d640 1 -- 172.21.15.91:0/3158886869 reap_dead start 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 shutdown_connections 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 >> 172.21.15.91:0/3158886869 conn(0x7feba00616e0 msgr2=0x7feba0073700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 shutdown_connections 2023-12-13T22:55:45.659 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.659+0000 7feba4933640 1 -- 172.21.15.91:0/3158886869 wait complete. 2023-12-13T22:55:45.681 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-13T22:55:45.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 Processor -- start 2023-12-13T22:55:45.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 -- start start 2023-12-13T22:55:45.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d01594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fd4d006b860 0x7fd4d00c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d00c3930 con 0x7fd4d006b420 2023-12-13T22:55:45.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d0159b80 con 0x7fd4d006b860 2023-12-13T22:55:45.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d6cdb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d0159e20 con 0x7fd4d014fea0 2023-12-13T22:55:45.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4cffff640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fd4d006b420 0x7fd4d00cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56260/0 (socket says 172.21.15.91:56260) 2023-12-13T22:55:45.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4cffff640 1 -- 172.21.15.91:0/1995252626 learned_addr learned my addr 172.21.15.91:0/1995252626 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:45.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.803+0000 7fd4d5278640 1 --2- 172.21.15.91:0/1995252626 >> v2:172.21.15.91:3300/0 conn(0x7fd4d006b860 0x7fd4d00c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.807+0000 7fd4cf7fe640 1 -- 172.21.15.91:0/1995252626 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940060827 0 0) 0x7fd4d00c3930 con 0x7fd4d006b420 2023-12-13T22:55:45.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.807+0000 7fd4cf7fe640 1 -- 172.21.15.91:0/1995252626 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b8003530 con 0x7fd4d006b420 2023-12-13T22:55:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.811+0000 7fd4d5278640 1 -- 172.21.15.91:0/1995252626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 msgr2=0x7fd4d01594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.811+0000 7fd4d5278640 1 --2- 172.21.15.91:0/1995252626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d01594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.811+0000 7fd4d5278640 1 -- 172.21.15.91:0/1995252626 >> v1:172.21.15.91:6789/0 conn(0x7fd4d006b420 legacy=0x7fd4d00cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.811+0000 7fd4d5278640 1 -- 172.21.15.91:0/1995252626 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d015a100 con 0x7fd4d006b860 2023-12-13T22:55:45.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.819+0000 7fd4d5278640 1 --2- 172.21.15.91:0/1995252626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c45d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80097c0 tx=0x7fd4c801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf732ccce73b3f8a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.823 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.823+0000 7fd4cf7fe640 1 -- 172.21.15.91:0/1995252626 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80a8970 con 0x7fd4d006b860 2023-12-13T22:55:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4cf7fe640 1 -- 172.21.15.91:0/1995252626 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c80a8ad0 con 0x7fd4d006b860 2023-12-13T22:55:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4cf7fe640 1 -- 172.21.15.91:0/1995252626 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80a8e60 con 0x7fd4d006b860 2023-12-13T22:55:45.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/1995252626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 msgr2=0x7fd4d00c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/1995252626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c45d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80097c0 tx=0x7fd4c801ec70 comp rx=0 tx=0).stop 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/1995252626 shutdown_connections 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/1995252626 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c45d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/1995252626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d01594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/1995252626 >> 172.21.15.91:0/1995252626 conn(0x7fd4d006d200 msgr2=0x7fd4d006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/1995252626 shutdown_connections 2023-12-13T22:55:45.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/1995252626 wait complete. 2023-12-13T22:55:45.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 Processor -- start 2023-12-13T22:55:45.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- start start 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d006b420 0x7fd4d01f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d015a6b0 con 0x7fd4d006b860 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d015a970 con 0x7fd4d006b420 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4d6cdb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d015ac50 con 0x7fd4d014fea0 2023-12-13T22:55:45.827 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.827+0000 7fd4cffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57238/0 (socket says 172.21.15.91:57238) 2023-12-13T22:55:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 -- 172.21.15.91:0/2503372602 learned_addr learned my addr 172.21.15.91:0/2503372602 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:45.828 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4d4a77640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d006b420 0x7fd4d01f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.831 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 -- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 msgr2=0x7fd4d015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 -- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d006b420 msgr2=0x7fd4d01f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:45.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d006b420 0x7fd4d01f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:45.832 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.831+0000 7fd4cffff640 1 -- 172.21.15.91:0/2503372602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009420 con 0x7fd4d006b860 2023-12-13T22:55:45.834 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.835+0000 7fd4cffff640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400cb40 tx=0x7fd4c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:45.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c400ac20 con 0x7fd4d006b860 2023-12-13T22:55:45.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c400ad80 con 0x7fd4d006b860 2023-12-13T22:55:45.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d015af30 con 0x7fd4d006b860 2023-12-13T22:55:45.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4012620 con 0x7fd4d006b860 2023-12-13T22:55:45.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d015b4f0 con 0x7fd4d006b860 2023-12-13T22:55:45.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.839+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d0073e70 con 0x7fd4d006b860 2023-12-13T22:55:45.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.859+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd4c4007070 con 0x7fd4d006b860 2023-12-13T22:55:45.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.859+0000 7fd4cd7fa640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 0x7fd4bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:45.858 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.859+0000 7fd4d4a77640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 0x7fd4bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:45.859 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:45.859+0000 7fd4d4a77640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 0x7fd4bc068d00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098f0 tx=0x7fd4c0006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.130 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.131+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4c4055460 con 0x7fd4d006b860 2023-12-13T22:55:46.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.131+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd4c4055230 con 0x7fd4d006b860 2023-12-13T22:55:46.290 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.291+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d00c40b0 con 0x7fd4bc066840 2023-12-13T22:55:46.291 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.291+0000 7fd4cd7fa640 1 -- 172.21.15.91:0/2503372602 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd4c0009540 con 0x7fd4bc066840 2023-12-13T22:55:46.292 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 0 to deep-scrub 2023-12-13T22:55:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 msgr2=0x7fd4bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 0x7fd4bc068d00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098f0 tx=0x7fd4c0006f90 comp rx=0 tx=0).stop 2023-12-13T22:55:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 msgr2=0x7fd4d00c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400cb40 tx=0x7fd4c400a060 comp rx=0 tx=0).stop 2023-12-13T22:55:46.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 shutdown_connections 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd4bc066840 0x7fd4bc068d00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4d014fea0 0x7fd4d015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd4d006b860 0x7fd4d00c5750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 --2- 172.21.15.91:0/2503372602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d006b420 0x7fd4d01f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 >> 172.21.15.91:0/2503372602 conn(0x7fd4d006d200 msgr2=0x7fd4d00caab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 shutdown_connections 2023-12-13T22:55:46.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.295+0000 7fd4d6cdb640 1 -- 172.21.15.91:0/2503372602 wait complete. 2023-12-13T22:55:46.312 INFO:tasks.ceph:Scrubbing osd.1 2023-12-13T22:55:46.312 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:46.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 Processor -- start 2023-12-13T22:55:46.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 -- start start 2023-12-13T22:55:46.437 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c88c0 0x7fd3980c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd398070290 0x7fd398151230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3981575c0 con 0x7fd3980c8ca0 2023-12-13T22:55:46.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3981578a0 con 0x7fd398070290 2023-12-13T22:55:46.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd39d767640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd398157b80 con 0x7fd3980c88c0 2023-12-13T22:55:46.439 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.439+0000 7fd3967fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd398070290 0x7fd398151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.443+0000 7fd3967fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd398070290 0x7fd398151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:50798/0 (socket says 172.21.15.91:50798) 2023-12-13T22:55:46.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.443+0000 7fd3967fc640 1 -- 172.21.15.91:0/1068274138 learned_addr learned my addr 172.21.15.91:0/1068274138 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:46.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.443+0000 7fd396ffd640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c88c0 0x7fd3980c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.447+0000 7fd3967fc640 1 -- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c88c0 msgr2=0x7fd3980c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:46.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.447+0000 7fd3967fc640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c88c0 0x7fd3980c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.447+0000 7fd3967fc640 1 -- 172.21.15.91:0/1068274138 >> v1:172.21.15.91:6789/0 conn(0x7fd3980c8ca0 legacy=0x7fd39806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:46.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.447+0000 7fd3967fc640 1 -- 172.21.15.91:0/1068274138 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398157e60 con 0x7fd398070290 2023-12-13T22:55:46.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.455+0000 7fd3967fc640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398151230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd3800098a0 tx=0x7fd38001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db92900b7816f78a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.464 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd395ffb640 1 -- 172.21.15.91:0/1068274138 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800ac410 con 0x7fd398070290 2023-12-13T22:55:46.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd395ffb640 1 -- 172.21.15.91:0/1068274138 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3800ac570 con 0x7fd398070290 2023-12-13T22:55:46.465 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd395ffb640 1 -- 172.21.15.91:0/1068274138 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800ac900 con 0x7fd398070290 2023-12-13T22:55:46.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 msgr2=0x7fd398151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398151230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd3800098a0 tx=0x7fd38001c4e0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- 172.21.15.91:0/1068274138 shutdown_connections 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398151230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 --2- 172.21.15.91:0/1068274138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c88c0 0x7fd3980c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- 172.21.15.91:0/1068274138 >> 172.21.15.91:0/1068274138 conn(0x7fd398070900 msgr2=0x7fd398070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- 172.21.15.91:0/1068274138 shutdown_connections 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- 172.21.15.91:0/1068274138 wait complete. 2023-12-13T22:55:46.467 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 Processor -- start 2023-12-13T22:55:46.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.467+0000 7fd39d767640 1 -- start start 2023-12-13T22:55:46.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3980c88c0 0x7fd398152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c8ca0 0x7fd398153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981f0780 con 0x7fd3980c88c0 2023-12-13T22:55:46.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3981f1750 con 0x7fd398070290 2023-12-13T22:55:46.469 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.471+0000 7fd39d767640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd398150af0 con 0x7fd3980c8ca0 2023-12-13T22:55:46.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.499+0000 7fd3977fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c8ca0 0x7fd398153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.511+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.515+0000 7fd396ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:50804/0 (socket says 172.21.15.91:50804) 2023-12-13T22:55:46.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.515+0000 7fd396ffd640 1 -- 172.21.15.91:0/3607897447 learned_addr learned my addr 172.21.15.91:0/3607897447 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:46.524 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.527+0000 7fd3967fc640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3980c88c0 0x7fd398152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.535+0000 7fd3967fc640 1 -- 172.21.15.91:0/3607897447 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c8ca0 msgr2=0x7fd398153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.535+0000 7fd3967fc640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd3980c8ca0 0x7fd398153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.535+0000 7fd3967fc640 1 -- 172.21.15.91:0/3607897447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 msgr2=0x7fd398144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.535+0000 7fd3967fc640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd398070290 0x7fd398144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.534 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.535+0000 7fd3967fc640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800094d0 con 0x7fd3980c88c0 2023-12-13T22:55:46.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.539+0000 7fd3967fc640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3980c88c0 0x7fd398152340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd39806b460 tx=0x7fd380019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.547+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800b9070 con 0x7fd3980c88c0 2023-12-13T22:55:46.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.547+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3800b45d0 con 0x7fd3980c88c0 2023-12-13T22:55:46.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.547+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800ac410 con 0x7fd3980c88c0 2023-12-13T22:55:46.547 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.547+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3981f0990 con 0x7fd3980c88c0 2023-12-13T22:55:46.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.547+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3981f0f50 con 0x7fd3980c88c0 2023-12-13T22:55:46.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.551+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd398164500 con 0x7fd3980c88c0 2023-12-13T22:55:46.591 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.591+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd3800b3070 con 0x7fd3980c88c0 2023-12-13T22:55:46.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.595+0000 7fd38f7fe640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd3780667f0 0x7fd378068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.595+0000 7fd396ffd640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd3780667f0 0x7fd378068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.595+0000 7fd396ffd640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd3780667f0 0x7fd378068cb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd388009a40 tx=0x7fd38800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.599+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3800efaa0 con 0x7fd3980c88c0 2023-12-13T22:55:46.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.599+0000 7fd38f7fe640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7fd37806ffd0 0x7fd378072470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.599+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd378072b40 con 0x7fd37806ffd0 2023-12-13T22:55:46.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.599+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3800eb6e0 con 0x7fd3980c88c0 2023-12-13T22:55:46.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.603+0000 7fd3977fe640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7fd37806ffd0 0x7fd378072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.603+0000 7fd3977fe640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7fd37806ffd0 0x7fd378072470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.602 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.603+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== osd.1 v2:172.21.15.91:6810/4169058440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd378072b40 con 0x7fd37806ffd0 2023-12-13T22:55:46.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 --> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd398073e70 con 0x7fd37806ffd0 2023-12-13T22:55:46.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd38f7fe640 1 -- 172.21.15.91:0/3607897447 <== osd.1 v2:172.21.15.91:6810/4169058440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd398073e70 con 0x7fd37806ffd0 2023-12-13T22:55:46.617 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:46.617 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:46.617 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7fd37806ffd0 msgr2=0x7fd378072470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6810/4169058440,v1:172.21.15.91:6811/4169058440] conn(0x7fd37806ffd0 0x7fd378072470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd3780667f0 msgr2=0x7fd378068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fd3780667f0 0x7fd378068cb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd388009a40 tx=0x7fd38800b040 comp rx=0 tx=0).stop 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3980c88c0 msgr2=0x7fd398152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 --2- 172.21.15.91:0/3607897447 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fd3980c88c0 0x7fd398152340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd39806b460 tx=0x7fd380019280 comp rx=0 tx=0).stop 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd3977fe640 1 -- 172.21.15.91:0/3607897447 reap_dead start 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 shutdown_connections 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 >> 172.21.15.91:0/3607897447 conn(0x7fd398070900 msgr2=0x7fd39813e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 shutdown_connections 2023-12-13T22:55:46.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.619+0000 7fd39d767640 1 -- 172.21.15.91:0/3607897447 wait complete. 2023-12-13T22:55:46.636 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-13T22:55:46.760 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 Processor -- start 2023-12-13T22:55:46.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 -- start start 2023-12-13T22:55:46.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5df40c4630 0x7f5df40c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40c72b0 con 0x7f5df40c4a10 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40c4f40 con 0x7f5df40c4630 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5dfa7fc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df415a6c0 con 0x7f5df4156dc0 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5df3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5df40c4630 0x7f5df40c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5df3fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f5df40c4630 0x7f5df40c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57254/0 (socket says 172.21.15.91:57254) 2023-12-13T22:55:46.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5df3fff640 1 -- 172.21.15.91:0/2933060205 learned_addr learned my addr 172.21.15.91:0/2933060205 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:46.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.763+0000 7f5df8d99640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.767+0000 7f5df3fff640 1 -- 172.21.15.91:0/2933060205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 msgr2=0x7f5df414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.767+0000 7f5df3fff640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.767+0000 7f5df3fff640 1 -- 172.21.15.91:0/2933060205 >> v1:172.21.15.152:6789/0 conn(0x7f5df40c4a10 legacy=0x7f5df41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.765 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.767+0000 7f5df3fff640 1 -- 172.21.15.91:0/2933060205 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df415a100 con 0x7f5df40c4630 2023-12-13T22:55:46.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.771+0000 7f5df3fff640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4630 0x7f5df40c6d70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b781ec2c076b9224 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5df2ffd640 1 -- 172.21.15.91:0/2933060205 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a8a30 con 0x7f5df40c4630 2023-12-13T22:55:46.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5df2ffd640 1 -- 172.21.15.91:0/2933060205 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a8b90 con 0x7f5df40c4630 2023-12-13T22:55:46.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5df2ffd640 1 -- 172.21.15.91:0/2933060205 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b0440 con 0x7f5df40c4630 2023-12-13T22:55:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/2933060205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4630 msgr2=0x7f5df40c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4630 0x7f5df40c6d70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de401ed30 comp rx=0 tx=0).stop 2023-12-13T22:55:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/2933060205 shutdown_connections 2023-12-13T22:55:46.773 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/2933060205 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4630 0x7f5df40c6d70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/2933060205 >> 172.21.15.91:0/2933060205 conn(0x7f5df406c6a0 msgr2=0x7f5df406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/2933060205 shutdown_connections 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/2933060205 wait complete. 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 Processor -- start 2023-12-13T22:55:46.774 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- start start 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df40c4630 0x7f5df4159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41eec10 con 0x7f5df40c4a10 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41f30f0 con 0x7f5df40c4630 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.775+0000 7f5dfa7fc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41ef9f0 con 0x7f5df4156dc0 2023-12-13T22:55:46.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.779+0000 7f5df37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.779+0000 7f5df37fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57262/0 (socket says 172.21.15.91:57262) 2023-12-13T22:55:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.779+0000 7f5df37fe640 1 -- 172.21.15.91:0/4186818403 learned_addr learned my addr 172.21.15.91:0/4186818403 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.779+0000 7f5df3fff640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df40c4630 0x7f5df4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.779+0000 7f5df8d99640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 -- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 msgr2=0x7f5df406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df406ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 -- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df40c4630 msgr2=0x7f5df4159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df40c4630 0x7f5df4159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:46.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 -- 172.21.15.91:0/4186818403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40094d0 con 0x7f5df40c4a10 2023-12-13T22:55:46.782 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.783+0000 7f5df37fe640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c460 tx=0x7f5ddc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0052d0 con 0x7f5df40c4a10 2023-12-13T22:55:46.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc005430 con 0x7f5df40c4a10 2023-12-13T22:55:46.786 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc007260 con 0x7f5df40c4a10 2023-12-13T22:55:46.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df41eee20 con 0x7f5df40c4a10 2023-12-13T22:55:46.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df41ef3a0 con 0x7f5df40c4a10 2023-12-13T22:55:46.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.787+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df41efba0 con 0x7f5df40c4a10 2023-12-13T22:55:46.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.807+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5ddc0073c0 con 0x7f5df40c4a10 2023-12-13T22:55:46.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.807+0000 7f5df0ff9640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 0x7f5dd4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:46.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.807+0000 7f5df3fff640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 0x7f5dd4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:46.807 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.811+0000 7f5df3fff640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 0x7f5dd4068d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b2000 tx=0x7f5de40aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:46.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:46.811+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ddc007670 con 0x7f5df40c4a10 2023-12-13T22:55:47.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.111+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5ddc0517b0 con 0x7f5df40c4a10 2023-12-13T22:55:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5df41565c0 con 0x7f5dd4066840 2023-12-13T22:55:47.273 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5df0ff9640 1 -- 172.21.15.91:0/4186818403 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5de40b0440 con 0x7f5dd4066840 2023-12-13T22:55:47.274 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 1 to deep-scrub 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 msgr2=0x7f5dd4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 0x7f5dd4068d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b2000 tx=0x7f5de40aa070 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 msgr2=0x7f5df406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.275+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00c460 tx=0x7f5ddc00c920 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 shutdown_connections 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5dd4066840 0x7f5dd4068d00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df4156dc0 0x7f5df406ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f5df40c4a10 0x7f5df406e530 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 --2- 172.21.15.91:0/4186818403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df40c4630 0x7f5df4159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 >> 172.21.15.91:0/4186818403 conn(0x7f5df406c6a0 msgr2=0x7f5df40c21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 shutdown_connections 2023-12-13T22:55:47.278 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.279+0000 7f5dfa7fc640 1 -- 172.21.15.91:0/4186818403 wait complete. 2023-12-13T22:55:47.294 INFO:tasks.ceph:Scrubbing osd.2 2023-12-13T22:55:47.294 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:47.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 Processor -- start 2023-12-13T22:55:47.429 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 -- start start 2023-12-13T22:55:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f60180c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60180c1ed0 0x7f601806e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60180c3b10 con 0x7f6018070ab0 2023-12-13T22:55:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601814fc30 con 0x7f60180c1ed0 2023-12-13T22:55:47.430 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601f7a2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180c11e0 con 0x7f601814f850 2023-12-13T22:55:47.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601cd3d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60180c1ed0 0x7f601806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601cd3d640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f60180c1ed0 0x7f601806e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57276/0 (socket says 172.21.15.91:57276) 2023-12-13T22:55:47.431 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.431+0000 7f601cd3d640 1 -- 172.21.15.91:0/3641561204 learned_addr learned my addr 172.21.15.91:0/3641561204 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:47.432 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.435+0000 7f601d53e640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f60180c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.435+0000 7f601cd3d640 1 -- 172.21.15.91:0/3641561204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 msgr2=0x7f60180c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.435+0000 7f601cd3d640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f60180c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.435+0000 7f601cd3d640 1 -- 172.21.15.91:0/3641561204 >> v1:172.21.15.152:6789/0 conn(0x7f6018070ab0 legacy=0x7f6018158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.434 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.435+0000 7f601cd3d640 1 -- 172.21.15.91:0/3641561204 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180c2410 con 0x7f60180c1ed0 2023-12-13T22:55:47.438 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.439+0000 7f601cd3d640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60180c1ed0 0x7f601806e530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6008009870 tx=0x7f600801d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45581de622f2bfc server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f600ffff640 1 -- 172.21.15.91:0/3641561204 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080aa400 con 0x7f60180c1ed0 2023-12-13T22:55:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f600ffff640 1 -- 172.21.15.91:0/3641561204 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080aa560 con 0x7f60180c1ed0 2023-12-13T22:55:47.442 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f600ffff640 1 -- 172.21.15.91:0/3641561204 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080aa8f0 con 0x7f60180c1ed0 2023-12-13T22:55:47.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 -- 172.21.15.91:0/3641561204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60180c1ed0 msgr2=0x7f601806e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60180c1ed0 0x7f601806e530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6008009870 tx=0x7f600801d620 comp rx=0 tx=0).stop 2023-12-13T22:55:47.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 -- 172.21.15.91:0/3641561204 shutdown_connections 2023-12-13T22:55:47.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60180c1ed0 0x7f601806e530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.443 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 --2- 172.21.15.91:0/3641561204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f60180c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 -- 172.21.15.91:0/3641561204 >> 172.21.15.91:0/3641561204 conn(0x7f601806c6a0 msgr2=0x7f601806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 -- 172.21.15.91:0/3641561204 shutdown_connections 2023-12-13T22:55:47.444 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.443+0000 7f601f7a2640 1 -- 172.21.15.91:0/3641561204 wait complete. 2023-12-13T22:55:47.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 Processor -- start 2023-12-13T22:55:47.445 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 -- start start 2023-12-13T22:55:47.446 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6018070ab0 0x7f60181ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60180c1ed0 0x7f6018143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f6018143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601813e6b0 con 0x7f6018070ab0 2023-12-13T22:55:47.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601813fc60 con 0x7f60180c1ed0 2023-12-13T22:55:47.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.447+0000 7f601f7a2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601813e8e0 con 0x7f601814f850 2023-12-13T22:55:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.451+0000 7f601cd3d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60180c1ed0 0x7f6018143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.451+0000 7f601dd3f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f6018143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.451+0000 7f601cd3d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60180c1ed0 0x7f6018143a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:50822/0 (socket says 172.21.15.91:50822) 2023-12-13T22:55:47.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.451+0000 7f601cd3d640 1 -- 172.21.15.91:0/1758642725 learned_addr learned my addr 172.21.15.91:0/1758642725 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:47.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.451+0000 7f601d53e640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6018070ab0 0x7f60181ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.456 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 -- 172.21.15.91:0/1758642725 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 msgr2=0x7f6018143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f601814f850 0x7f6018143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 -- 172.21.15.91:0/1758642725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60180c1ed0 msgr2=0x7f6018143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60180c1ed0 0x7f6018143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080094d0 con 0x7f6018070ab0 2023-12-13T22:55:47.459 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.459+0000 7f601d53e640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6018070ab0 0x7f60181ef230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f601400d5f0 tx=0x7f601400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140125f0 con 0x7f6018070ab0 2023-12-13T22:55:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014012750 con 0x7f6018070ab0 2023-12-13T22:55:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014012ae0 con 0x7f6018070ab0 2023-12-13T22:55:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601813ebc0 con 0x7f6018070ab0 2023-12-13T22:55:47.462 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601813f180 con 0x7f6018070ab0 2023-12-13T22:55:47.463 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.463+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6018071d80 con 0x7f6018070ab0 2023-12-13T22:55:47.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.483+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6014012c40 con 0x7f6018070ab0 2023-12-13T22:55:47.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.483+0000 7f600dffb640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5ffc06ac50 0x7f5ffc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.483 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.483+0000 7f601cd3d640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5ffc06ac50 0x7f5ffc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.484 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.487+0000 7f601cd3d640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5ffc06ac50 0x7f5ffc06d110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f601806dfb0 tx=0x7f60080b4040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6014055e70 con 0x7f6018070ab0 2023-12-13T22:55:47.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f600dffb640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f5ffc074530 0x7f5ffc0769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.492 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ffc0770a0 con 0x7f5ffc074530 2023-12-13T22:55:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6014015ea0 con 0x7f6018070ab0 2023-12-13T22:55:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f601dd3f640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f5ffc074530 0x7f5ffc0769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f601dd3f640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f5ffc074530 0x7f5ffc0769d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.493 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.495+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== osd.2 v2:172.21.15.91:6826/4024773626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5ffc0770a0 con 0x7f5ffc074530 2023-12-13T22:55:47.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.507+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 --> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60180c4e30 con 0x7f5ffc074530 2023-12-13T22:55:47.507 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.507+0000 7f600dffb640 1 -- 172.21.15.91:0/1758642725 <== osd.2 v2:172.21.15.91:6826/4024773626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6010001aa0 con 0x7f5ffc074530 2023-12-13T22:55:47.508 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:47.508 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:47.508 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.507+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f5ffc074530 msgr2=0x7f5ffc0769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.507+0000 7f601f7a2640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6826/4024773626,v1:172.21.15.91:6827/4024773626] conn(0x7f5ffc074530 0x7f5ffc0769d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5ffc06ac50 msgr2=0x7f5ffc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5ffc06ac50 0x7f5ffc06d110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f601806dfb0 tx=0x7f60080b4040 comp rx=0 tx=0).stop 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6018070ab0 msgr2=0x7f60181ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 --2- 172.21.15.91:0/1758642725 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f6018070ab0 0x7f60181ef230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f601400d5f0 tx=0x7f601400dab0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601dd3f640 1 -- 172.21.15.91:0/1758642725 reap_dead start 2023-12-13T22:55:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 shutdown_connections 2023-12-13T22:55:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 >> 172.21.15.91:0/1758642725 conn(0x7f601806c6a0 msgr2=0x7f60180c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 shutdown_connections 2023-12-13T22:55:47.511 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.511+0000 7f601f7a2640 1 -- 172.21.15.91:0/1758642725 wait complete. 2023-12-13T22:55:47.526 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-13T22:55:47.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 Processor -- start 2023-12-13T22:55:47.649 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 -- start start 2023-12-13T22:55:47.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f780c0ce0c0 0x7f780c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0cd9a0 con 0x7f780c15a280 2023-12-13T22:55:47.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c1596c0 con 0x7f780c0cc3c0 2023-12-13T22:55:47.650 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.651+0000 7f78113ca640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0ca550 con 0x7f780c0ce0c0 2023-12-13T22:55:47.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.655+0000 7f780b7fe640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f780c15a280 0x7f780c163e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56270/0 (socket says 172.21.15.91:56270) 2023-12-13T22:55:47.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.655+0000 7f780b7fe640 1 -- 172.21.15.91:0/1446791301 learned_addr learned my addr 172.21.15.91:0/1446791301 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:47.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.655+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748522970 0 0) 0x7f780c0cd9a0 con 0x7f780c15a280 2023-12-13T22:55:47.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.655+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003530 con 0x7f780c15a280 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3714637630 0 0) 0x7f77f8003530 con 0x7f780c15a280 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 >> v2:172.21.15.152:3300/0 conn(0x7f780c0ce0c0 msgr2=0x7f780c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 --2- 172.21.15.91:0/1446791301 >> v2:172.21.15.152:3300/0 conn(0x7f780c0ce0c0 0x7f780c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 >> v1:172.21.15.152:6789/0 conn(0x7f780c0cc3c0 legacy=0x7f780c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0cd6c0 con 0x7f780c15a280 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.659+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f77f4001680 con 0x7f780c15a280 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 >> v1:172.21.15.91:6789/0 conn(0x7f780c15a280 legacy=0x7f780c163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77f80039f0 0x7f77f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.660 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80052e0 0x7f77f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800c1f0 con 0x7f77f80047d0 2023-12-13T22:55:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800c360 con 0x7f77f80052e0 2023-12-13T22:55:47.661 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.663+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800c520 con 0x7f77f80039f0 2023-12-13T22:55:47.663 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.666 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780affd640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77f80039f0 0x7f77f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 -- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77f80039f0 msgr2=0x7f77f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77f80039f0 0x7f77f8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 -- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80052e0 msgr2=0x7f77f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80052e0 0x7f77f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780a7fc640 1 -- 172.21.15.91:0/1446791301 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8003530 con 0x7f77f80047d0 2023-12-13T22:55:47.667 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.667+0000 7f780b7fe640 1 -- 172.21.15.91:0/1446791301 reap_dead start 2023-12-13T22:55:47.671 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.671+0000 7f780a7fc640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f77fc001e70 tx=0x7f77fc01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86579b1029ae57f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.675+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc003b80 con 0x7f77f80047d0 2023-12-13T22:55:47.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.675+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc003ce0 con 0x7f77f80047d0 2023-12-13T22:55:47.675 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.675+0000 7f7809ffb640 1 -- 172.21.15.91:0/1446791301 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0052c0 con 0x7f77f80047d0 2023-12-13T22:55:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 msgr2=0x7f77f8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f77fc001e70 tx=0x7f77fc01c740 comp rx=0 tx=0).stop 2023-12-13T22:55:47.676 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- 172.21.15.91:0/1446791301 shutdown_connections 2023-12-13T22:55:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 --2- 172.21.15.91:0/1446791301 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- 172.21.15.91:0/1446791301 >> 172.21.15.91:0/1446791301 conn(0x7f780c0b07c0 msgr2=0x7f780c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- 172.21.15.91:0/1446791301 shutdown_connections 2023-12-13T22:55:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- 172.21.15.91:0/1446791301 wait complete. 2023-12-13T22:55:47.677 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 Processor -- start 2023-12-13T22:55:47.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- start start 2023-12-13T22:55:47.678 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f780c0c2130 0x7f780c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c1f3420 0x7f780c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1568d0 con 0x7f77f80047d0 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0cbdc0 con 0x7f780c1f3420 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f78113ca640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c15bff0 con 0x7f780c0c2130 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f780affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.679+0000 7f780affd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57302/0 (socket says 172.21.15.91:57302) 2023-12-13T22:55:47.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 -- 172.21.15.91:0/3976794069 learned_addr learned my addr 172.21.15.91:0/3976794069 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:47.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780b7fe640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c1f3420 0x7f780c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780a7fc640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f780c0c2130 0x7f780c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 -- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f780c0c2130 msgr2=0x7f780c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f780c0c2130 0x7f780c15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.683 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 -- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c1f3420 msgr2=0x7f780c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:47.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c1f3420 0x7f780c152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:47.684 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.683+0000 7f780affd640 1 -- 172.21.15.91:0/3976794069 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c156310 con 0x7f77f80047d0 2023-12-13T22:55:47.686 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.687+0000 7f780affd640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f780400d550 tx=0x7f780400da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804014620 con 0x7f77f80047d0 2023-12-13T22:55:47.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804014780 con 0x7f77f80047d0 2023-12-13T22:55:47.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804014b30 con 0x7f77f80047d0 2023-12-13T22:55:47.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c1565f0 con 0x7f77f80047d0 2023-12-13T22:55:47.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c1f2c20 con 0x7f77f80047d0 2023-12-13T22:55:47.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.691+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c1f27a0 con 0x7f77f80047d0 2023-12-13T22:55:47.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.971+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7804014c90 con 0x7f77f80047d0 2023-12-13T22:55:47.968 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.971+0000 7f78037fe640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 0x7f77ec068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.971+0000 7f780a7fc640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 0x7f77ec068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:47.969 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.971+0000 7f780a7fc640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 0x7f77ec068ce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005000 tx=0x7f77fc001520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:47.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.995+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7804055960 con 0x7f77f80047d0 2023-12-13T22:55:47.992 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:47.995+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7804051ca0 con 0x7f77f80047d0 2023-12-13T22:55:48.168 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f780c0cb3d0 con 0x7f77ec066820 2023-12-13T22:55:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78037fe640 1 -- 172.21.15.91:0/3976794069 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f77fc003b60 con 0x7f77ec066820 2023-12-13T22:55:48.169 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 2 to deep-scrub 2023-12-13T22:55:48.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 msgr2=0x7f77ec068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 0x7f77ec068ce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f77fc005000 tx=0x7f77fc001520 comp rx=0 tx=0).stop 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 msgr2=0x7f780c1efcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f780400d550 tx=0x7f780400da10 comp rx=0 tx=0).stop 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 shutdown_connections 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f77ec066820 0x7f77ec068ce0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f780c1f3420 0x7f780c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f780c0c2130 0x7f780c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 --2- 172.21.15.91:0/3976794069 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f77f80047d0 0x7f780c1efcb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 >> 172.21.15.91:0/3976794069 conn(0x7f780c0b07c0 msgr2=0x7f780c14d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:48.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 shutdown_connections 2023-12-13T22:55:48.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.171+0000 7f78113ca640 1 -- 172.21.15.91:0/3976794069 wait complete. 2023-12-13T22:55:48.189 INFO:tasks.ceph:Scrubbing osd.3 2023-12-13T22:55:48.189 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:48.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.323+0000 7f090030f640 1 Processor -- start 2023-12-13T22:55:48.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.323+0000 7f090030f640 1 -- start start 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f090030f640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08f814fc10 0x7f08f81559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f090030f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f80c6960 0x7f08f806b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f090030f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f806afb0 con 0x7f08f80c6540 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f090030f640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f806b980 con 0x7f08f814fc10 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f090030f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80c6ed0 con 0x7f08f80c6960 2023-12-13T22:55:48.324 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f08fe0ab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08f814fc10 0x7f08f81559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f08fe0ab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f08f814fc10 0x7f08f81559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57306/0 (socket says 172.21.15.91:57306) 2023-12-13T22:55:48.325 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.327+0000 7f08fe0ab640 1 -- 172.21.15.91:0/425405878 learned_addr learned my addr 172.21.15.91:0/425405878 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:48.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.331+0000 7f08fe0ab640 1 -- 172.21.15.91:0/425405878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f80c6960 msgr2=0x7f08f806b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:48.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.331+0000 7f08fe0ab640 1 --2- 172.21.15.91:0/425405878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f80c6960 0x7f08f806b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.331+0000 7f08fe0ab640 1 -- 172.21.15.91:0/425405878 >> v1:172.21.15.91:6789/0 conn(0x7f08f80c6540 legacy=0x7f08f80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.328 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.331+0000 7f08fe0ab640 1 -- 172.21.15.91:0/425405878 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80c7170 con 0x7f08f814fc10 2023-12-13T22:55:48.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.335+0000 7f08fe0ab640 1 --2- 172.21.15.91:0/425405878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f814fc10 0x7f08f81559e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009870 tx=0x7f08f401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2179317431574d2a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f08fd0a9640 1 -- 172.21.15.91:0/425405878 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40a8a30 con 0x7f08f814fc10 2023-12-13T22:55:48.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f08fd0a9640 1 -- 172.21.15.91:0/425405878 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f40a8b90 con 0x7f08f814fc10 2023-12-13T22:55:48.336 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f08fd0a9640 1 -- 172.21.15.91:0/425405878 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40b0440 con 0x7f08f814fc10 2023-12-13T22:55:48.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- 172.21.15.91:0/425405878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f814fc10 msgr2=0x7f08f81559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- 172.21.15.91:0/425405878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f814fc10 0x7f08f81559e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009870 tx=0x7f08f401ed30 comp rx=0 tx=0).stop 2023-12-13T22:55:48.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- 172.21.15.91:0/425405878 shutdown_connections 2023-12-13T22:55:48.337 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- 172.21.15.91:0/425405878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f80c6960 0x7f08f806b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- 172.21.15.91:0/425405878 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f814fc10 0x7f08f81559e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- 172.21.15.91:0/425405878 >> 172.21.15.91:0/425405878 conn(0x7f08f806d220 msgr2=0x7f08f806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- 172.21.15.91:0/425405878 shutdown_connections 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- 172.21.15.91:0/425405878 wait complete. 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 Processor -- start 2023-12-13T22:55:48.338 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- start start 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08f80c6960 0x7f08f81f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f814fc10 0x7f08f81615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 0x7f08f814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f814e630 con 0x7f08f806a740 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f814bbb0 con 0x7f08f80c6960 2023-12-13T22:55:48.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.339+0000 7f090030f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815aac0 con 0x7f08f814fc10 2023-12-13T22:55:48.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.343+0000 7f08fe8ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 0x7f08f814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.343+0000 7f08fe8ac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 0x7f08f814bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57314/0 (socket says 172.21.15.91:57314) 2023-12-13T22:55:48.340 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.343+0000 7f08fe8ac640 1 -- 172.21.15.91:0/1475282206 learned_addr learned my addr 172.21.15.91:0/1475282206 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:48.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 -- 172.21.15.91:0/1475282206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f814fc10 msgr2=0x7f08f81615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08f814fc10 0x7f08f81615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 -- 172.21.15.91:0/1475282206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08f80c6960 msgr2=0x7f08f81f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08f80c6960 0x7f08f81f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.344 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40094d0 con 0x7f08f806a740 2023-12-13T22:55:48.347 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.347+0000 7f08fe8ac640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 0x7f08f814bfd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08f000b9a0 tx=0x7f08f000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000cb40 con 0x7f08f806a740 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000ccc0 con 0x7f08f806a740 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f814aad0 con 0x7f08f806a740 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0014680 con 0x7f08f806a740 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f814b5c0 con 0x7f08f806a740 2023-12-13T22:55:48.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.351+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08f8156180 con 0x7f08f806a740 2023-12-13T22:55:48.370 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.371+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f08f001d3b0 con 0x7f08f806a740 2023-12-13T22:55:48.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.371+0000 7f08eeffd640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f08dc066840 0x7f08dc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.371+0000 7f08fe0ab640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f08dc066840 0x7f08dc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.371 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.371+0000 7f08fe0ab640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f08dc066840 0x7f08dc068d00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f40b2000 tx=0x7f08f4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08f000ce30 con 0x7f08f806a740 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08eeffd640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f08dc070120 0x7f08dc0725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08dc072c90 con 0x7f08dc070120 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f0055520 con 0x7f08f806a740 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08fd8aa640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f08dc070120 0x7f08dc0725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.375 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.375+0000 7f08fd8aa640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f08dc070120 0x7f08dc0725c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.376 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.379+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== osd.3 v2:172.21.15.91:6802/470541736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f08dc072c90 con 0x7f08dc070120 2023-12-13T22:55:48.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 --> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f08f81536e0 con 0x7f08dc070120 2023-12-13T22:55:48.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f08eeffd640 1 -- 172.21.15.91:0/1475282206 <== osd.3 v2:172.21.15.91:6802/470541736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f08f81536e0 con 0x7f08dc070120 2023-12-13T22:55:48.390 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:48.390 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:48.390 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f08dc070120 msgr2=0x7f08dc0725c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6802/470541736,v1:172.21.15.91:6803/470541736] conn(0x7f08dc070120 0x7f08dc0725c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f08dc066840 msgr2=0x7f08dc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f08dc066840 0x7f08dc068d00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f40b2000 tx=0x7f08f4004740 comp rx=0 tx=0).stop 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 msgr2=0x7f08f814bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 --2- 172.21.15.91:0/1475282206 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f08f806a740 0x7f08f814bfd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08f000b9a0 tx=0x7f08f000be60 comp rx=0 tx=0).stop 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f08fe8ac640 1 -- 172.21.15.91:0/1475282206 reap_dead start 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 shutdown_connections 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 >> 172.21.15.91:0/1475282206 conn(0x7f08f806d220 msgr2=0x7f08f8155760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 shutdown_connections 2023-12-13T22:55:48.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.391+0000 7f090030f640 1 -- 172.21.15.91:0/1475282206 wait complete. 2023-12-13T22:55:48.409 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-13T22:55:48.526 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 Processor -- start 2023-12-13T22:55:48.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 -- start start 2023-12-13T22:55:48.527 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff4f413d0c0 0x7ff4f415a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff4f415ae80 0x7ff4f40cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f413d4a0 con 0x7ff4f406a5f0 2023-12-13T22:55:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f4157350 con 0x7ff4f415ae80 2023-12-13T22:55:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.527+0000 7ff4fc09b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f4158320 con 0x7ff4f413d0c0 2023-12-13T22:55:48.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.531+0000 7ff4f9e37640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff4f413d0c0 0x7ff4f415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.531+0000 7ff4f9e37640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff4f413d0c0 0x7ff4f415a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:50872/0 (socket says 172.21.15.91:50872) 2023-12-13T22:55:48.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.531+0000 7ff4f9e37640 1 -- 172.21.15.91:0/2438960569 learned_addr learned my addr 172.21.15.91:0/2438960569 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:48.532 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.535+0000 7ff4fa638640 1 --2- 172.21.15.91:0/2438960569 >> v2:172.21.15.91:3300/0 conn(0x7ff4f415ae80 0x7ff4f40cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.535+0000 7ff4f9e37640 1 -- 172.21.15.91:0/2438960569 >> v2:172.21.15.91:3300/0 conn(0x7ff4f415ae80 msgr2=0x7ff4f40cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.535+0000 7ff4f9e37640 1 --2- 172.21.15.91:0/2438960569 >> v2:172.21.15.91:3300/0 conn(0x7ff4f415ae80 0x7ff4f40cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.535+0000 7ff4f9e37640 1 -- 172.21.15.91:0/2438960569 >> v1:172.21.15.91:6789/0 conn(0x7ff4f406a5f0 legacy=0x7ff4f40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:48.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.535+0000 7ff4f9e37640 1 -- 172.21.15.91:0/2438960569 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40cbf50 con 0x7ff4f413d0c0 2023-12-13T22:55:48.541 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.543+0000 7ff4f9e37640 1 --2- 172.21.15.91:0/2438960569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f415a940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4157490 tx=0x7ff4f001f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37ca1c568d23d03 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4f8e35640 1 -- 172.21.15.91:0/2438960569 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00af400 con 0x7ff4f413d0c0 2023-12-13T22:55:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4f8e35640 1 -- 172.21.15.91:0/2438960569 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00ab050 con 0x7ff4f413d0c0 2023-12-13T22:55:48.689 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4f8e35640 1 -- 172.21.15.91:0/2438960569 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00af780 con 0x7ff4f413d0c0 2023-12-13T22:55:48.690 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- 172.21.15.91:0/2438960569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 msgr2=0x7ff4f415a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/2438960569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f415a940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4157490 tx=0x7ff4f001f180 comp rx=0 tx=0).stop 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- 172.21.15.91:0/2438960569 shutdown_connections 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/2438960569 >> v2:172.21.15.91:3300/0 conn(0x7ff4f415ae80 0x7ff4f40cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/2438960569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f415a940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- 172.21.15.91:0/2438960569 >> 172.21.15.91:0/2438960569 conn(0x7ff4f406d200 msgr2=0x7ff4f406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- 172.21.15.91:0/2438960569 shutdown_connections 2023-12-13T22:55:48.691 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- 172.21.15.91:0/2438960569 wait complete. 2023-12-13T22:55:48.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 Processor -- start 2023-12-13T22:55:48.692 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.691+0000 7ff4fc09b640 1 -- start start 2023-12-13T22:55:48.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f406f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff4f415ae80 0x7ff4f41ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40c3270 con 0x7ff4f406a5f0 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40c3000 con 0x7ff4f413d0c0 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4fc09b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41e22e0 con 0x7ff4f415ae80 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4f9e37640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:48.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4f9e37640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:57330/0 (socket says 172.21.15.91:57330) 2023-12-13T22:55:48.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.695+0000 7ff4f9e37640 1 -- 172.21.15.91:0/581945132 learned_addr learned my addr 172.21.15.91:0/581945132 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.703+0000 7ff4f9e37640 1 -- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff4f415ae80 msgr2=0x7ff4f41ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.703+0000 7ff4f9e37640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff4f415ae80 0x7ff4f41ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.703+0000 7ff4f9e37640 1 -- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 msgr2=0x7ff4f406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.703+0000 7ff4f9e37640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:48.703 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.703+0000 7ff4f9e37640 1 -- 172.21.15.91:0/581945132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009b30 con 0x7ff4f406a5f0 2023-12-13T22:55:48.714 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.715+0000 7ff4f9e37640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff4f001bd90 tx=0x7ff4f001bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:48.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00b9410 con 0x7ff4f406a5f0 2023-12-13T22:55:48.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00b9590 con 0x7ff4f406a5f0 2023-12-13T22:55:48.721 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f40c3c90 con 0x7ff4f406a5f0 2023-12-13T22:55:48.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00b9940 con 0x7ff4f406a5f0 2023-12-13T22:55:48.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f40c4250 con 0x7ff4f406a5f0 2023-12-13T22:55:48.722 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:48.723+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f4073e70 con 0x7ff4f406a5f0 2023-12-13T22:55:49.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.007+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff4f00b6070 con 0x7ff4f406a5f0 2023-12-13T22:55:49.006 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.007+0000 7ff4ea7fc640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 0x7ff4d8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.007 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.007+0000 7ff4f9636640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 0x7ff4d8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.008 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.011+0000 7ff4f9636640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 0x7ff4d8068cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4007fd0 tx=0x7ff4e40079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.083+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff4f00f45e0 con 0x7ff4f406a5f0 2023-12-13T22:55:49.083 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.083+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff4f00f0220 con 0x7ff4f406a5f0 2023-12-13T22:55:49.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.255+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f4157b20 con 0x7ff4d80667f0 2023-12-13T22:55:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 3 to deep-scrub 2023-12-13T22:55:49.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4ea7fc640 1 -- 172.21.15.91:0/581945132 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4e40050d0 con 0x7ff4d80667f0 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 msgr2=0x7ff4d8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 0x7ff4d8068cb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4007fd0 tx=0x7ff4e40079a0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 msgr2=0x7ff4f40c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff4f001bd90 tx=0x7ff4f001bf20 comp rx=0 tx=0).stop 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 shutdown_connections 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff4d80667f0 0x7ff4d8068cb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff4f415ae80 0x7ff4f41ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.259 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4f413d0c0 0x7ff4f406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 --2- 172.21.15.91:0/581945132 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff4f406a5f0 0x7ff4f40c2ac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 >> 172.21.15.91:0/581945132 conn(0x7ff4f406d200 msgr2=0x7ff4f4139d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:49.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 shutdown_connections 2023-12-13T22:55:49.260 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.259+0000 7ff4fc09b640 1 -- 172.21.15.91:0/581945132 wait complete. 2023-12-13T22:55:49.276 INFO:tasks.ceph:Scrubbing osd.4 2023-12-13T22:55:49.276 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:49.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 Processor -- start 2023-12-13T22:55:49.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 -- start start 2023-12-13T22:55:49.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f10e80c8ca0 0x7f10e8164e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80c6780 con 0x7f10e81537c0 2023-12-13T22:55:49.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e8070010 con 0x7f10e806f2a0 2023-12-13T22:55:49.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10f013a640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80c14f0 con 0x7f10e80c8ca0 2023-12-13T22:55:49.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.399+0000 7f10ee6d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f10e80c8ca0 0x7f10e8164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10eded6640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f10e81537c0 0x7f10e815ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56102/0 (socket says 172.21.15.91:56102) 2023-12-13T22:55:49.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10ed6d5640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f10e806f2a0 0x7f10e80c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:48512/0 (socket says 172.21.15.91:48512) 2023-12-13T22:55:49.400 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10eded6640 1 -- 172.21.15.91:0/4063370431 learned_addr learned my addr 172.21.15.91:0/4063370431 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:49.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10ee6d7640 1 -- 172.21.15.91:0/4063370431 >> v1:172.21.15.152:6789/0 conn(0x7f10e806f2a0 legacy=0x7f10e80c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.403 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10ee6d7640 1 -- 172.21.15.91:0/4063370431 >> v1:172.21.15.91:6789/0 conn(0x7f10e81537c0 legacy=0x7f10e815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.403+0000 7f10ee6d7640 1 -- 172.21.15.91:0/4063370431 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8159ee0 con 0x7f10e80c8ca0 2023-12-13T22:55:49.407 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.407+0000 7f10ee6d7640 1 --2- 172.21.15.91:0/4063370431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e80c8ca0 0x7f10e8164e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104aa1c266599c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10eced4640 1 -- 172.21.15.91:0/4063370431 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00a8970 con 0x7f10e80c8ca0 2023-12-13T22:55:49.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10eced4640 1 -- 172.21.15.91:0/4063370431 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00a8ad0 con 0x7f10e80c8ca0 2023-12-13T22:55:49.412 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10eced4640 1 -- 172.21.15.91:0/4063370431 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00a8e60 con 0x7f10e80c8ca0 2023-12-13T22:55:49.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- 172.21.15.91:0/4063370431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e80c8ca0 msgr2=0x7f10e8164e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 --2- 172.21.15.91:0/4063370431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e80c8ca0 0x7f10e8164e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001ec70 comp rx=0 tx=0).stop 2023-12-13T22:55:49.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- 172.21.15.91:0/4063370431 shutdown_connections 2023-12-13T22:55:49.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 --2- 172.21.15.91:0/4063370431 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e80c8ca0 0x7f10e8164e10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- 172.21.15.91:0/4063370431 >> 172.21.15.91:0/4063370431 conn(0x7f10e806b670 msgr2=0x7f10e806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:49.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- 172.21.15.91:0/4063370431 shutdown_connections 2023-12-13T22:55:49.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- 172.21.15.91:0/4063370431 wait complete. 2023-12-13T22:55:49.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 Processor -- start 2023-12-13T22:55:49.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- start start 2023-12-13T22:55:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e806f2a0 0x7f10e806a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10e80c8ca0 0x7f10e814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 0x7f10e814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e806b290 con 0x7f10e81537c0 2023-12-13T22:55:49.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80c41d0 con 0x7f10e806f2a0 2023-12-13T22:55:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.415+0000 7f10f013a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80c44b0 con 0x7f10e80c8ca0 2023-12-13T22:55:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.419+0000 7f10ee6d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 0x7f10e814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.419+0000 7f10ee6d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 0x7f10e814fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34382/0 (socket says 172.21.15.91:34382) 2023-12-13T22:55:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.419+0000 7f10ee6d7640 1 -- 172.21.15.91:0/3010487505 learned_addr learned my addr 172.21.15.91:0/3010487505 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:49.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.419+0000 7f10eded6640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e806f2a0 0x7f10e806a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.419+0000 7f10ed6d5640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10e80c8ca0 0x7f10e814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 -- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10e80c8ca0 msgr2=0x7f10e814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10e80c8ca0 0x7f10e814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 -- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e806f2a0 msgr2=0x7f10e806a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10e806f2a0 0x7f10e806a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009420 con 0x7f10e81537c0 2023-12-13T22:55:49.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.423+0000 7f10ee6d7640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 0x7f10e814fad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f10e001b880 tx=0x7f10e001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b9630 con 0x7f10e81537c0 2023-12-13T22:55:49.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00b9790 con 0x7f10e81537c0 2023-12-13T22:55:49.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b9b40 con 0x7f10e81537c0 2023-12-13T22:55:49.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e80c3ec0 con 0x7f10e81537c0 2023-12-13T22:55:49.426 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e8156780 con 0x7f10e81537c0 2023-12-13T22:55:49.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.427+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10e81595f0 con 0x7f10e81537c0 2023-12-13T22:55:49.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.447+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f10e00b7040 con 0x7f10e81537c0 2023-12-13T22:55:49.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.447+0000 7f10de7fc640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f10cc066840 0x7f10cc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.447+0000 7f10eded6640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f10cc066840 0x7f10cc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10eded6640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f10cc066840 0x7f10cc068d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005c10 tx=0x7f10e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f10e00f3b50 con 0x7f10e81537c0 2023-12-13T22:55:49.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10de7fc640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f10cc0700a0 0x7f10cc072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10cc072c10 con 0x7f10cc0700a0 2023-12-13T22:55:49.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10ed6d5640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f10cc0700a0 0x7f10cc072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10ed6d5640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f10cc0700a0 0x7f10cc072540 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.451+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10e00efe90 con 0x7f10e81537c0 2023-12-13T22:55:49.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.455+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== osd.4 v2:172.21.15.152:6808/501453671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f10cc072c10 con 0x7f10cc0700a0 2023-12-13T22:55:49.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 --> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f10e815d180 con 0x7f10cc0700a0 2023-12-13T22:55:49.466 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10de7fc640 1 -- 172.21.15.91:0/3010487505 <== osd.4 v2:172.21.15.152:6808/501453671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f10d8004a70 con 0x7f10cc0700a0 2023-12-13T22:55:49.467 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:49.467 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:49.467 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f10cc0700a0 msgr2=0x7f10cc072540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.152:6808/501453671,v1:172.21.15.152:6809/501453671] conn(0x7f10cc0700a0 0x7f10cc072540 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f10cc066840 msgr2=0x7f10cc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f10cc066840 0x7f10cc068d00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005c10 tx=0x7f10e4009040 comp rx=0 tx=0).stop 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 msgr2=0x7f10e814fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 --2- 172.21.15.91:0/3010487505 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f10e81537c0 0x7f10e814fad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f10e001b880 tx=0x7f10e001ba10 comp rx=0 tx=0).stop 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10ee6d7640 1 -- 172.21.15.91:0/3010487505 reap_dead start 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 shutdown_connections 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 >> 172.21.15.91:0/3010487505 conn(0x7f10e806b670 msgr2=0x7f10e81e4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 shutdown_connections 2023-12-13T22:55:49.468 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.467+0000 7f10f013a640 1 -- 172.21.15.91:0/3010487505 wait complete. 2023-12-13T22:55:49.486 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-13T22:55:49.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 Processor -- start 2023-12-13T22:55:49.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 -- start start 2023-12-13T22:55:49.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f40e8070f60 0x7f40e806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f40e806f5f0 0x7f40e8157340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e815b430 con 0x7f40e81515e0 2023-12-13T22:55:49.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e806ee10 con 0x7f40e8070f60 2023-12-13T22:55:49.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.607+0000 7f40ef144640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e815a860 con 0x7f40e806f5f0 2023-12-13T22:55:49.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.611+0000 7f40ed6e1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f40e806f5f0 0x7f40e8157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.611+0000 7f40ed6e1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f40e806f5f0 0x7f40e8157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:43710/0 (socket says 172.21.15.91:43710) 2023-12-13T22:55:49.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.611+0000 7f40ed6e1640 1 -- 172.21.15.91:0/3883969321 learned_addr learned my addr 172.21.15.91:0/3883969321 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:49.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.619+0000 7f40ed6e1640 1 -- 172.21.15.91:0/3883969321 >> v2:172.21.15.91:3300/0 conn(0x7f40e8070f60 msgr2=0x7f40e806e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:49.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.619+0000 7f40ed6e1640 1 --2- 172.21.15.91:0/3883969321 >> v2:172.21.15.91:3300/0 conn(0x7f40e8070f60 0x7f40e806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.619+0000 7f40ed6e1640 1 -- 172.21.15.91:0/3883969321 >> v1:172.21.15.91:6789/0 conn(0x7f40e81515e0 legacy=0x7f40e80c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:49.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.619+0000 7f40ed6e1640 1 -- 172.21.15.91:0/3883969321 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e806f030 con 0x7f40e806f5f0 2023-12-13T22:55:49.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.627+0000 7f40ed6e1640 1 --2- 172.21.15.91:0/3883969321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e806f5f0 0x7f40e8157340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c75a0 tx=0x7f40e001c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0eabb93e200c27 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.635+0000 7f40e77fe640 1 -- 172.21.15.91:0/3883969321 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00a5730 con 0x7f40e806f5f0 2023-12-13T22:55:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.635+0000 7f40e77fe640 1 -- 172.21.15.91:0/3883969321 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00a5890 con 0x7f40e806f5f0 2023-12-13T22:55:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.635+0000 7f40e77fe640 1 -- 172.21.15.91:0/3883969321 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00a5c20 con 0x7f40e806f5f0 2023-12-13T22:55:49.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- 172.21.15.91:0/3883969321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e806f5f0 msgr2=0x7f40e8157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- 172.21.15.91:0/3883969321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e806f5f0 0x7f40e8157340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c75a0 tx=0x7f40e001c960 comp rx=0 tx=0).stop 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- 172.21.15.91:0/3883969321 shutdown_connections 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- 172.21.15.91:0/3883969321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e806f5f0 0x7f40e8157340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- 172.21.15.91:0/3883969321 >> v2:172.21.15.91:3300/0 conn(0x7f40e8070f60 0x7f40e806e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- 172.21.15.91:0/3883969321 >> 172.21.15.91:0/3883969321 conn(0x7f40e806d3b0 msgr2=0x7f40e806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- 172.21.15.91:0/3883969321 shutdown_connections 2023-12-13T22:55:49.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- 172.21.15.91:0/3883969321 wait complete. 2023-12-13T22:55:49.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 Processor -- start 2023-12-13T22:55:49.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- start start 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40e8070f60 0x7f40e80ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e81515e0 0x7f40e81415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e81568f0 con 0x7f40e8070f60 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80c8b40 con 0x7f40e81515e0 2023-12-13T22:55:49.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.639+0000 7f40ef144640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e81f2170 con 0x7f40e806f5f0 2023-12-13T22:55:49.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.643+0000 7f40ecee0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.643+0000 7f40ecee0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:36980/0 (socket says 172.21.15.91:36980) 2023-12-13T22:55:49.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.643+0000 7f40ecee0640 1 -- 172.21.15.91:0/3985191931 learned_addr learned my addr 172.21.15.91:0/3985191931 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:49.642 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.643+0000 7f40ed6e1640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e81515e0 0x7f40e81415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:49.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.655+0000 7f40ecee0640 1 -- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e81515e0 msgr2=0x7f40e81415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.655 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.655+0000 7f40ecee0640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e81515e0 0x7f40e81415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.655+0000 7f40ecee0640 1 -- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40e8070f60 msgr2=0x7f40e80ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:49.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.655+0000 7f40ecee0640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40e8070f60 0x7f40e80ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:49.656 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.655+0000 7f40ecee0640 1 -- 172.21.15.91:0/3985191931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009b30 con 0x7f40e806f5f0 2023-12-13T22:55:49.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.803+0000 7f40ecee0640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b3e0 tx=0x7f40dc00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:49.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc011830 con 0x7f40e806f5f0 2023-12-13T22:55:49.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0119b0 con 0x7f40e806f5f0 2023-12-13T22:55:49.812 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc011d60 con 0x7f40e806f5f0 2023-12-13T22:55:49.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e81f2450 con 0x7f40e806f5f0 2023-12-13T22:55:49.813 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e81f2a10 con 0x7f40e806f5f0 2023-12-13T22:55:49.814 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:49.815+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e80c8cb0 con 0x7f40e806f5f0 2023-12-13T22:55:50.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.135+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f40dc01a400 con 0x7f40e806f5f0 2023-12-13T22:55:50.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.135+0000 7f40e57fa640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 0x7f40cc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.139+0000 7f40e7fff640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 0x7f40cc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.137 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.139+0000 7f40e7fff640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 0x7f40cc068cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c4830 tx=0x7f40d4006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.147+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40dc055e50 con 0x7f40e806f5f0 2023-12-13T22:55:50.183 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.183+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f40dc051a90 con 0x7f40e806f5f0 2023-12-13T22:55:50.360 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f40e81519c0 con 0x7f40cc0667f0 2023-12-13T22:55:50.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40e57fa640 1 -- 172.21.15.91:0/3985191931 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f40d4013430 con 0x7f40cc0667f0 2023-12-13T22:55:50.361 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 4 to deep-scrub 2023-12-13T22:55:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 msgr2=0x7f40cc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.363 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 0x7f40cc068cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c4830 tx=0x7f40d4006c00 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 msgr2=0x7f40e81438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b3e0 tx=0x7f40dc00b8a0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 shutdown_connections 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f40cc0667f0 0x7f40cc068cb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e81515e0 0x7f40e81415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f40e8070f60 0x7f40e80ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 --2- 172.21.15.91:0/3985191931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40e806f5f0 0x7f40e81438b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 >> 172.21.15.91:0/3985191931 conn(0x7f40e806d3b0 msgr2=0x7f40e806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 shutdown_connections 2023-12-13T22:55:50.364 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.363+0000 7f40ef144640 1 -- 172.21.15.91:0/3985191931 wait complete. 2023-12-13T22:55:50.382 INFO:tasks.ceph:Scrubbing osd.5 2023-12-13T22:55:50.382 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:50.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 Processor -- start 2023-12-13T22:55:50.509 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 -- start start 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f75bc1505a0 0x7f75bc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0c72b0 con 0x7f75bc0c4630 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc15a100 con 0x7f75bc0c4a10 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c2a8f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0c4f40 con 0x7f75bc1505a0 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c082b640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f75bc0c4630 0x7f75bc1596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56124/0 (socket says 172.21.15.91:56124) 2023-12-13T22:55:50.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.511+0000 7f75c082b640 1 -- 172.21.15.91:0/2278188716 learned_addr learned my addr 172.21.15.91:0/2278188716 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:50.512 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.515+0000 7f75c102c640 1 --2- 172.21.15.91:0/2278188716 >> v2:172.21.15.152:3300/0 conn(0x7f75bc1505a0 0x7f75bc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.515+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702015001 0 0) 0x7f75bc0c72b0 con 0x7f75bc0c4630 2023-12-13T22:55:50.514 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.515+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003530 con 0x7f75bc0c4630 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2666257194 0 0) 0x7f75a4003530 con 0x7f75bc0c4630 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 >> v2:172.21.15.152:3300/0 conn(0x7f75bc1505a0 msgr2=0x7f75bc0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 --2- 172.21.15.91:0/2278188716 >> v2:172.21.15.152:3300/0 conn(0x7f75bc1505a0 0x7f75bc0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 >> v1:172.21.15.152:6789/0 conn(0x7f75bc0c4a10 legacy=0x7f75bc14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc15a3e0 con 0x7f75bc0c4630 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f75ac001680 con 0x7f75bc0c4630 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 >> v1:172.21.15.91:6789/0 conn(0x7f75bc0c4630 legacy=0x7f75bc1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75a40039f0 0x7f75a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a40047d0 0x7f75a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 0x7f75a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400c070 con 0x7f75a4005190 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400c1e0 con 0x7f75a40047d0 2023-12-13T22:55:50.519 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.519+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400c3a0 con 0x7f75a40039f0 2023-12-13T22:55:50.520 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.523+0000 7f75c082b640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75a40039f0 0x7f75a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.521 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.523+0000 7f75c102c640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 0x7f75a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.527+0000 7f75c102c640 1 -- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75a40039f0 msgr2=0x7f75a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:50.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.527+0000 7f75c102c640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75a40039f0 0x7f75a4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.527+0000 7f75c102c640 1 -- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a40047d0 msgr2=0x7f75a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:50.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.527+0000 7f75c102c640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a40047d0 0x7f75a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.525 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.527+0000 7f75c102c640 1 -- 172.21.15.91:0/2278188716 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4003530 con 0x7f75a4005190 2023-12-13T22:55:50.528 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.531+0000 7f75c102c640 1 -- 172.21.15.91:0/2278188716 reap_dead start 2023-12-13T22:55:50.529 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.531+0000 7f75c102c640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 0x7f75a400b990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009f90 tx=0x7f75b401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1889e9b9aab24ed server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.535+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40a5c70 con 0x7f75a4005190 2023-12-13T22:55:50.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.535+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400f040 con 0x7f75a4005190 2023-12-13T22:55:50.535 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.535+0000 7f75bb7fe640 1 -- 172.21.15.91:0/2278188716 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40039a0 con 0x7f75a4005190 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.535+0000 7f75c2a8f640 1 -- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 msgr2=0x7f75a400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.535+0000 7f75c2a8f640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 0x7f75a400b990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009f90 tx=0x7f75b401cc60 comp rx=0 tx=0).stop 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- 172.21.15.91:0/2278188716 shutdown_connections 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 --2- 172.21.15.91:0/2278188716 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75a4005190 0x7f75a400b990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- 172.21.15.91:0/2278188716 >> 172.21.15.91:0/2278188716 conn(0x7f75bc06c6a0 msgr2=0x7f75bc06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- 172.21.15.91:0/2278188716 shutdown_connections 2023-12-13T22:55:50.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- 172.21.15.91:0/2278188716 wait complete. 2023-12-13T22:55:50.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 Processor -- start 2023-12-13T22:55:50.538 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- start start 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a4005190 0x7f75bc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 0x7f75bc0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75bc154c10 0x7f75bc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc153f20 con 0x7f75bc0c8be0 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc154780 con 0x7f75a4005190 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75c2a8f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc155600 con 0x7f75bc154c10 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.539+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 0x7f75bc0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.539 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.543+0000 7f75bbfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 0x7f75bc0c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34418/0 (socket says 172.21.15.91:34418) 2023-12-13T22:55:50.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.543+0000 7f75bbfff640 1 -- 172.21.15.91:0/945299147 learned_addr learned my addr 172.21.15.91:0/945299147 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:50.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.543+0000 7f75c082b640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a4005190 0x7f75bc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.540 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.543+0000 7f75c102c640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75bc154c10 0x7f75bc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 -- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75bc154c10 msgr2=0x7f75bc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f75bc154c10 0x7f75bc1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 -- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a4005190 msgr2=0x7f75bc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a4005190 0x7f75bc071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.544 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0c91e0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.547+0000 7f75bbfff640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 0x7f75bc0c9760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c3c0 tx=0x7f75b000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.551+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b00052d0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.551+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0005450 con 0x7f75bc0c8be0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.551+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0007260 con 0x7f75bc0c8be0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.551+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc070df0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.551+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc154130 con 0x7f75bc0c8be0 2023-12-13T22:55:50.554 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.555+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75bc1568a0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.575+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f75b00073c0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.575+0000 7f75b97fa640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f75a80667e0 0x7f75a8068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.575+0000 7f75c082b640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f75a80667e0 0x7f75a8068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.575+0000 7f75c082b640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f75a80667e0 0x7f75a8068ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75ac007db0 tx=0x7f75ac001500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f75b0007670 con 0x7f75bc0c8be0 2023-12-13T22:55:50.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75b97fa640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f75a806ffc0 0x7f75a8072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75a8072b30 con 0x7f75a806ffc0 2023-12-13T22:55:50.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75b00511d0 con 0x7f75bc0c8be0 2023-12-13T22:55:50.577 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75c102c640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f75a806ffc0 0x7f75a8072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.579+0000 7f75c102c640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f75a806ffc0 0x7f75a8072460 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.583+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== osd.5 v2:172.21.15.152:6824/489484286 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f75a8072b30 con 0x7f75a806ffc0 2023-12-13T22:55:50.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 --> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75bc1565c0 con 0x7f75a806ffc0 2023-12-13T22:55:50.597 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75b97fa640 1 -- 172.21.15.91:0/945299147 <== osd.5 v2:172.21.15.152:6824/489484286 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f75b40ad440 con 0x7f75a806ffc0 2023-12-13T22:55:50.597 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:50.597 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:50.597 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f75a806ffc0 msgr2=0x7f75a8072460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.152:6824/489484286,v1:172.21.15.152:6825/489484286] conn(0x7f75a806ffc0 0x7f75a8072460 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f75a80667e0 msgr2=0x7f75a8068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.598 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f75a80667e0 0x7f75a8068ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75ac007db0 tx=0x7f75ac001500 comp rx=0 tx=0).stop 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 msgr2=0x7f75bc0c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 --2- 172.21.15.91:0/945299147 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f75bc0c8be0 0x7f75bc0c9760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c3c0 tx=0x7f75b000c7c0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c102c640 1 -- 172.21.15.91:0/945299147 reap_dead start 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 shutdown_connections 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 >> 172.21.15.91:0/945299147 conn(0x7f75bc06c6a0 msgr2=0x7f75bc0c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 shutdown_connections 2023-12-13T22:55:50.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.599+0000 7f75c2a8f640 1 -- 172.21.15.91:0/945299147 wait complete. 2023-12-13T22:55:50.620 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-13T22:55:50.741 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 Processor -- start 2023-12-13T22:55:50.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 -- start start 2023-12-13T22:55:50.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d806e790 0x7fa0d80c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0d806eb70 0x7fa0d80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d8072990 con 0x7fa0d8070b20 2023-12-13T22:55:50.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d80c6f60 con 0x7fa0d806eb70 2023-12-13T22:55:50.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0ddfa1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80c7240 con 0x7fa0d806e790 2023-12-13T22:55:50.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.743+0000 7fa0cffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0d806eb70 0x7fa0d80713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fa0d806eb70 0x7fa0d80713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34430/0 (socket says 172.21.15.91:34430) 2023-12-13T22:55:50.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 -- 172.21.15.91:0/2549760011 learned_addr learned my addr 172.21.15.91:0/2549760011 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:50.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0d77fe640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d806e790 0x7fa0d80c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 -- 172.21.15.91:0/2549760011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d806e790 msgr2=0x7fa0d80c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:50.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d806e790 0x7fa0d80c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 -- 172.21.15.91:0/2549760011 >> v1:172.21.15.152:6789/0 conn(0x7fa0d8070b20 legacy=0x7fa0d814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.746 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.747+0000 7fa0cffff640 1 -- 172.21.15.91:0/2549760011 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d8072060 con 0x7fa0d806eb70 2023-12-13T22:55:50.749 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.751+0000 7fa0cffff640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806eb70 0x7fa0d80713d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006fd0 tx=0x7fa0c00211c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f028a9943aa04ed server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0d6ffd640 1 -- 172.21.15.91:0/2549760011 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0004030 con 0x7fa0d806eb70 2023-12-13T22:55:50.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0d6ffd640 1 -- 172.21.15.91:0/2549760011 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00ad030 con 0x7fa0d806eb70 2023-12-13T22:55:50.754 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0d6ffd640 1 -- 172.21.15.91:0/2549760011 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0004410 con 0x7fa0d806eb70 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/2549760011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806eb70 msgr2=0x7fa0d80713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806eb70 0x7fa0d80713d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006fd0 tx=0x7fa0c00211c0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/2549760011 shutdown_connections 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806eb70 0x7fa0d80713d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/2549760011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d806e790 0x7fa0d80c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/2549760011 >> 172.21.15.91:0/2549760011 conn(0x7fa0d806c6a0 msgr2=0x7fa0d806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:50.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/2549760011 shutdown_connections 2023-12-13T22:55:50.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.755+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/2549760011 wait complete. 2023-12-13T22:55:50.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 Processor -- start 2023-12-13T22:55:50.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 -- start start 2023-12-13T22:55:50.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0d806eb70 0x7fa0d8152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d8070b20 0x7fa0d8152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8158220 con 0x7fa0d806e790 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8158c10 con 0x7fa0d806eb70 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0ddfa1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d81eb380 con 0x7fa0d8070b20 2023-12-13T22:55:50.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0d77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0d77fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34436/0 (socket says 172.21.15.91:34436) 2023-12-13T22:55:50.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0d77fe640 1 -- 172.21.15.91:0/687211779 learned_addr learned my addr 172.21.15.91:0/687211779 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:50.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0d7fff640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d8070b20 0x7fa0d8152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.759+0000 7fa0cffff640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0d806eb70 0x7fa0d8152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 -- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d8070b20 msgr2=0x7fa0d8152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d8070b20 0x7fa0d8152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 -- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0d806eb70 msgr2=0x7fa0d8152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:50.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0d806eb70 0x7fa0d8152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:50.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 -- 172.21.15.91:0/687211779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c000b780 con 0x7fa0d806e790 2023-12-13T22:55:50.763 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.763+0000 7fa0d77fe640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d800 tx=0x7fa0c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:50.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.767+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800b6c0 con 0x7fa0d806e790 2023-12-13T22:55:50.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.767+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c800b820 con 0x7fa0d806e790 2023-12-13T22:55:50.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.767+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d81eb870 con 0x7fa0d806e790 2023-12-13T22:55:50.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.767+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800bb90 con 0x7fa0d806e790 2023-12-13T22:55:50.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.767+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d81eb590 con 0x7fa0d806e790 2023-12-13T22:55:50.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.771+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8158490 con 0x7fa0d806e790 2023-12-13T22:55:50.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.787+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa0c800bcf0 con 0x7fa0d806e790 2023-12-13T22:55:50.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.787+0000 7fa0d4ff9640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 0x7fa0b8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:50.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.787+0000 7fa0cffff640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 0x7fa0b8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:50.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:50.791+0000 7fa0cffff640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 0x7fa0b8068cb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b4000 tx=0x7fa0c00ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.064 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.067+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa0c8056040 con 0x7fa0d806e790 2023-12-13T22:55:51.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.067+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa0c8052380 con 0x7fa0d806e790 2023-12-13T22:55:51.232 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0d8072620 con 0x7fa0b80667f0 2023-12-13T22:55:51.233 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0d4ff9640 1 -- 172.21.15.91:0/687211779 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0c00c0070 con 0x7fa0b80667f0 2023-12-13T22:55:51.233 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 5 to deep-scrub 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 msgr2=0x7fa0b8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 0x7fa0b8068cb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b4000 tx=0x7fa0c00ac000 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 msgr2=0x7fa0d814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d800 tx=0x7fa0c800dcc0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 shutdown_connections 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa0b80667f0 0x7fa0b8068cb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0d8070b20 0x7fa0d8152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0d806eb70 0x7fa0d8152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 --2- 172.21.15.91:0/687211779 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa0d806e790 0x7fa0d814e3b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 >> 172.21.15.91:0/687211779 conn(0x7fa0d806c6a0 msgr2=0x7fa0d81ded80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 shutdown_connections 2023-12-13T22:55:51.236 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.235+0000 7fa0ddfa1640 1 -- 172.21.15.91:0/687211779 wait complete. 2023-12-13T22:55:51.253 INFO:tasks.ceph:Scrubbing osd.6 2023-12-13T22:55:51.254 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:51.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 Processor -- start 2023-12-13T22:55:51.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 -- start start 2023-12-13T22:55:51.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f2008072780 0x7f20080cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200815a300 con 0x7f200815cbf0 2023-12-13T22:55:51.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20081537c0 con 0x7f2008072780 2023-12-13T22:55:51.390 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200f7c0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2008159430 con 0x7f20081533e0 2023-12-13T22:55:51.391 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.391+0000 7f200d55c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.395+0000 7f200d55c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:37010/0 (socket says 172.21.15.91:37010) 2023-12-13T22:55:51.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.395+0000 7f200d55c640 1 -- 172.21.15.91:0/2663526256 learned_addr learned my addr 172.21.15.91:0/2663526256 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:51.395 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.395+0000 7f200cd5b640 1 --2- 172.21.15.91:0/2663526256 >> v2:172.21.15.91:3300/0 conn(0x7f2008072780 0x7f20080cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.399+0000 7f200d55c640 1 -- 172.21.15.91:0/2663526256 >> v2:172.21.15.91:3300/0 conn(0x7f2008072780 msgr2=0x7f20080cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:51.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.399+0000 7f200d55c640 1 --2- 172.21.15.91:0/2663526256 >> v2:172.21.15.91:3300/0 conn(0x7f2008072780 0x7f20080cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.399+0000 7f200d55c640 1 -- 172.21.15.91:0/2663526256 >> v1:172.21.15.91:6789/0 conn(0x7f200815cbf0 legacy=0x7f200815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:51.399 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.399+0000 7f200d55c640 1 -- 172.21.15.91:0/2663526256 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20081596f0 con 0x7f20081533e0 2023-12-13T22:55:51.404 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.403+0000 7f200d55c640 1 --2- 172.21.15.91:0/2663526256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20000098a0 tx=0x7f200001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237c00d33644ddb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f1ffffff640 1 -- 172.21.15.91:0/2663526256 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20000ad640 con 0x7f20081533e0 2023-12-13T22:55:51.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f1ffffff640 1 -- 172.21.15.91:0/2663526256 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20000ad7a0 con 0x7f20081533e0 2023-12-13T22:55:51.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f1ffffff640 1 -- 172.21.15.91:0/2663526256 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20000adb30 con 0x7f20081533e0 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 -- 172.21.15.91:0/2663526256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 msgr2=0x7f20080cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 --2- 172.21.15.91:0/2663526256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20000098a0 tx=0x7f200001c4e0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 -- 172.21.15.91:0/2663526256 shutdown_connections 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 --2- 172.21.15.91:0/2663526256 >> v2:172.21.15.91:3300/0 conn(0x7f2008072780 0x7f20080cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 --2- 172.21.15.91:0/2663526256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20081533e0 0x7f20080cc000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.415 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 -- 172.21.15.91:0/2663526256 >> 172.21.15.91:0/2663526256 conn(0x7f200806b670 msgr2=0x7f200806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 -- 172.21.15.91:0/2663526256 shutdown_connections 2023-12-13T22:55:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.415+0000 7f200f7c0640 1 -- 172.21.15.91:0/2663526256 wait complete. 2023-12-13T22:55:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 Processor -- start 2023-12-13T22:55:51.416 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 -- start start 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2008072780 0x7f20081f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20081533e0 0x7f20081520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 0x7f2008142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008151260 con 0x7f200815cbf0 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200815ade0 con 0x7f20081533e0 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200f7c0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20081f3340 con 0x7f2008072780 2023-12-13T22:55:51.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200dd5d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 0x7f2008142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200dd5d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 0x7f2008142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34448/0 (socket says 172.21.15.91:34448) 2023-12-13T22:55:51.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200dd5d640 1 -- 172.21.15.91:0/657513593 learned_addr learned my addr 172.21.15.91:0/657513593 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:51.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.419+0000 7f200cd5b640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20081533e0 0x7f20081520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.420 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200d55c640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2008072780 0x7f20081f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 -- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2008072780 msgr2=0x7f20081f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.421 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2008072780 0x7f20081f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 -- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20081533e0 msgr2=0x7f20081520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20081533e0 0x7f20081520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.422 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000094d0 con 0x7f200815cbf0 2023-12-13T22:55:51.423 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.423+0000 7f200dd5d640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 0x7f2008142620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f200400b9c0 tx=0x7f200400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.427+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400cae0 con 0x7f200815cbf0 2023-12-13T22:55:51.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.427+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400cc40 con 0x7f200815cbf0 2023-12-13T22:55:51.427 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.427+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2008151c30 con 0x7f200815cbf0 2023-12-13T22:55:51.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.427+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004014440 con 0x7f200815cbf0 2023-12-13T22:55:51.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.427+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2008152600 con 0x7f200815cbf0 2023-12-13T22:55:51.428 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.431+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2008073e70 con 0x7f200815cbf0 2023-12-13T22:55:51.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.447+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2004007370 con 0x7f200815cbf0 2023-12-13T22:55:51.447 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f1ffdffb640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1fec066870 0x7f1fec068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f200d55c640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1fec066870 0x7f1fec068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.448 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f200d55c640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1fec066870 0x7f1fec068d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f20000af000 tx=0x7f20000a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2004054e00 con 0x7f200815cbf0 2023-12-13T22:55:51.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f1ffdffb640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7f1fec0700d0 0x7f1fec072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fec072c40 con 0x7f1fec0700d0 2023-12-13T22:55:51.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.451+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2004054bd0 con 0x7f200815cbf0 2023-12-13T22:55:51.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.455+0000 7f200cd5b640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7f1fec0700d0 0x7f1fec072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.455+0000 7f200cd5b640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7f1fec0700d0 0x7f1fec072570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.454 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.455+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== osd.6 v2:172.21.15.152:6800/3653290810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1fec072c40 con 0x7f1fec0700d0 2023-12-13T22:55:51.471 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.471+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 --> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2008151dc0 con 0x7f1fec0700d0 2023-12-13T22:55:51.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f1ffdffb640 1 -- 172.21.15.91:0/657513593 <== osd.6 v2:172.21.15.152:6800/3653290810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2008151dc0 con 0x7f1fec0700d0 2023-12-13T22:55:51.473 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:51.473 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:51.473 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7f1fec0700d0 msgr2=0x7f1fec072570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.152:6800/3653290810,v1:172.21.15.152:6801/3653290810] conn(0x7f1fec0700d0 0x7f1fec072570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1fec066870 msgr2=0x7f1fec068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1fec066870 0x7f1fec068d30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f20000af000 tx=0x7f20000a7070 comp rx=0 tx=0).stop 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 msgr2=0x7f2008142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 --2- 172.21.15.91:0/657513593 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f200815cbf0 0x7f2008142620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f200400b9c0 tx=0x7f200400be80 comp rx=0 tx=0).stop 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200dd5d640 1 -- 172.21.15.91:0/657513593 reap_dead start 2023-12-13T22:55:51.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 shutdown_connections 2023-12-13T22:55:51.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 >> 172.21.15.91:0/657513593 conn(0x7f200806b670 msgr2=0x7f20080c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:51.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 shutdown_connections 2023-12-13T22:55:51.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.475+0000 7f200f7c0640 1 -- 172.21.15.91:0/657513593 wait complete. 2023-12-13T22:55:51.494 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-13T22:55:51.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 Processor -- start 2023-12-13T22:55:51.620 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 -- start start 2023-12-13T22:55:51.621 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb598150380 0x7fb59815a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb5980c7400 0x7fb5980cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb598159cb0 con 0x7fb598156220 2023-12-13T22:55:51.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5980c4010 con 0x7fb598150380 2023-12-13T22:55:51.622 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.623+0000 7fb59dadd640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59806bea0 con 0x7fb5980c7400 2023-12-13T22:55:51.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb598150380 0x7fb59815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fb598150380 0x7fb59815a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34456/0 (socket says 172.21.15.91:34456) 2023-12-13T22:55:51.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 -- 172.21.15.91:0/3826352451 learned_addr learned my addr 172.21.15.91:0/3826352451 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:51.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb597fff640 1 --2- 172.21.15.91:0/3826352451 >> v2:172.21.15.152:3300/0 conn(0x7fb5980c7400 0x7fb5980cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 -- 172.21.15.91:0/3826352451 >> v2:172.21.15.152:3300/0 conn(0x7fb5980c7400 msgr2=0x7fb5980cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:51.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 --2- 172.21.15.91:0/3826352451 >> v2:172.21.15.152:3300/0 conn(0x7fb5980c7400 0x7fb5980cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 -- 172.21.15.91:0/3826352451 >> v1:172.21.15.152:6789/0 conn(0x7fb598156220 legacy=0x7fb59806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.627+0000 7fb5977fe640 1 -- 172.21.15.91:0/3826352451 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980c6770 con 0x7fb598150380 2023-12-13T22:55:51.631 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.631+0000 7fb5977fe640 1 --2- 172.21.15.91:0/3826352451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598150380 0x7fb59815a140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb598157390 tx=0x7fb58801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d8e8c797d20e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.635+0000 7fb596ffd640 1 -- 172.21.15.91:0/3826352451 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880a7a90 con 0x7fb598150380 2023-12-13T22:55:51.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.635+0000 7fb596ffd640 1 -- 172.21.15.91:0/3826352451 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5880a7bf0 con 0x7fb598150380 2023-12-13T22:55:51.636 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.635+0000 7fb596ffd640 1 -- 172.21.15.91:0/3826352451 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880af440 con 0x7fb598150380 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- 172.21.15.91:0/3826352451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598150380 msgr2=0x7fb59815a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3826352451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598150380 0x7fb59815a140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb598157390 tx=0x7fb58801ebb0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- 172.21.15.91:0/3826352451 shutdown_connections 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3826352451 >> v2:172.21.15.152:3300/0 conn(0x7fb5980c7400 0x7fb5980cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3826352451 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598150380 0x7fb59815a140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- 172.21.15.91:0/3826352451 >> 172.21.15.91:0/3826352451 conn(0x7fb59806d200 msgr2=0x7fb59806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- 172.21.15.91:0/3826352451 shutdown_connections 2023-12-13T22:55:51.637 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- 172.21.15.91:0/3826352451 wait complete. 2023-12-13T22:55:51.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 Processor -- start 2023-12-13T22:55:51.638 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- start start 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5980c7400 0x7fb5980caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb598150380 0x7fb59814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981f1d70 con 0x7fb598156220 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980cafb0 con 0x7fb5980c7400 2023-12-13T22:55:51.639 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.639+0000 7fb59dadd640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981553a0 con 0x7fb598150380 2023-12-13T22:55:51.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34458/0 (socket says 172.21.15.91:34458) 2023-12-13T22:55:51.640 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 -- 172.21.15.91:0/3178114597 learned_addr learned my addr 172.21.15.91:0/3178114597 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:51.641 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb58effd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb598150380 0x7fb59814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.643 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 -- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb598150380 msgr2=0x7fb59814af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb598150380 0x7fb59814af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 -- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5980c7400 msgr2=0x7fb5980caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:51.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5980c7400 0x7fb5980caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:51.644 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.643+0000 7fb597fff640 1 -- 172.21.15.91:0/3178114597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58800b770 con 0x7fb598156220 2023-12-13T22:55:51.648 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.651+0000 7fb597fff640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb590007e90 tx=0x7fb59000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.651+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590014420 con 0x7fb598156220 2023-12-13T22:55:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.651+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590014580 con 0x7fb598156220 2023-12-13T22:55:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.651+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590014930 con 0x7fb598156220 2023-12-13T22:55:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.651+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb598155660 con 0x7fb598156220 2023-12-13T22:55:51.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.655+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb598155c20 con 0x7fb598156220 2023-12-13T22:55:51.653 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.655+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb598073e70 con 0x7fb598156220 2023-12-13T22:55:51.936 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.939+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb590014a90 con 0x7fb598156220 2023-12-13T22:55:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.939+0000 7fb594ff9640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 0x7fb578068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:51.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.939+0000 7fb5977fe640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 0x7fb578068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:51.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.939+0000 7fb5977fe640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 0x7fb578068cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5880b1000 tx=0x7fb588004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:51.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.967+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb590056ea0 con 0x7fb598156220 2023-12-13T22:55:51.966 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:51.967+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb590052ae0 con 0x7fb598156220 2023-12-13T22:55:52.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.135+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb598159940 con 0x7fb5780667f0 2023-12-13T22:55:52.136 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.135+0000 7fb594ff9640 1 -- 172.21.15.91:0/3178114597 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5880af440 con 0x7fb5780667f0 2023-12-13T22:55:52.136 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 6 to deep-scrub 2023-12-13T22:55:52.139 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 msgr2=0x7fb578068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 0x7fb578068cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb5880b1000 tx=0x7fb588004740 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 msgr2=0x7fb5981f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb590007e90 tx=0x7fb59000e4b0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 shutdown_connections 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb5780667f0 0x7fb578068cb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb598156220 0x7fb5981f21c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb598150380 0x7fb59814af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 --2- 172.21.15.91:0/3178114597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5980c7400 0x7fb5980caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 >> 172.21.15.91:0/3178114597 conn(0x7fb59806d200 msgr2=0x7fb5980735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 shutdown_connections 2023-12-13T22:55:52.140 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.139+0000 7fb59dadd640 1 -- 172.21.15.91:0/3178114597 wait complete. 2023-12-13T22:55:52.157 INFO:tasks.ceph:Scrubbing osd.7 2023-12-13T22:55:52.157 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-13T22:55:52.293 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 Processor -- start 2023-12-13T22:55:52.294 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 -- start start 2023-12-13T22:55:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 0x7f6114161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114159590 con 0x7f61140726d0 2023-12-13T22:55:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114156190 con 0x7f61140722f0 2023-12-13T22:55:52.295 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.295+0000 7f611c359640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114155fa0 con 0x7f611415a130 2023-12-13T22:55:52.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.311+0000 7f61198f4640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7f61140726d0 0x7f6114159a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56154/0 (socket says 172.21.15.91:56154) 2023-12-13T22:55:52.311 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.311+0000 7f61198f4640 1 -- 172.21.15.91:0/1924127117 learned_addr learned my addr 172.21.15.91:0/1924127117 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:52.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.323+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158793753 0 0) 0x7f6114159590 con 0x7f61140726d0 2023-12-13T22:55:52.323 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.323+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc003530 con 0x7f61140726d0 2023-12-13T22:55:52.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230594506 0 0) 0x7f60fc003530 con 0x7f61140726d0 2023-12-13T22:55:52.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 msgr2=0x7f6114161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 0x7f6114161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 >> v1:172.21.15.152:6789/0 conn(0x7f61140722f0 legacy=0x7f61140c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.329 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114156470 con 0x7f61140726d0 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7f6108001680 con 0x7f61140726d0 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 >> v1:172.21.15.91:6789/0 conn(0x7f61140726d0 legacy=0x7f6114159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc003a20 0x7f60fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 0x7f60fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60fc004e30 0x7f60fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0055c0 con 0x7f60fc004e30 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc00bed0 con 0x7f60fc003a20 2023-12-13T22:55:52.330 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.331+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc00c010 con 0x7f611415a130 2023-12-13T22:55:52.332 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.335+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60fc004e30 0x7f60fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.339+0000 7f611a8f6640 1 -- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 msgr2=0x7f60fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.339+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f611415a130 0x7f60fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.339+0000 7f611a8f6640 1 -- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc003a20 msgr2=0x7f60fc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.339+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc003a20 0x7f60fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.339 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.339+0000 7f611a8f6640 1 -- 172.21.15.91:0/1924127117 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc003530 con 0x7f60fc004e30 2023-12-13T22:55:52.343 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.343+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60fc004e30 0x7f60fc00b990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6104009ca0 tx=0x7f610401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc49acd5a0c04630 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040a5c60 con 0x7f60fc004e30 2023-12-13T22:55:52.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61040a5de0 con 0x7f60fc004e30 2023-12-13T22:55:52.348 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f61190f3640 1 -- 172.21.15.91:0/1924127117 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040ad680 con 0x7f60fc004e30 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- 172.21.15.91:0/1924127117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60fc004e30 msgr2=0x7f60fc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 --2- 172.21.15.91:0/1924127117 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f60fc004e30 0x7f60fc00b990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6104009ca0 tx=0x7f610401cc50 comp rx=0 tx=0).stop 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611a8f6640 1 -- 172.21.15.91:0/1924127117 reap_dead start 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- 172.21.15.91:0/1924127117 shutdown_connections 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- 172.21.15.91:0/1924127117 >> 172.21.15.91:0/1924127117 conn(0x7f611406b670 msgr2=0x7f611406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:52.349 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- 172.21.15.91:0/1924127117 shutdown_connections 2023-12-13T22:55:52.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- 172.21.15.91:0/1924127117 wait complete. 2023-12-13T22:55:52.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 Processor -- start 2023-12-13T22:55:52.350 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- start start 2023-12-13T22:55:52.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc004e30 0x7f6114145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6114070290 0x7f61141e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 0x7f6114151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.351 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61141f2ee0 con 0x7f61141e3c20 2023-12-13T22:55:52.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61141f21d0 con 0x7f60fc004e30 2023-12-13T22:55:52.352 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.351+0000 7f611c359640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61141eead0 con 0x7f6114070290 2023-12-13T22:55:52.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.355+0000 7f611a8f6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 0x7f6114151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.355+0000 7f611a8f6640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 0x7f6114151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34478/0 (socket says 172.21.15.91:34478) 2023-12-13T22:55:52.355 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.355+0000 7f611a8f6640 1 -- 172.21.15.91:0/1875455134 learned_addr learned my addr 172.21.15.91:0/1875455134 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:52.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.359+0000 7f611a8f6640 1 -- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6114070290 msgr2=0x7f61141e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.359+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6114070290 0x7f61141e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.359+0000 7f611a8f6640 1 -- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc004e30 msgr2=0x7f6114145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.359+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60fc004e30 0x7f6114145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.359+0000 7f611a8f6640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61141eedb0 con 0x7f61141e3c20 2023-12-13T22:55:52.361 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.363+0000 7f611a8f6640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 0x7f6114151950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f610401ca80 tx=0x7f60fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040bf070 con 0x7f61141e3c20 2023-12-13T22:55:52.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61040a5c70 con 0x7f61141e3c20 2023-12-13T22:55:52.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61141ef090 con 0x7f61141e3c20 2023-12-13T22:55:52.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040ad9c0 con 0x7f61141e3c20 2023-12-13T22:55:52.366 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61141ef650 con 0x7f61141e3c20 2023-12-13T22:55:52.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.367+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6114156d10 con 0x7f61141e3c20 2023-12-13T22:55:52.392 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.395+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f61040b4050 con 0x7f61141e3c20 2023-12-13T22:55:52.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.395+0000 7f6112ffd640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6100066840 0x7f6100068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.395+0000 7f611a0f5640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6100066840 0x7f6100068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.393 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.395+0000 7f611a0f5640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6100066840 0x7f6100068d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f610c007fd0 tx=0x7f610c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f61040f0620 con 0x7f61141e3c20 2023-12-13T22:55:52.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f6112ffd640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f6100070120 0x7f61000725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6100072c90 con 0x7f6100070120 2023-12-13T22:55:52.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61040ec2e0 con 0x7f61141e3c20 2023-12-13T22:55:52.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f61198f4640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f6100070120 0x7f61000725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f61198f4640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f6100070120 0x7f61000725c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.401 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.399+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== osd.7 v2:172.21.15.152:6816/1599476558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6100072c90 con 0x7f6100070120 2023-12-13T22:55:52.413 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 --> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6114156a30 con 0x7f6100070120 2023-12-13T22:55:52.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f6112ffd640 1 -- 172.21.15.91:0/1875455134 <== osd.7 v2:172.21.15.152:6816/1599476558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f61080078f0 con 0x7f6100070120 2023-12-13T22:55:52.418 INFO:teuthology.orchestra.run.smithi091.stdout:{ 2023-12-13T22:55:52.418 INFO:teuthology.orchestra.run.smithi091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-13T22:55:52.418 INFO:teuthology.orchestra.run.smithi091.stdout:} 2023-12-13T22:55:52.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f6100070120 msgr2=0x7f61000725c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.152:6816/1599476558,v1:172.21.15.152:6817/1599476558] conn(0x7f6100070120 0x7f61000725c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6100066840 msgr2=0x7f6100068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f6100066840 0x7f6100068d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f610c007fd0 tx=0x7f610c0079a0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 msgr2=0x7f6114151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 --2- 172.21.15.91:0/1875455134 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f61141e3c20 0x7f6114151950 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f610401ca80 tx=0x7f60fc005800 comp rx=0 tx=0).stop 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611a8f6640 1 -- 172.21.15.91:0/1875455134 reap_dead start 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 shutdown_connections 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 >> 172.21.15.91:0/1875455134 conn(0x7f611406b670 msgr2=0x7f6114148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 shutdown_connections 2023-12-13T22:55:52.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.415+0000 7f611c359640 1 -- 172.21.15.91:0/1875455134 wait complete. 2023-12-13T22:55:52.432 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-13T22:55:52.548 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 Processor -- start 2023-12-13T22:55:52.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 -- start start 2023-12-13T22:55:52.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 0x7fb96415a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9640c6c50 0x7fb9641560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.549 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640c27d0 con 0x7fb9641505d0 2023-12-13T22:55:52.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640c3270 con 0x7fb9640c6c50 2023-12-13T22:55:52.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb96bfae640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c25e0 con 0x7fb9641501f0 2023-12-13T22:55:52.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb969549640 1 --1- >> v1:172.21.15.91:6789/0 conn(0x7fb9641505d0 0x7fb9640c1ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.91:6789/0 says I am v1:172.21.15.91:56166/0 (socket says 172.21.15.91:56166) 2023-12-13T22:55:52.550 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.551+0000 7fb969549640 1 -- 172.21.15.91:0/3510392906 learned_addr learned my addr 172.21.15.91:0/3510392906 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:52.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.555+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v1:172.21.15.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880285082 0 0) 0x7fb9640c27d0 con 0x7fb9641505d0 2023-12-13T22:55:52.553 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.555+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 --> v1:172.21.15.91:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb950003530 con 0x7fb9641505d0 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v1:172.21.15.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 859388334 0 0) 0x7fb950003530 con 0x7fb9641505d0 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 msgr2=0x7fb96415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 0x7fb96415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 >> v2:172.21.15.152:3300/0 conn(0x7fb9640c6c50 msgr2=0x7fb9641560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 --2- 172.21.15.91:0/3510392906 >> v2:172.21.15.152:3300/0 conn(0x7fb9640c6c50 0x7fb9641560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 --> v1:172.21.15.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640c2ab0 con 0x7fb9641505d0 2023-12-13T22:55:52.558 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v1:172.21.15.91:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4116673430 0 0) 0x7fb954001680 con 0x7fb9641505d0 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 >> v1:172.21.15.91:6789/0 conn(0x7fb9641505d0 legacy=0x7fb9640c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9500039f0 0x7fb950003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 0x7fb9500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb950004e30 0x7fb95000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950005520 con 0x7fb950004e30 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950005690 con 0x7fb9500039f0 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000e160 con 0x7fb9641501f0 2023-12-13T22:55:52.559 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.559+0000 7fb96a54b640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb950004e30 0x7fb95000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.563+0000 7fb96a54b640 1 -- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 msgr2=0x7fb9500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.563+0000 7fb96a54b640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9641501f0 0x7fb9500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.563+0000 7fb96a54b640 1 -- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9500039f0 msgr2=0x7fb950003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:52.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.563+0000 7fb96a54b640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9500039f0 0x7fb950003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.567+0000 7fb96a54b640 1 -- 172.21.15.91:0/3510392906 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950003530 con 0x7fb950004e30 2023-12-13T22:55:52.567 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.567+0000 7fb96a54b640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb950004e30 0x7fb95000dba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ca0 tx=0x7fb95c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36eadb1a0e362c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.571+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0a5b80 con 0x7fb950004e30 2023-12-13T22:55:52.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.571+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0a5d00 con 0x7fb950004e30 2023-12-13T22:55:52.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.571+0000 7fb968d48640 1 -- 172.21.15.91:0/3510392906 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ad680 con 0x7fb950004e30 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- 172.21.15.91:0/3510392906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb950004e30 msgr2=0x7fb95000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 --2- 172.21.15.91:0/3510392906 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb950004e30 0x7fb95000dba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009ca0 tx=0x7fb95c01cc50 comp rx=0 tx=0).stop 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96a54b640 1 -- 172.21.15.91:0/3510392906 reap_dead start 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- 172.21.15.91:0/3510392906 shutdown_connections 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- 172.21.15.91:0/3510392906 >> 172.21.15.91:0/3510392906 conn(0x7fb96406c6a0 msgr2=0x7fb96406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- 172.21.15.91:0/3510392906 shutdown_connections 2023-12-13T22:55:52.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- 172.21.15.91:0/3510392906 wait complete. 2023-12-13T22:55:52.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 Processor -- start 2023-12-13T22:55:52.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- start start 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb950004e30 0x7fb96406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640717c0 0x7fb964140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964140d90 con 0x7fb964072890 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9641eecb0 con 0x7fb9640717c0 2023-12-13T22:55:52.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb96bfae640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96413f820 con 0x7fb950004e30 2023-12-13T22:55:52.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb969549640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb969549640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34498/0 (socket says 172.21.15.91:34498) 2023-12-13T22:55:52.575 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.575+0000 7fb969549640 1 -- 172.21.15.91:0/409770977 learned_addr learned my addr 172.21.15.91:0/409770977 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:52.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.579+0000 7fb969549640 1 -- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb950004e30 msgr2=0x7fb96406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.579+0000 7fb969549640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb950004e30 0x7fb96406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.579+0000 7fb969549640 1 -- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640717c0 msgr2=0x7fb964140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:52.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.579+0000 7fb969549640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640717c0 0x7fb964140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:52.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.579+0000 7fb969549640 1 -- 172.21.15.91:0/409770977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96413fba0 con 0x7fb964072890 2023-12-13T22:55:52.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.583+0000 7fb969549640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c730 tx=0x7fb95400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9540074e0 con 0x7fb964072890 2023-12-13T22:55:52.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954007640 con 0x7fb964072890 2023-12-13T22:55:52.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954004a30 con 0x7fb964072890 2023-12-13T22:55:52.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb964070b20 con 0x7fb964072890 2023-12-13T22:55:52.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9641ee7b0 con 0x7fb964072890 2023-12-13T22:55:52.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.587+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb964067520 con 0x7fb964072890 2023-12-13T22:55:52.824 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.827+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb954004b90 con 0x7fb964072890 2023-12-13T22:55:52.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.827+0000 7fb95a7fc640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 0x7fb948068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:52.825 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.827+0000 7fb969d4a640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 0x7fb948068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:52.826 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.827+0000 7fb969d4a640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 0x7fb948068d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9600096b0 tx=0x7fb960006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:52.837 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.839+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb95400ce40 con 0x7fb964072890 2023-12-13T22:55:52.838 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:52.839+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb954054940 con 0x7fb964072890 2023-12-13T22:55:53.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb964159d10 con 0x7fb948066840 2023-12-13T22:55:53.009 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb95a7fc640 1 -- 172.21.15.91:0/409770977 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb960013430 con 0x7fb948066840 2023-12-13T22:55:53.009 INFO:teuthology.orchestra.run.smithi091.stderr:instructed osd(s) 7 to deep-scrub 2023-12-13T22:55:53.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 msgr2=0x7fb948068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.013 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 0x7fb948068d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9600096b0 tx=0x7fb960006ca0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 msgr2=0x7fb964140310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c730 tx=0x7fb95400cbf0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 shutdown_connections 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fb948066840 0x7fb948068d00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640717c0 0x7fb964140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fb964072890 0x7fb964140310 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 --2- 172.21.15.91:0/409770977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb950004e30 0x7fb96406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 >> 172.21.15.91:0/409770977 conn(0x7fb96406c6a0 msgr2=0x7fb964144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 shutdown_connections 2023-12-13T22:55:53.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.011+0000 7fb96bfae640 1 -- 172.21.15.91:0/409770977 wait complete. 2023-12-13T22:55:53.029 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:55:53.144 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 Processor -- start 2023-12-13T22:55:53.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 -- start start 2023-12-13T22:55:53.145 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6d4153720 0x7fa6d415a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 0x7fa6d406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d4159ba0 con 0x7fa6d40c83c0 2023-12-13T22:55:53.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40c6c90 con 0x7fa6d4153720 2023-12-13T22:55:53.146 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d971d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40c8830 con 0x7fa6d406ab60 2023-12-13T22:55:53.147 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.147+0000 7fa6d37fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 0x7fa6d406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.151+0000 7fa6d27fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa6d40c83c0 0x7fa6d40c6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:48556/0 (socket says 172.21.15.91:48556) 2023-12-13T22:55:53.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.151+0000 7fa6d27fc640 1 -- 172.21.15.91:0/4202595006 learned_addr learned my addr 172.21.15.91:0/4202595006 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:55:53.148 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.151+0000 7fa6d2ffd640 1 --2- 172.21.15.91:0/4202595006 >> v2:172.21.15.152:3300/0 conn(0x7fa6d4153720 0x7fa6d415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.154 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.155+0000 7fa6d37fe640 1 -- 172.21.15.91:0/4202595006 >> v2:172.21.15.152:3300/0 conn(0x7fa6d4153720 msgr2=0x7fa6d415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:55:53.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.155+0000 7fa6d37fe640 1 --2- 172.21.15.91:0/4202595006 >> v2:172.21.15.152:3300/0 conn(0x7fa6d4153720 0x7fa6d415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.155+0000 7fa6d37fe640 1 -- 172.21.15.91:0/4202595006 >> v1:172.21.15.152:6789/0 conn(0x7fa6d40c83c0 legacy=0x7fa6d40c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.155 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.155+0000 7fa6d37fe640 1 -- 172.21.15.91:0/4202595006 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4072910 con 0x7fa6d406ab60 2023-12-13T22:55:53.160 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.163+0000 7fa6d37fe640 1 --2- 172.21.15.91:0/4202595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 0x7fa6d406aff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40097c0 tx=0x7fa6c401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ae132b0e20e24b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:53.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d1ffb640 1 -- 172.21.15.91:0/4202595006 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40a8970 con 0x7fa6d406ab60 2023-12-13T22:55:53.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d1ffb640 1 -- 172.21.15.91:0/4202595006 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c40a8ad0 con 0x7fa6d406ab60 2023-12-13T22:55:53.172 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d1ffb640 1 -- 172.21.15.91:0/4202595006 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40a8e60 con 0x7fa6d406ab60 2023-12-13T22:55:53.173 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- 172.21.15.91:0/4202595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 msgr2=0x7fa6d406aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- 172.21.15.91:0/4202595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 0x7fa6d406aff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40097c0 tx=0x7fa6c401ec70 comp rx=0 tx=0).stop 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- 172.21.15.91:0/4202595006 shutdown_connections 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- 172.21.15.91:0/4202595006 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d406ab60 0x7fa6d406aff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- 172.21.15.91:0/4202595006 >> v2:172.21.15.152:3300/0 conn(0x7fa6d4153720 0x7fa6d415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- 172.21.15.91:0/4202595006 >> 172.21.15.91:0/4202595006 conn(0x7fa6d4070160 msgr2=0x7fa6d406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- 172.21.15.91:0/4202595006 shutdown_connections 2023-12-13T22:55:53.174 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- 172.21.15.91:0/4202595006 wait complete. 2023-12-13T22:55:53.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 Processor -- start 2023-12-13T22:55:53.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- start start 2023-12-13T22:55:53.175 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d40c83c0 0x7fa6d41e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d4153720 0x7fa6d41ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41ef090 con 0x7fa6d406ab60 2023-12-13T22:55:53.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d415ba80 con 0x7fa6d40c83c0 2023-12-13T22:55:53.176 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.175+0000 7fa6d971d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4150500 con 0x7fa6d4153720 2023-12-13T22:55:53.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.179+0000 7fa6d2ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.179+0000 7fa6d2ffd640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:34510/0 (socket says 172.21.15.91:34510) 2023-12-13T22:55:53.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.179+0000 7fa6d2ffd640 1 -- 172.21.15.91:0/1684750180 learned_addr learned my addr 172.21.15.91:0/1684750180 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:55:53.177 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.179+0000 7fa6d27fc640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d40c83c0 0x7fa6d41e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.179 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.179+0000 7fa6d37fe640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d4153720 0x7fa6d41ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.183+0000 7fa6d2ffd640 1 -- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d4153720 msgr2=0x7fa6d41ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.183+0000 7fa6d2ffd640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d4153720 0x7fa6d41ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.181 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.183+0000 7fa6d2ffd640 1 -- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d40c83c0 msgr2=0x7fa6d41e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.183+0000 7fa6d2ffd640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d40c83c0 0x7fa6d41e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.182 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.183+0000 7fa6d2ffd640 1 -- 172.21.15.91:0/1684750180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4009420 con 0x7fa6d406ab60 2023-12-13T22:55:53.184 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.187+0000 7fa6d2ffd640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d10 tx=0x7fa6cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc009b80 con 0x7fa6d406ab60 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6d406ab60 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc014680 con 0x7fa6d406ab60 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40c2f60 con 0x7fa6d406ab60 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41ef280 con 0x7fa6d406ab60 2023-12-13T22:55:53.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.191+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d4073e70 con 0x7fa6d406ab60 2023-12-13T22:55:53.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.219+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa6cc0147e0 con 0x7fa6d406ab60 2023-12-13T22:55:53.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.219+0000 7fa6cb7fe640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 0x7fa6b4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:55:53.218 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.219+0000 7fa6d27fc640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 0x7fa6b4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:55:53.219 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.219+0000 7fa6d27fc640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 0x7fa6b4068d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6d41529c0 tx=0x7fa6bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:55:53.229 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.231+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6cc0569c0 con 0x7fa6d406ab60 2023-12-13T22:55:53.510 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.511+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa6cc052600 con 0x7fa6d406ab60 2023-12-13T22:55:53.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.679+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6d40c2990 con 0x7fa6b4066840 2023-12-13T22:55:53.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.699+0000 7fa6cb7fe640 1 -- 172.21.15.91:0/1684750180 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+365255 (secure 0 0 0) 0x7fa6bc001510 con 0x7fa6b4066840 2023-12-13T22:55:53.701 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:55:53.704 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 msgr2=0x7fa6b4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 0x7fa6b4068d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6d41529c0 tx=0x7fa6bc009040 comp rx=0 tx=0).stop 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 msgr2=0x7fa6d415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009d10 tx=0x7fa6cc00c490 comp rx=0 tx=0).stop 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 shutdown_connections 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa6b4066840 0x7fa6b4068d00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d4153720 0x7fa6d41ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.705 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d40c83c0 0x7fa6d41e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 --2- 172.21.15.91:0/1684750180 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa6d406ab60 0x7fa6d415b540 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:55:53.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 >> 172.21.15.91:0/1684750180 conn(0x7fa6d4070160 msgr2=0x7fa6d4157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:55:53.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 shutdown_connections 2023-12-13T22:55:53.706 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:55:53.703+0000 7fa6d971d640 1 -- 172.21.15.91:0/1684750180 wait complete. 2023-12-13T22:55:53.720 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":947,"stamp":"2023-12-13T22:55:53.351222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13430,"ondisk_log_size":13430,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004284"},"pg_stats":[{"pgid":"2.1f","version":"31'10","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.656100+0000","last_change":"2023-12-13T22:25:57.854709+0000","last_active":"2023-12-13T22:55:18.656100+0000","last_peered":"2023-12-13T22:55:18.656100+0000","last_clean":"2023-12-13T22:55:18.656100+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:18.656100+0000","last_undegraded":"2023-12-13T22:55:18.656100+0000","last_fullsized":"2023-12-13T22:55:18.656100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.691595+0000","last_change":"2023-12-13T22:26:00.389666+0000","last_active":"2023-12-13T22:55:35.691595+0000","last_peered":"2023-12-13T22:55:35.691595+0000","last_clean":"2023-12-13T22:55:35.691595+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:35.691595+0000","last_undegraded":"2023-12-13T22:55:35.691595+0000","last_fullsized":"2023-12-13T22:55:35.691595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.878700+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:55:12.878700+0000","last_peered":"2023-12-13T22:55:12.878700+0000","last_clean":"2023-12-13T22:55:12.878700+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:55:12.878700+0000","last_undegraded":"2023-12-13T22:55:12.878700+0000","last_fullsized":"2023-12-13T22:55:12.878700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":593,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.823913+0000","last_change":"2023-12-13T22:25:57.844670+0000","last_active":"2023-12-13T22:55:35.823913+0000","last_peered":"2023-12-13T22:55:35.823913+0000","last_clean":"2023-12-13T22:55:35.823913+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:55:35.823913+0000","last_undegraded":"2023-12-13T22:55:35.823913+0000","last_fullsized":"2023-12-13T22:55:35.823913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579810+0000","last_change":"2023-12-13T22:25:59.501805+0000","last_active":"2023-12-13T22:55:35.579810+0000","last_peered":"2023-12-13T22:55:35.579810+0000","last_clean":"2023-12-13T22:55:35.579810+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:35.579810+0000","last_undegraded":"2023-12-13T22:55:35.579810+0000","last_fullsized":"2023-12-13T22:55:35.579810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.033861+0000","last_change":"2023-12-13T22:26:05.938915+0000","last_active":"2023-12-13T22:55:08.033861+0000","last_peered":"2023-12-13T22:55:08.033861+0000","last_clean":"2023-12-13T22:55:08.033861+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:55:08.033861+0000","last_undegraded":"2023-12-13T22:55:08.033861+0000","last_fullsized":"2023-12-13T22:55:08.033861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'12","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.221109+0000","last_change":"2023-12-13T22:25:57.857968+0000","last_active":"2023-12-13T22:55:13.221109+0000","last_peered":"2023-12-13T22:55:13.221109+0000","last_clean":"2023-12-13T22:55:13.221109+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:55:13.221109+0000","last_undegraded":"2023-12-13T22:55:13.221109+0000","last_fullsized":"2023-12-13T22:55:13.221109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:27:23.472100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631646+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:55:35.631646+0000","last_peered":"2023-12-13T22:55:35.631646+0000","last_clean":"2023-12-13T22:55:35.631646+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:55:35.631646+0000","last_undegraded":"2023-12-13T22:55:35.631646+0000","last_fullsized":"2023-12-13T22:55:35.631646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:08.863348+0000","last_change":"2023-12-13T22:27:03.108442+0000","last_active":"2023-12-13T22:54:08.863348+0000","last_peered":"2023-12-13T22:54:08.863348+0000","last_clean":"2023-12-13T22:54:08.863348+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:54:08.863348+0000","last_undegraded":"2023-12-13T22:54:08.863348+0000","last_fullsized":"2023-12-13T22:54:08.863348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'6","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.539803+0000","last_change":"2023-12-13T22:25:57.861956+0000","last_active":"2023-12-13T22:54:58.539803+0000","last_peered":"2023-12-13T22:54:58.539803+0000","last_clean":"2023-12-13T22:54:58.539803+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:54:58.539803+0000","last_undegraded":"2023-12-13T22:54:58.539803+0000","last_fullsized":"2023-12-13T22:54:58.539803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:57:20.376619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638546+0000","last_change":"2023-12-13T22:26:00.402649+0000","last_active":"2023-12-13T22:55:35.638546+0000","last_peered":"2023-12-13T22:55:35.638546+0000","last_clean":"2023-12-13T22:55:35.638546+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:55:35.638546+0000","last_undegraded":"2023-12-13T22:55:35.638546+0000","last_fullsized":"2023-12-13T22:55:35.638546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:15.951998+0000","last_change":"2023-12-13T22:26:05.935779+0000","last_active":"2023-12-13T22:54:15.951998+0000","last_peered":"2023-12-13T22:54:15.951998+0000","last_clean":"2023-12-13T22:54:15.951998+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:54:15.951998+0000","last_undegraded":"2023-12-13T22:54:15.951998+0000","last_fullsized":"2023-12-13T22:54:15.951998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624523+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:55:35.624523+0000","last_peered":"2023-12-13T22:55:35.624523+0000","last_clean":"2023-12-13T22:55:35.624523+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:55:35.624523+0000","last_undegraded":"2023-12-13T22:55:35.624523+0000","last_fullsized":"2023-12-13T22:55:35.624523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'671","reported_seq":705,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.116962+0000","last_change":"2023-12-13T22:25:57.854963+0000","last_active":"2023-12-13T22:55:35.116962+0000","last_peered":"2023-12-13T22:55:35.116962+0000","last_clean":"2023-12-13T22:55:35.116962+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:55:35.116962+0000","last_undegraded":"2023-12-13T22:55:35.116962+0000","last_fullsized":"2023-12-13T22:55:35.116962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:25:43.879595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.679391+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:55:22.679391+0000","last_peered":"2023-12-13T22:55:22.679391+0000","last_clean":"2023-12-13T22:55:22.679391+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:55:22.679391+0000","last_undegraded":"2023-12-13T22:55:22.679391+0000","last_fullsized":"2023-12-13T22:55:22.679391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698184+0000","last_change":"2023-12-13T22:26:00.391750+0000","last_active":"2023-12-13T22:55:35.698184+0000","last_peered":"2023-12-13T22:55:35.698184+0000","last_clean":"2023-12-13T22:55:35.698184+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:55:35.698184+0000","last_undegraded":"2023-12-13T22:55:35.698184+0000","last_fullsized":"2023-12-13T22:55:35.698184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'230","reported_seq":265,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.533594+0000","last_change":"2023-12-13T22:25:57.845900+0000","last_active":"2023-12-13T22:55:18.533594+0000","last_peered":"2023-12-13T22:55:18.533594+0000","last_clean":"2023-12-13T22:55:18.533594+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:18.533594+0000","last_undegraded":"2023-12-13T22:55:18.533594+0000","last_fullsized":"2023-12-13T22:55:18.533594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.679261+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:55:22.679261+0000","last_peered":"2023-12-13T22:55:22.679261+0000","last_clean":"2023-12-13T22:55:22.679261+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:55:22.679261+0000","last_undegraded":"2023-12-13T22:55:22.679261+0000","last_fullsized":"2023-12-13T22:55:22.679261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698862+0000","last_change":"2023-12-13T22:26:00.412861+0000","last_active":"2023-12-13T22:55:35.698862+0000","last_peered":"2023-12-13T22:55:35.698862+0000","last_clean":"2023-12-13T22:55:35.698862+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:55:35.698862+0000","last_undegraded":"2023-12-13T22:55:35.698862+0000","last_fullsized":"2023-12-13T22:55:35.698862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'165","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.352933+0000","last_change":"2023-12-13T22:25:57.855084+0000","last_active":"2023-12-13T22:55:13.352933+0000","last_peered":"2023-12-13T22:55:13.352933+0000","last_clean":"2023-12-13T22:55:13.352933+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:55:13.352933+0000","last_undegraded":"2023-12-13T22:55:13.352933+0000","last_fullsized":"2023-12-13T22:55:13.352933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.749290+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:55:32.749290+0000","last_peered":"2023-12-13T22:55:32.749290+0000","last_clean":"2023-12-13T22:55:32.749290+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:55:32.749290+0000","last_undegraded":"2023-12-13T22:55:32.749290+0000","last_fullsized":"2023-12-13T22:55:32.749290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.593920+0000","last_change":"2023-12-13T22:26:00.405678+0000","last_active":"2023-12-13T22:55:35.593920+0000","last_peered":"2023-12-13T22:55:35.593920+0000","last_clean":"2023-12-13T22:55:35.593920+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:35.593920+0000","last_undegraded":"2023-12-13T22:55:35.593920+0000","last_fullsized":"2023-12-13T22:55:35.593920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'4","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:09.867630+0000","last_change":"2023-12-13T22:25:57.852946+0000","last_active":"2023-12-13T22:55:09.867630+0000","last_peered":"2023-12-13T22:55:09.867630+0000","last_clean":"2023-12-13T22:55:09.867630+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:09.867630+0000","last_undegraded":"2023-12-13T22:55:09.867630+0000","last_fullsized":"2023-12-13T22:55:09.867630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:53:54.919611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.679456+0000","last_change":"2023-12-13T22:26:05.938576+0000","last_active":"2023-12-13T22:55:22.679456+0000","last_peered":"2023-12-13T22:55:22.679456+0000","last_clean":"2023-12-13T22:55:22.679456+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:55:22.679456+0000","last_undegraded":"2023-12-13T22:55:22.679456+0000","last_fullsized":"2023-12-13T22:55:22.679456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.564700+0000","last_change":"2023-12-13T22:26:00.283728+0000","last_active":"2023-12-13T22:55:35.564700+0000","last_peered":"2023-12-13T22:55:35.564700+0000","last_clean":"2023-12-13T22:55:35.564700+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:35.564700+0000","last_undegraded":"2023-12-13T22:55:35.564700+0000","last_fullsized":"2023-12-13T22:55:35.564700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'9","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:26.933240+0000","last_change":"2023-12-13T22:25:57.848287+0000","last_active":"2023-12-13T22:55:26.933240+0000","last_peered":"2023-12-13T22:55:26.933240+0000","last_clean":"2023-12-13T22:55:26.933240+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:26.933240+0000","last_undegraded":"2023-12-13T22:55:26.933240+0000","last_fullsized":"2023-12-13T22:55:26.933240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.677584+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:55:17.677584+0000","last_peered":"2023-12-13T22:55:17.677584+0000","last_clean":"2023-12-13T22:55:17.677584+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:55:17.677584+0000","last_undegraded":"2023-12-13T22:55:17.677584+0000","last_fullsized":"2023-12-13T22:55:17.677584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694793+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:55:35.694793+0000","last_peered":"2023-12-13T22:55:35.694793+0000","last_clean":"2023-12-13T22:55:35.694793+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:55:35.694793+0000","last_undegraded":"2023-12-13T22:55:35.694793+0000","last_fullsized":"2023-12-13T22:55:35.694793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'188","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:34.786514+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:55:34.786514+0000","last_peered":"2023-12-13T22:55:34.786514+0000","last_clean":"2023-12-13T22:55:34.786514+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:55:34.786514+0000","last_undegraded":"2023-12-13T22:55:34.786514+0000","last_fullsized":"2023-12-13T22:55:34.786514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.718761+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:54:14.718761+0000","last_peered":"2023-12-13T22:54:14.718761+0000","last_clean":"2023-12-13T22:54:14.718761+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:54:14.718761+0000","last_undegraded":"2023-12-13T22:54:14.718761+0000","last_fullsized":"2023-12-13T22:54:14.718761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501792+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:55:35.501792+0000","last_peered":"2023-12-13T22:55:35.501792+0000","last_clean":"2023-12-13T22:55:35.501792+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:55:35.501792+0000","last_undegraded":"2023-12-13T22:55:35.501792+0000","last_fullsized":"2023-12-13T22:55:35.501792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'2","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:31.335556+0000","last_change":"2023-12-13T22:25:57.853162+0000","last_active":"2023-12-13T22:54:31.335556+0000","last_peered":"2023-12-13T22:54:31.335556+0000","last_clean":"2023-12-13T22:54:31.335556+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:54:31.335556+0000","last_undegraded":"2023-12-13T22:54:31.335556+0000","last_fullsized":"2023-12-13T22:54:31.335556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:16:29.579415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:14.806416+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:55:14.806416+0000","last_peered":"2023-12-13T22:55:14.806416+0000","last_clean":"2023-12-13T22:55:14.806416+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:55:14.806416+0000","last_undegraded":"2023-12-13T22:55:14.806416+0000","last_fullsized":"2023-12-13T22:55:14.806416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.638466+0000","last_change":"2023-12-13T22:26:00.418153+0000","last_active":"2023-12-13T22:55:35.638466+0000","last_peered":"2023-12-13T22:55:35.638466+0000","last_clean":"2023-12-13T22:55:35.638466+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:55:35.638466+0000","last_undegraded":"2023-12-13T22:55:35.638466+0000","last_fullsized":"2023-12-13T22:55:35.638466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:23.383648+0000","last_change":"2023-12-13T22:25:57.854141+0000","last_active":"2023-12-13T22:55:23.383648+0000","last_peered":"2023-12-13T22:55:23.383648+0000","last_clean":"2023-12-13T22:55:23.383648+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:55:23.383648+0000","last_undegraded":"2023-12-13T22:55:23.383648+0000","last_fullsized":"2023-12-13T22:55:23.383648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.692664+0000","last_change":"2023-12-13T22:27:03.566251+0000","last_active":"2023-12-13T22:54:14.692664+0000","last_peered":"2023-12-13T22:54:14.692664+0000","last_clean":"2023-12-13T22:54:14.692664+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:54:14.692664+0000","last_undegraded":"2023-12-13T22:54:14.692664+0000","last_fullsized":"2023-12-13T22:54:14.692664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596847+0000","last_change":"2023-12-13T22:26:00.393262+0000","last_active":"2023-12-13T22:55:35.596847+0000","last_peered":"2023-12-13T22:55:35.596847+0000","last_clean":"2023-12-13T22:55:35.596847+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:35.596847+0000","last_undegraded":"2023-12-13T22:55:35.596847+0000","last_fullsized":"2023-12-13T22:55:35.596847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.639135+0000","last_change":"2023-12-13T22:25:57.868013+0000","last_active":"2023-12-13T22:55:18.639135+0000","last_peered":"2023-12-13T22:55:18.639135+0000","last_clean":"2023-12-13T22:55:18.639135+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:18.639135+0000","last_undegraded":"2023-12-13T22:55:18.639135+0000","last_fullsized":"2023-12-13T22:55:18.639135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.746486+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:55:17.746486+0000","last_peered":"2023-12-13T22:55:17.746486+0000","last_clean":"2023-12-13T22:55:17.746486+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:55:17.746486+0000","last_undegraded":"2023-12-13T22:55:17.746486+0000","last_fullsized":"2023-12-13T22:55:17.746486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501549+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:55:35.501549+0000","last_peered":"2023-12-13T22:55:35.501549+0000","last_clean":"2023-12-13T22:55:35.501549+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:55:35.501549+0000","last_undegraded":"2023-12-13T22:55:35.501549+0000","last_fullsized":"2023-12-13T22:55:35.501549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'252","reported_seq":441,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.111817+0000","last_change":"2023-12-13T22:25:57.852183+0000","last_active":"2023-12-13T22:55:35.111817+0000","last_peered":"2023-12-13T22:55:35.111817+0000","last_clean":"2023-12-13T22:55:35.111817+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:35.111817+0000","last_undegraded":"2023-12-13T22:55:35.111817+0000","last_fullsized":"2023-12-13T22:55:35.111817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.923670+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:54:17.923670+0000","last_peered":"2023-12-13T22:54:17.923670+0000","last_clean":"2023-12-13T22:54:17.923670+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:54:17.923670+0000","last_undegraded":"2023-12-13T22:54:17.923670+0000","last_fullsized":"2023-12-13T22:54:17.923670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.568692+0000","last_change":"2023-12-13T22:25:59.493902+0000","last_active":"2023-12-13T22:55:35.568692+0000","last_peered":"2023-12-13T22:55:35.568692+0000","last_clean":"2023-12-13T22:55:35.568692+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:35.568692+0000","last_undegraded":"2023-12-13T22:55:35.568692+0000","last_fullsized":"2023-12-13T22:55:35.568692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:58.540014+0000","last_change":"2023-12-13T22:25:57.853381+0000","last_active":"2023-12-13T22:54:58.540014+0000","last_peered":"2023-12-13T22:54:58.540014+0000","last_clean":"2023-12-13T22:54:58.540014+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:54:58.540014+0000","last_undegraded":"2023-12-13T22:54:58.540014+0000","last_fullsized":"2023-12-13T22:54:58.540014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:37:01.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.048818+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:54:23.048818+0000","last_peered":"2023-12-13T22:54:23.048818+0000","last_clean":"2023-12-13T22:54:23.048818+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:54:23.048818+0000","last_undegraded":"2023-12-13T22:54:23.048818+0000","last_fullsized":"2023-12-13T22:54:23.048818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698623+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:55:35.698623+0000","last_peered":"2023-12-13T22:55:35.698623+0000","last_clean":"2023-12-13T22:55:35.698623+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:55:35.698623+0000","last_undegraded":"2023-12-13T22:55:35.698623+0000","last_fullsized":"2023-12-13T22:55:35.698623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.359601+0000","last_change":"2023-12-13T22:55:52.359631+0000","last_active":"2023-12-13T22:55:52.359601+0000","last_peered":"2023-12-13T22:55:52.359601+0000","last_clean":"2023-12-13T22:55:52.359601+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:52.359601+0000","last_undegraded":"2023-12-13T22:55:52.359601+0000","last_fullsized":"2023-12-13T22:55:52.359601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.359516+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:37.445461+0000","scrub_duration":0.0062306879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:53:23.067917+0000","last_change":"2023-12-13T22:25:19.714262+0000","last_active":"2023-12-13T22:53:23.067917+0000","last_peered":"2023-12-13T22:53:23.067917+0000","last_clean":"2023-12-13T22:53:23.067917+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:53:23.067917+0000","last_undegraded":"2023-12-13T22:53:23.067917+0000","last_fullsized":"2023-12-13T22:53:23.067917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:18.143925+0000","last_clean_scrub_stamp":"2023-12-13T22:25:18.143925+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:09:07.907079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.599238+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:55:22.599238+0000","last_peered":"2023-12-13T22:55:22.599238+0000","last_clean":"2023-12-13T22:55:22.599238+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:55:22.599238+0000","last_undegraded":"2023-12-13T22:55:22.599238+0000","last_fullsized":"2023-12-13T22:55:22.599238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629343+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:55:35.629343+0000","last_peered":"2023-12-13T22:55:35.629343+0000","last_clean":"2023-12-13T22:55:35.629343+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:55:35.629343+0000","last_undegraded":"2023-12-13T22:55:35.629343+0000","last_fullsized":"2023-12-13T22:55:35.629343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:30:14.326400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:18.617010+0000","last_change":"2023-12-13T22:25:57.864566+0000","last_active":"2023-12-13T22:55:18.617010+0000","last_peered":"2023-12-13T22:55:18.617010+0000","last_clean":"2023-12-13T22:55:18.617010+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:55:18.617010+0000","last_undegraded":"2023-12-13T22:55:18.617010+0000","last_fullsized":"2023-12-13T22:55:18.617010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:19.997454+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:54:19.997454+0000","last_peered":"2023-12-13T22:54:19.997454+0000","last_clean":"2023-12-13T22:54:19.997454+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:54:19.997454+0000","last_undegraded":"2023-12-13T22:54:19.997454+0000","last_fullsized":"2023-12-13T22:54:19.997454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.366939+0000","last_change":"2023-12-13T22:55:51.367028+0000","last_active":"2023-12-13T22:55:51.366939+0000","last_peered":"2023-12-13T22:55:51.366939+0000","last_clean":"2023-12-13T22:55:51.366939+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:51.366939+0000","last_undegraded":"2023-12-13T22:55:51.366939+0000","last_fullsized":"2023-12-13T22:55:51.366939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.366729+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:41:58.469140+0000","scrub_duration":0.0033407179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'6","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.935681+0000","last_change":"2023-12-13T22:25:57.852697+0000","last_active":"2023-12-13T22:55:12.935681+0000","last_peered":"2023-12-13T22:55:12.935681+0000","last_clean":"2023-12-13T22:55:12.935681+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:55:12.935681+0000","last_undegraded":"2023-12-13T22:55:12.935681+0000","last_fullsized":"2023-12-13T22:55:12.935681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:19.807469+0000","last_change":"2023-12-13T22:26:05.942446+0000","last_active":"2023-12-13T22:55:19.807469+0000","last_peered":"2023-12-13T22:55:19.807469+0000","last_clean":"2023-12-13T22:55:19.807469+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:55:19.807469+0000","last_undegraded":"2023-12-13T22:55:19.807469+0000","last_fullsized":"2023-12-13T22:55:19.807469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.542756+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.542756+0000","last_peered":"2023-12-13T22:55:35.542756+0000","last_clean":"2023-12-13T22:55:35.542756+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.542756+0000","last_undegraded":"2023-12-13T22:55:35.542756+0000","last_fullsized":"2023-12-13T22:55:35.542756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:55.457235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:11.925804+0000","last_change":"2023-12-13T22:25:57.852187+0000","last_active":"2023-12-13T22:55:11.925804+0000","last_peered":"2023-12-13T22:55:11.925804+0000","last_clean":"2023-12-13T22:55:11.925804+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:55:11.925804+0000","last_undegraded":"2023-12-13T22:55:11.925804+0000","last_fullsized":"2023-12-13T22:55:11.925804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.404683+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:54:24.404683+0000","last_peered":"2023-12-13T22:54:24.404683+0000","last_clean":"2023-12-13T22:54:24.404683+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:54:24.404683+0000","last_undegraded":"2023-12-13T22:54:24.404683+0000","last_fullsized":"2023-12-13T22:54:24.404683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503670+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:35.503670+0000","last_peered":"2023-12-13T22:55:35.503670+0000","last_clean":"2023-12-13T22:55:35.503670+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:35.503670+0000","last_undegraded":"2023-12-13T22:55:35.503670+0000","last_fullsized":"2023-12-13T22:55:35.503670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'265","reported_seq":308,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.957704+0000","last_change":"2023-12-13T22:55:50.957847+0000","last_active":"2023-12-13T22:55:50.957704+0000","last_peered":"2023-12-13T22:55:50.957704+0000","last_clean":"2023-12-13T22:55:50.957704+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:50.957704+0000","last_undegraded":"2023-12-13T22:55:50.957704+0000","last_fullsized":"2023-12-13T22:55:50.957704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'265","last_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_deep_scrub":"31'265","last_deep_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.957478+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:05:25.538846+0000","scrub_duration":0.01053072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:19.995909+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:54:19.995909+0000","last_peered":"2023-12-13T22:54:19.995909+0000","last_clean":"2023-12-13T22:54:19.995909+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:54:19.995909+0000","last_undegraded":"2023-12-13T22:54:19.995909+0000","last_fullsized":"2023-12-13T22:54:19.995909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.533484+0000","last_change":"2023-12-13T22:26:00.418713+0000","last_active":"2023-12-13T22:55:35.533484+0000","last_peered":"2023-12-13T22:55:35.533484+0000","last_clean":"2023-12-13T22:55:35.533484+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:35.533484+0000","last_undegraded":"2023-12-13T22:55:35.533484+0000","last_fullsized":"2023-12-13T22:55:35.533484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:40:52.161970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'260","reported_seq":294,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.016573+0000","last_change":"2023-12-13T22:25:57.854041+0000","last_active":"2023-12-13T22:55:32.016573+0000","last_peered":"2023-12-13T22:55:32.016573+0000","last_clean":"2023-12-13T22:55:32.016573+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:55:32.016573+0000","last_undegraded":"2023-12-13T22:55:32.016573+0000","last_fullsized":"2023-12-13T22:55:32.016573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:04.804479+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:55:04.804479+0000","last_peered":"2023-12-13T22:55:04.804479+0000","last_clean":"2023-12-13T22:55:04.804479+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:55:04.804479+0000","last_undegraded":"2023-12-13T22:55:04.804479+0000","last_fullsized":"2023-12-13T22:55:04.804479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614629+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:55:35.614629+0000","last_peered":"2023-12-13T22:55:35.614629+0000","last_clean":"2023-12-13T22:55:35.614629+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:55:35.614629+0000","last_undegraded":"2023-12-13T22:55:35.614629+0000","last_fullsized":"2023-12-13T22:55:35.614629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1019","reported_seq":1053,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.395231+0000","last_change":"2023-12-13T22:25:57.850727+0000","last_active":"2023-12-13T22:55:24.395231+0000","last_peered":"2023-12-13T22:55:24.395231+0000","last_clean":"2023-12-13T22:55:24.395231+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:55:24.395231+0000","last_undegraded":"2023-12-13T22:55:24.395231+0000","last_fullsized":"2023-12-13T22:55:24.395231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:07.877831+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:55:07.877831+0000","last_peered":"2023-12-13T22:55:07.877831+0000","last_clean":"2023-12-13T22:55:07.877831+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:55:07.877831+0000","last_undegraded":"2023-12-13T22:55:07.877831+0000","last_fullsized":"2023-12-13T22:55:07.877831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.545966+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:55:35.545966+0000","last_peered":"2023-12-13T22:55:35.545966+0000","last_clean":"2023-12-13T22:55:35.545966+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:55:35.545966+0000","last_undegraded":"2023-12-13T22:55:35.545966+0000","last_fullsized":"2023-12-13T22:55:35.545966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:27:33.813435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'6","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:25.914809+0000","last_change":"2023-12-13T22:25:57.858511+0000","last_active":"2023-12-13T22:55:25.914809+0000","last_peered":"2023-12-13T22:55:25.914809+0000","last_clean":"2023-12-13T22:55:25.914809+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:25.914809+0000","last_undegraded":"2023-12-13T22:55:25.914809+0000","last_fullsized":"2023-12-13T22:55:25.914809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.390781+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.390781+0000","last_peered":"2023-12-13T22:54:24.390781+0000","last_clean":"2023-12-13T22:54:24.390781+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.390781+0000","last_undegraded":"2023-12-13T22:54:24.390781+0000","last_fullsized":"2023-12-13T22:54:24.390781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.555910+0000","last_change":"2023-12-13T22:25:59.703370+0000","last_active":"2023-12-13T22:55:35.555910+0000","last_peered":"2023-12-13T22:55:35.555910+0000","last_clean":"2023-12-13T22:55:35.555910+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:35.555910+0000","last_undegraded":"2023-12-13T22:55:35.555910+0000","last_fullsized":"2023-12-13T22:55:35.555910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'12","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.403222+0000","last_change":"2023-12-13T22:55:49.403251+0000","last_active":"2023-12-13T22:55:49.403222+0000","last_peered":"2023-12-13T22:55:49.403222+0000","last_clean":"2023-12-13T22:55:49.403222+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:55:49.403222+0000","last_undegraded":"2023-12-13T22:55:49.403222+0000","last_fullsized":"2023-12-13T22:55:49.403222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_clean_scrub_stamp":"2023-12-13T22:55:49.403136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:06:21.586077+0000","scrub_duration":0.0076955030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.064220+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:55:08.064220+0000","last_peered":"2023-12-13T22:55:08.064220+0000","last_clean":"2023-12-13T22:55:08.064220+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:55:08.064220+0000","last_undegraded":"2023-12-13T22:55:08.064220+0000","last_fullsized":"2023-12-13T22:55:08.064220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.544167+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:55:35.544167+0000","last_peered":"2023-12-13T22:55:35.544167+0000","last_clean":"2023-12-13T22:55:35.544167+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:55:35.544167+0000","last_undegraded":"2023-12-13T22:55:35.544167+0000","last_fullsized":"2023-12-13T22:55:35.544167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:57:08.420858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1182","reported_seq":1216,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:23.390662+0000","last_change":"2023-12-13T22:25:57.841195+0000","last_active":"2023-12-13T22:55:23.390662+0000","last_peered":"2023-12-13T22:55:23.390662+0000","last_clean":"2023-12-13T22:55:23.390662+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:23.390662+0000","last_undegraded":"2023-12-13T22:55:23.390662+0000","last_fullsized":"2023-12-13T22:55:23.390662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.391265+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:54:24.391265+0000","last_peered":"2023-12-13T22:54:24.391265+0000","last_clean":"2023-12-13T22:54:24.391265+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:54:24.391265+0000","last_undegraded":"2023-12-13T22:54:24.391265+0000","last_fullsized":"2023-12-13T22:54:24.391265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.599660+0000","last_change":"2023-12-13T22:26:00.402919+0000","last_active":"2023-12-13T22:55:35.599660+0000","last_peered":"2023-12-13T22:55:35.599660+0000","last_clean":"2023-12-13T22:55:35.599660+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:35.599660+0000","last_undegraded":"2023-12-13T22:55:35.599660+0000","last_fullsized":"2023-12-13T22:55:35.599660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'128","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.024377+0000","last_change":"2023-12-13T22:25:57.862862+0000","last_active":"2023-12-13T22:55:32.024377+0000","last_peered":"2023-12-13T22:55:32.024377+0000","last_clean":"2023-12-13T22:55:32.024377+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:32.024377+0000","last_undegraded":"2023-12-13T22:55:32.024377+0000","last_fullsized":"2023-12-13T22:55:32.024377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.390692+0000","last_change":"2023-12-13T22:26:05.939905+0000","last_active":"2023-12-13T22:54:24.390692+0000","last_peered":"2023-12-13T22:54:24.390692+0000","last_clean":"2023-12-13T22:54:24.390692+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:54:24.390692+0000","last_undegraded":"2023-12-13T22:54:24.390692+0000","last_fullsized":"2023-12-13T22:54:24.390692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.579386+0000","last_change":"2023-12-13T22:25:59.501711+0000","last_active":"2023-12-13T22:55:35.579386+0000","last_peered":"2023-12-13T22:55:35.579386+0000","last_clean":"2023-12-13T22:55:35.579386+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:55:35.579386+0000","last_undegraded":"2023-12-13T22:55:35.579386+0000","last_fullsized":"2023-12-13T22:55:35.579386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'7","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.393567+0000","last_change":"2023-12-13T22:25:57.860955+0000","last_active":"2023-12-13T22:55:24.393567+0000","last_peered":"2023-12-13T22:55:24.393567+0000","last_clean":"2023-12-13T22:55:24.393567+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:24.393567+0000","last_undegraded":"2023-12-13T22:55:24.393567+0000","last_fullsized":"2023-12-13T22:55:24.393567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.331139+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:54:24.331139+0000","last_peered":"2023-12-13T22:54:24.331139+0000","last_clean":"2023-12-13T22:54:24.331139+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:54:24.331139+0000","last_undegraded":"2023-12-13T22:54:24.331139+0000","last_fullsized":"2023-12-13T22:54:24.331139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.584337+0000","last_change":"2023-12-13T22:26:00.410040+0000","last_active":"2023-12-13T22:55:35.584337+0000","last_peered":"2023-12-13T22:55:35.584337+0000","last_clean":"2023-12-13T22:55:35.584337+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:55:35.584337+0000","last_undegraded":"2023-12-13T22:55:35.584337+0000","last_fullsized":"2023-12-13T22:55:35.584337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'90","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.128782+0000","last_change":"2023-12-13T22:25:57.850562+0000","last_active":"2023-12-13T22:55:35.128782+0000","last_peered":"2023-12-13T22:55:35.128782+0000","last_clean":"2023-12-13T22:55:35.128782+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:55:35.128782+0000","last_undegraded":"2023-12-13T22:55:35.128782+0000","last_fullsized":"2023-12-13T22:55:35.128782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.062331+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:54:23.062331+0000","last_peered":"2023-12-13T22:54:23.062331+0000","last_clean":"2023-12-13T22:54:23.062331+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:54:23.062331+0000","last_undegraded":"2023-12-13T22:54:23.062331+0000","last_fullsized":"2023-12-13T22:54:23.062331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.384057+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:54:24.384057+0000","last_peered":"2023-12-13T22:54:24.384057+0000","last_clean":"2023-12-13T22:54:24.384057+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:54:24.384057+0000","last_undegraded":"2023-12-13T22:54:24.384057+0000","last_fullsized":"2023-12-13T22:54:24.384057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.617154+0000","last_change":"2023-12-13T22:55:47.617203+0000","last_active":"2023-12-13T22:55:47.617154+0000","last_peered":"2023-12-13T22:55:47.617154+0000","last_clean":"2023-12-13T22:55:47.617154+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:47.617154+0000","last_undegraded":"2023-12-13T22:55:47.617154+0000","last_fullsized":"2023-12-13T22:55:47.617154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_clean_scrub_stamp":"2023-12-13T22:55:47.617039+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:57.072541+0000","scrub_duration":0.0027396679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:05.096791+0000","last_change":"2023-12-13T22:25:57.861249+0000","last_active":"2023-12-13T22:55:05.096791+0000","last_peered":"2023-12-13T22:55:05.096791+0000","last_clean":"2023-12-13T22:55:05.096791+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:55:05.096791+0000","last_undegraded":"2023-12-13T22:55:05.096791+0000","last_fullsized":"2023-12-13T22:55:05.096791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.598315+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:55:17.598315+0000","last_peered":"2023-12-13T22:55:17.598315+0000","last_clean":"2023-12-13T22:55:17.598315+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:55:17.598315+0000","last_undegraded":"2023-12-13T22:55:17.598315+0000","last_fullsized":"2023-12-13T22:55:17.598315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.695642+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:55:35.695642+0000","last_peered":"2023-12-13T22:55:35.695642+0000","last_clean":"2023-12-13T22:55:35.695642+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:55:35.695642+0000","last_undegraded":"2023-12-13T22:55:35.695642+0000","last_fullsized":"2023-12-13T22:55:35.695642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'209","reported_seq":443,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:13.341783+0000","last_change":"2023-12-13T22:25:57.860988+0000","last_active":"2023-12-13T22:55:13.341783+0000","last_peered":"2023-12-13T22:55:13.341783+0000","last_clean":"2023-12-13T22:55:13.341783+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:55:13.341783+0000","last_undegraded":"2023-12-13T22:55:13.341783+0000","last_fullsized":"2023-12-13T22:55:13.341783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'305","reported_seq":634,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:24.383184+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:55:24.383184+0000","last_peered":"2023-12-13T22:55:24.383184+0000","last_clean":"2023-12-13T22:55:24.383184+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:55:24.383184+0000","last_undegraded":"2023-12-13T22:55:24.383184+0000","last_fullsized":"2023-12-13T22:55:24.383184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.572078+0000","last_change":"2023-12-13T22:25:59.493929+0000","last_active":"2023-12-13T22:55:35.572078+0000","last_peered":"2023-12-13T22:55:35.572078+0000","last_clean":"2023-12-13T22:55:35.572078+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:35.572078+0000","last_undegraded":"2023-12-13T22:55:35.572078+0000","last_fullsized":"2023-12-13T22:55:35.572078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.335148+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:54:24.335148+0000","last_peered":"2023-12-13T22:54:24.335148+0000","last_clean":"2023-12-13T22:54:24.335148+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:54:24.335148+0000","last_undegraded":"2023-12-13T22:54:24.335148+0000","last_fullsized":"2023-12-13T22:54:24.335148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2402","reported_seq":2435,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.831295+0000","last_change":"2023-12-13T22:25:57.854994+0000","last_active":"2023-12-13T22:55:35.831295+0000","last_peered":"2023-12-13T22:55:35.831295+0000","last_clean":"2023-12-13T22:55:35.831295+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:55:35.831295+0000","last_undegraded":"2023-12-13T22:55:35.831295+0000","last_fullsized":"2023-12-13T22:55:35.831295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.596616+0000","last_change":"2023-12-13T22:26:00.411711+0000","last_active":"2023-12-13T22:55:35.596616+0000","last_peered":"2023-12-13T22:55:35.596616+0000","last_clean":"2023-12-13T22:55:35.596616+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:35.596616+0000","last_undegraded":"2023-12-13T22:55:35.596616+0000","last_fullsized":"2023-12-13T22:55:35.596616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.950342+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:54:17.950342+0000","last_peered":"2023-12-13T22:54:17.950342+0000","last_clean":"2023-12-13T22:54:17.950342+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:54:17.950342+0000","last_undegraded":"2023-12-13T22:54:17.950342+0000","last_fullsized":"2023-12-13T22:54:17.950342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624606+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:55:35.624606+0000","last_peered":"2023-12-13T22:55:35.624606+0000","last_clean":"2023-12-13T22:55:35.624606+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:55:35.624606+0000","last_undegraded":"2023-12-13T22:55:35.624606+0000","last_fullsized":"2023-12-13T22:55:35.624606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.761688+0000","last_change":"2023-12-13T22:26:00.419942+0000","last_active":"2023-12-13T22:55:35.761688+0000","last_peered":"2023-12-13T22:55:35.761688+0000","last_clean":"2023-12-13T22:55:35.761688+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:55:35.761688+0000","last_undegraded":"2023-12-13T22:55:35.761688+0000","last_fullsized":"2023-12-13T22:55:35.761688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631151+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:55:35.631151+0000","last_peered":"2023-12-13T22:55:35.631151+0000","last_clean":"2023-12-13T22:55:35.631151+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:55:35.631151+0000","last_undegraded":"2023-12-13T22:55:35.631151+0000","last_fullsized":"2023-12-13T22:55:35.631151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.573586+0000","last_change":"2023-12-13T22:26:00.242525+0000","last_active":"2023-12-13T22:55:35.573586+0000","last_peered":"2023-12-13T22:55:35.573586+0000","last_clean":"2023-12-13T22:55:35.573586+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:55:35.573586+0000","last_undegraded":"2023-12-13T22:55:35.573586+0000","last_fullsized":"2023-12-13T22:55:35.573586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.973766+0000","last_change":"2023-12-13T22:55:51.973818+0000","last_active":"2023-12-13T22:55:51.973766+0000","last_peered":"2023-12-13T22:55:51.973766+0000","last_clean":"2023-12-13T22:55:51.973766+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:51.973766+0000","last_undegraded":"2023-12-13T22:55:51.973766+0000","last_fullsized":"2023-12-13T22:55:51.973766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.973584+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:03.967036+0000","scrub_duration":0.0031747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501639+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:35.501639+0000","last_peered":"2023-12-13T22:55:35.501639+0000","last_clean":"2023-12-13T22:55:35.501639+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:35.501639+0000","last_undegraded":"2023-12-13T22:55:35.501639+0000","last_fullsized":"2023-12-13T22:55:35.501639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631179+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:35.631179+0000","last_peered":"2023-12-13T22:55:35.631179+0000","last_clean":"2023-12-13T22:55:35.631179+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:35.631179+0000","last_undegraded":"2023-12-13T22:55:35.631179+0000","last_fullsized":"2023-12-13T22:55:35.631179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.692262+0000","last_change":"2023-12-13T22:26:00.400654+0000","last_active":"2023-12-13T22:55:35.692262+0000","last_peered":"2023-12-13T22:55:35.692262+0000","last_clean":"2023-12-13T22:55:35.692262+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:35.692262+0000","last_undegraded":"2023-12-13T22:55:35.692262+0000","last_fullsized":"2023-12-13T22:55:35.692262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632343+0000","last_change":"2023-12-13T22:26:00.402552+0000","last_active":"2023-12-13T22:55:35.632343+0000","last_peered":"2023-12-13T22:55:35.632343+0000","last_clean":"2023-12-13T22:55:35.632343+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:55:35.632343+0000","last_undegraded":"2023-12-13T22:55:35.632343+0000","last_fullsized":"2023-12-13T22:55:35.632343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.699075+0000","last_change":"2023-12-13T22:26:00.398545+0000","last_active":"2023-12-13T22:55:35.699075+0000","last_peered":"2023-12-13T22:55:35.699075+0000","last_clean":"2023-12-13T22:55:35.699075+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.699075+0000","last_undegraded":"2023-12-13T22:55:35.699075+0000","last_fullsized":"2023-12-13T22:55:35.699075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631226+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:55:35.631226+0000","last_peered":"2023-12-13T22:55:35.631226+0000","last_clean":"2023-12-13T22:55:35.631226+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:55:35.631226+0000","last_undegraded":"2023-12-13T22:55:35.631226+0000","last_fullsized":"2023-12-13T22:55:35.631226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.572912+0000","last_change":"2023-12-13T22:25:59.703594+0000","last_active":"2023-12-13T22:55:35.572912+0000","last_peered":"2023-12-13T22:55:35.572912+0000","last_clean":"2023-12-13T22:55:35.572912+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:55:35.572912+0000","last_undegraded":"2023-12-13T22:55:35.572912+0000","last_fullsized":"2023-12-13T22:55:35.572912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624448+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:55:35.624448+0000","last_peered":"2023-12-13T22:55:35.624448+0000","last_clean":"2023-12-13T22:55:35.624448+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:55:35.624448+0000","last_undegraded":"2023-12-13T22:55:35.624448+0000","last_fullsized":"2023-12-13T22:55:35.624448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543937+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.543937+0000","last_peered":"2023-12-13T22:55:35.543937+0000","last_clean":"2023-12-13T22:55:35.543937+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.543937+0000","last_undegraded":"2023-12-13T22:55:35.543937+0000","last_fullsized":"2023-12-13T22:55:35.543937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:41:13.544901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.762182+0000","last_change":"2023-12-13T22:26:00.415864+0000","last_active":"2023-12-13T22:55:35.762182+0000","last_peered":"2023-12-13T22:55:35.762182+0000","last_clean":"2023-12-13T22:55:35.762182+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:55:35.762182+0000","last_undegraded":"2023-12-13T22:55:35.762182+0000","last_fullsized":"2023-12-13T22:55:35.762182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.759084+0000","last_change":"2023-12-13T22:27:03.509440+0000","last_active":"2023-12-13T22:55:35.759084+0000","last_peered":"2023-12-13T22:55:35.759084+0000","last_clean":"2023-12-13T22:55:35.759084+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:55:35.759084+0000","last_undegraded":"2023-12-13T22:55:35.759084+0000","last_fullsized":"2023-12-13T22:55:35.759084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.632392+0000","last_change":"2023-12-13T22:26:00.394776+0000","last_active":"2023-12-13T22:55:35.632392+0000","last_peered":"2023-12-13T22:55:35.632392+0000","last_clean":"2023-12-13T22:55:35.632392+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:55:35.632392+0000","last_undegraded":"2023-12-13T22:55:35.632392+0000","last_fullsized":"2023-12-13T22:55:35.632392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.502195+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:55:35.502195+0000","last_peered":"2023-12-13T22:55:35.502195+0000","last_clean":"2023-12-13T22:55:35.502195+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:55:35.502195+0000","last_undegraded":"2023-12-13T22:55:35.502195+0000","last_fullsized":"2023-12-13T22:55:35.502195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.425461+0000","last_change":"2023-12-13T22:55:46.425498+0000","last_active":"2023-12-13T22:55:46.425461+0000","last_peered":"2023-12-13T22:55:46.425461+0000","last_clean":"2023-12-13T22:55:46.425461+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:46.425461+0000","last_undegraded":"2023-12-13T22:55:46.425461+0000","last_fullsized":"2023-12-13T22:55:46.425461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_clean_scrub_stamp":"2023-12-13T22:55:46.425334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:25:04.502584+0000","scrub_duration":0.0031700270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698112+0000","last_change":"2023-12-13T22:26:00.389747+0000","last_active":"2023-12-13T22:55:35.698112+0000","last_peered":"2023-12-13T22:55:35.698112+0000","last_clean":"2023-12-13T22:55:35.698112+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:35.698112+0000","last_undegraded":"2023-12-13T22:55:35.698112+0000","last_fullsized":"2023-12-13T22:55:35.698112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614971+0000","last_change":"2023-12-13T22:26:00.397727+0000","last_active":"2023-12-13T22:55:35.614971+0000","last_peered":"2023-12-13T22:55:35.614971+0000","last_clean":"2023-12-13T22:55:35.614971+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:55:35.614971+0000","last_undegraded":"2023-12-13T22:55:35.614971+0000","last_fullsized":"2023-12-13T22:55:35.614971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.635546+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:55:35.635546+0000","last_peered":"2023-12-13T22:55:35.635546+0000","last_clean":"2023-12-13T22:55:35.635546+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:55:35.635546+0000","last_undegraded":"2023-12-13T22:55:35.635546+0000","last_fullsized":"2023-12-13T22:55:35.635546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631639+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631639+0000","last_peered":"2023-12-13T22:55:35.631639+0000","last_clean":"2023-12-13T22:55:35.631639+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631639+0000","last_undegraded":"2023-12-13T22:55:35.631639+0000","last_fullsized":"2023-12-13T22:55:35.631639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580534+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580534+0000","last_peered":"2023-12-13T22:55:35.580534+0000","last_clean":"2023-12-13T22:55:35.580534+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580534+0000","last_undegraded":"2023-12-13T22:55:35.580534+0000","last_fullsized":"2023-12-13T22:55:35.580534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:15:50.913628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.699053+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:55:35.699053+0000","last_peered":"2023-12-13T22:55:35.699053+0000","last_clean":"2023-12-13T22:55:35.699053+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:35.699053+0000","last_undegraded":"2023-12-13T22:55:35.699053+0000","last_fullsized":"2023-12-13T22:55:35.699053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.532526+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:55:35.532526+0000","last_peered":"2023-12-13T22:55:35.532526+0000","last_clean":"2023-12-13T22:55:35.532526+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:55:35.532526+0000","last_undegraded":"2023-12-13T22:55:35.532526+0000","last_fullsized":"2023-12-13T22:55:35.532526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:26.288923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760647+0000","last_change":"2023-12-13T22:27:03.070128+0000","last_active":"2023-12-13T22:55:35.760647+0000","last_peered":"2023-12-13T22:55:35.760647+0000","last_clean":"2023-12-13T22:55:35.760647+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:55:35.760647+0000","last_undegraded":"2023-12-13T22:55:35.760647+0000","last_fullsized":"2023-12-13T22:55:35.760647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539165+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:55:35.539165+0000","last_peered":"2023-12-13T22:55:35.539165+0000","last_clean":"2023-12-13T22:55:35.539165+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:55:35.539165+0000","last_undegraded":"2023-12-13T22:55:35.539165+0000","last_fullsized":"2023-12-13T22:55:35.539165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:14:49.091451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631751+0000","last_change":"2023-12-13T22:26:00.416619+0000","last_active":"2023-12-13T22:55:35.631751+0000","last_peered":"2023-12-13T22:55:35.631751+0000","last_clean":"2023-12-13T22:55:35.631751+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:55:35.631751+0000","last_undegraded":"2023-12-13T22:55:35.631751+0000","last_fullsized":"2023-12-13T22:55:35.631751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.564426+0000","last_change":"2023-12-13T22:26:00.249386+0000","last_active":"2023-12-13T22:55:35.564426+0000","last_peered":"2023-12-13T22:55:35.564426+0000","last_clean":"2023-12-13T22:55:35.564426+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:55:35.564426+0000","last_undegraded":"2023-12-13T22:55:35.564426+0000","last_fullsized":"2023-12-13T22:55:35.564426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503600+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:55:35.503600+0000","last_peered":"2023-12-13T22:55:35.503600+0000","last_clean":"2023-12-13T22:55:35.503600+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:55:35.503600+0000","last_undegraded":"2023-12-13T22:55:35.503600+0000","last_fullsized":"2023-12-13T22:55:35.503600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.538999+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.538999+0000","last_peered":"2023-12-13T22:55:35.538999+0000","last_clean":"2023-12-13T22:55:35.538999+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.538999+0000","last_undegraded":"2023-12-13T22:55:35.538999+0000","last_fullsized":"2023-12-13T22:55:35.538999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T22:39:20.879389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8041,"ondisk_log_size":8041,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477109,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.38100000000000001},"max":{"1min":1.3180000000000001,"5min":1.73,"15min":1.7689999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.65100000000000002,"5min":0.55900000000000005,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.628,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.2350000000000001,"5min":2.165,"15min":2.165},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.022,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.63300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.369,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97299999999999998,"15min":0.97699999999999998},"min":{"1min":0.66000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.361,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.383,"5min":1.649,"15min":2.1269999999999998},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.76700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.792,"15min":1.792},"last":1.012},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0069999999999999,"15min":1.032},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.3700000000000001,"5min":1.496,"15min":2.996},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.6819999999999999,"5min":1.847,"15min":1.8480000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.8120000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.04},"min":{"1min":0.68100000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6339999999999999,"15min":2.21},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.159,"5min":1.111,"15min":1.107},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.591,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.145,"15min":1.143},"min":{"1min":0.77100000000000002,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.506,"5min":2.056,"15min":2.0590000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.167,"5min":1.133,"15min":1.129},"min":{"1min":0.60599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.73,"5min":1.798,"15min":2.169},"last":0.96799999999999997}]}]},{"osd":6,"up_from":16,"seq":68719477109,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.67400000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.272,"5min":1.575,"15min":2.1970000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.3109999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.873,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.319,"15min":1.5109999999999999},"last":0.629},{"interface":"front","average":{"1min":1.032,"5min":1.0289999999999999,"15min":1.0129999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":1.0569999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4650000000000001,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.04,"15min":1.014},"min":{"1min":0.79100000000000004,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.506,"5min":1.506,"15min":1.8540000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0700000000000001,"15min":1.0649999999999999},"min":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.44800000000000001},"max":{"1min":1.4930000000000001,"5min":1.587,"15min":1.841},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.083,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.3320000000000001,"5min":1.405,"15min":1.784},"last":0.71999999999999997}]},{"osd":4,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.755,"5min":0.47499999999999998,"15min":0.375},"max":{"1min":1.6279999999999999,"5min":1.7350000000000001,"15min":2.504},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.72799999999999998,"5min":0.47099999999999997,"15min":0.33000000000000002},"max":{"1min":1.5569999999999999,"5min":1.708,"15min":2.044},"last":0.97299999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.63200000000000001,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.9239999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1879999999999999,"15min":1.2010000000000001},"min":{"1min":0.72499999999999998,"5min":0.52200000000000002,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.161}]},{"osd":7,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.21,"15min":1.2},"min":{"1min":0.69799999999999995,"5min":0.45000000000000001,"15min":0.42299999999999999},"max":{"1min":1.6339999999999999,"5min":1.766,"15min":2.956},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.99399999999999999,"5min":0.495,"15min":0.442},"max":{"1min":1.6779999999999999,"5min":1.788,"15min":1.9350000000000001},"last":0.88500000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477109,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.264,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.494},"last":0.71199999999999997}]},{"osd":1,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.75800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.667},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93999999999999995,"15min":0.96899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.0920000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.69099999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.4350000000000001,"15min":1.5009999999999999},"last":1.0549999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.57499999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.599},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3360000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.175}]},{"osd":4,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89400000000000002,"15min":0.92500000000000004},"min":{"1min":0.57199999999999995,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3779999999999999,"5min":1.482,"15min":1.53},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.024,"15min":1.0680000000000001},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.63300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.466,"5min":1.552,"15min":1.8480000000000001},"last":1.137}]},{"osd":7,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.1459999999999999},"min":{"1min":0.60199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.9339999999999999},"last":1.02},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.274}]}]},{"osd":4,"up_from":16,"seq":68719477110,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.879,"15min":0.91200000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.90700000000000003,"15min":0.90200000000000002},"min":{"1min":0.64200000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3220000000000001,"5min":1.3759999999999999,"15min":1.488},"last":1.046}]},{"osd":1,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95099999999999996},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.242,"5min":1.75,"15min":1.75},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.997,"15min":1.002},"min":{"1min":0.71399999999999997,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.22,"5min":1.4299999999999999,"15min":1.831},"last":1.0920000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.96699999999999997,"15min":0.97999999999999998},"min":{"1min":0.65200000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.2470000000000001,"5min":1.371,"15min":1.645},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.0309999999999999,"15min":1.04},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.423,"5min":1.5149999999999999,"15min":1.75},"last":0.91100000000000003}]},{"osd":3,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.96299999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.194,"5min":1.639,"15min":1.639},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.097,"15min":1.1220000000000001},"min":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.3899999999999999,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":1.1919999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.63400000000000001,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.51,"5min":2.218,"15min":2.218},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0349999999999999},"min":{"1min":0.63600000000000001,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.464,"5min":1.5,"15min":1.643},"last":0.97699999999999998}]},{"osd":6,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0189999999999999,"15min":1.0680000000000001},"min":{"1min":0.60999999999999999,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.595,"5min":2.137,"15min":2.137},"last":1.327}]},{"osd":7,"last update":"Wed Dec 13 22:55:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1020000000000001,"15min":1.1200000000000001},"min":{"1min":0.628,"5min":0.61599999999999999,"15min":0.504},"max":{"1min":1.585,"5min":1.8049999999999999,"15min":1.857},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1879999999999999,"15min":1.2070000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.833,"5min":1.927,"15min":2.3079999999999998},"last":1.3640000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477109,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.081,"5min":1.3149999999999999,"15min":1.524},"last":0.308}]},{"osd":1,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88200000000000001,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3859999999999999,"15min":1.4379999999999999},"last":0.434}]},{"osd":2,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.86699999999999999},"min":{"1min":0.61599999999999999,"5min":0.373,"15min":0.34200000000000003},"max":{"1min":1.085,"5min":1.3029999999999999,"15min":5.085},"last":0.35599999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95099999999999996,"15min":0.92900000000000005},"min":{"1min":0.63600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.81599999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3069999999999999,"5min":1.6359999999999999,"15min":1.77},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3180000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0800000000000001,"15min":1.091},"min":{"1min":0.76800000000000002,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.3919999999999999,"5min":1.532,"15min":1.8400000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1830000000000001,"15min":1.177},"min":{"1min":0.84999999999999998,"5min":0.63200000000000001,"15min":0.38200000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.23,"15min":1.204},"min":{"1min":0.98999999999999999,"5min":0.60299999999999998,"15min":0.47199999999999998},"max":{"1min":1.5720000000000001,"5min":1.8149999999999999,"15min":2.181},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.96399999999999997,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.407,"5min":1.742,"15min":2.1230000000000002},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.81699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4870000000000001,"5min":1.841,"15min":2.1779999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0189999999999999,"5min":0.65200000000000002,"15min":0.55600000000000005},"max":{"1min":1.5169999999999999,"5min":1.7909999999999999,"15min":1.948},"last":0.70399999999999996}]}]},{"osd":1,"up_from":16,"seq":68719477110,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53000000000000003,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":1.054,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.45700000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1559999999999999,"5min":1.401,"15min":1.5580000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.397,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1160000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.872,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.308,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0049999999999999,"15min":1.0089999999999999},"min":{"1min":0.746,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.3169999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.60299999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3260000000000001,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0609999999999999,"15min":1.089},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.6599999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.181,"15min":1.1799999999999999},"min":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"max":{"1min":1.4710000000000001,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.117},"min":{"1min":0.79000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.468,"5min":1.706,"15min":1.7649999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.66400000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.4339999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.91600000000000004}]},{"osd":7,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.88500000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.409,"5min":1.8,"15min":1.8520000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.095,"5min":1.1519999999999999,"15min":1.173},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4239999999999999,"5min":2.774,"15min":2.774},"last":0.877}]}]},{"osd":2,"up_from":15,"seq":64424509812,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.24,"5min":1.24,"15min":2.8730000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.042,"5min":1.47,"15min":1.964},"last":0.755},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.2609999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.503,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1619999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1759999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.012}]},{"osd":4,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.63400000000000001,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.105,"5min":1.718,"15min":1.869},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.034,"15min":1.0669999999999999},"min":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":1.8340000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.091},"min":{"1min":0.71999999999999997,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.573,"5min":1.772,"15min":2.1030000000000002},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":2.0779999999999998},"last":1.1739999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.1499999999999999},"min":{"1min":0.80300000000000005,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.518,"5min":1.764,"15min":1.835},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1060000000000001,"15min":1.1419999999999999},"min":{"1min":0.72999999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.319,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1599999999999999,"15min":1.1910000000000001},"min":{"1min":0.83199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.704,"15min":2.5640000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1479999999999999,"15min":1.2050000000000001},"min":{"1min":0.81200000000000006,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":1.986,"15min":5.3310000000000004},"last":1.2070000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542515,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":1.048,"5min":1.897,"15min":1.897},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.77000000000000002},"min":{"1min":0.51700000000000002,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.099,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.75600000000000001},"min":{"1min":0.5,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89400000000000002,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.495},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.872,"15min":0.874},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.79,"5min":1.79,"15min":1.9099999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":0.91900000000000004},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.0680000000000001,"5min":1.867,"15min":2.6320000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92400000000000004,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":2.0659999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.71199999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.4490000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.995}]},{"osd":5,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.099,"15min":1.0760000000000001},"min":{"1min":0.70999999999999996,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.5309999999999999,"5min":1.554,"15min":1.625},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.53000000000000003,"15min":0.46800000000000003},"max":{"1min":1.5049999999999999,"5min":2.0259999999999998,"15min":2.1539999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.139,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.8420000000000001,"15min":2.2250000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.232,"15min":1.212},"min":{"1min":0.93799999999999994,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5669999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.2090000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.91800000000000004,"5min":0.56899999999999995,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.232,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6419999999999999,"5min":2.1259999999999999,"15min":2.339},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.729 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.730 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.731 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.732 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.733 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-13T22:25:18.143925+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=18, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.734 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.735 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.736 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.737 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.738 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.739 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.740 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.741 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.742 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.743 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:55:53.744 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T22:56:05.875 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:56:05.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:56:13.745 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:56:13.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.874+0000 7f198e0d5640 1 Processor -- start 2023-12-13T22:56:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.874+0000 7f198e0d5640 1 -- start start 2023-12-13T22:56:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f198e0d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1988151340 0x7f198806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f198e0d5640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19880c40e0 0x7f19880c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.872 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f198e0d5640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198806f4a0 con 0x7f1988151720 2023-12-13T22:56:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f198e0d5640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1988072570 con 0x7f19880c40e0 2023-12-13T22:56:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f198e0d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1988070be0 con 0x7f1988151340 2023-12-13T22:56:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f1987fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19880c40e0 0x7f19880c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:13.873 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f1987fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f19880c40e0 0x7f19880c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44856/0 (socket says 172.21.15.91:44856) 2023-12-13T22:56:13.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.878+0000 7f1987fff640 1 -- 172.21.15.91:0/509894479 learned_addr learned my addr 172.21.15.91:0/509894479 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.882+0000 7f1987fff640 1 -- 172.21.15.91:0/509894479 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1988151340 msgr2=0x7f198806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:56:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.882+0000 7f1987fff640 1 --2- 172.21.15.91:0/509894479 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1988151340 0x7f198806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.882+0000 7f1987fff640 1 -- 172.21.15.91:0/509894479 >> v1:172.21.15.91:6789/0 conn(0x7f1988151720 legacy=0x7f1988157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:56:13.877 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.882+0000 7f1987fff640 1 -- 172.21.15.91:0/509894479 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988070e80 con 0x7f19880c40e0 2023-12-13T22:56:13.881 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.886+0000 7f1987fff640 1 --2- 172.21.15.91:0/509894479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19880c40e0 0x7f19880c4590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1980009e50 tx=0x7f198001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9f430dbb5d6049 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:13.885 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f19867fc640 1 -- 172.21.15.91:0/509894479 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800a5820 con 0x7f19880c40e0 2023-12-13T22:56:13.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f19867fc640 1 -- 172.21.15.91:0/509894479 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19800a5980 con 0x7f19880c40e0 2023-12-13T22:56:13.886 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f19867fc640 1 -- 172.21.15.91:0/509894479 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800a5d10 con 0x7f19880c40e0 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 -- 172.21.15.91:0/509894479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19880c40e0 msgr2=0x7f19880c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 --2- 172.21.15.91:0/509894479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19880c40e0 0x7f19880c4590 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1980009e50 tx=0x7f198001c9a0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 -- 172.21.15.91:0/509894479 shutdown_connections 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 --2- 172.21.15.91:0/509894479 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f19880c40e0 0x7f19880c4590 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 --2- 172.21.15.91:0/509894479 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1988151340 0x7f198806ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 -- 172.21.15.91:0/509894479 >> 172.21.15.91:0/509894479 conn(0x7f198806c6a0 msgr2=0x7f198806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 -- 172.21.15.91:0/509894479 shutdown_connections 2023-12-13T22:56:13.887 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 -- 172.21.15.91:0/509894479 wait complete. 2023-12-13T22:56:13.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.890+0000 7f198e0d5640 1 Processor -- start 2023-12-13T22:56:13.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 -- start start 2023-12-13T22:56:13.888 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19880c40e0 0x7f19880c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1988151340 0x7f19880c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881f5ec0 con 0x7f1988151720 2023-12-13T22:56:13.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880c1f70 con 0x7f1988151340 2023-12-13T22:56:13.889 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f198e0d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880c2250 con 0x7f19880c40e0 2023-12-13T22:56:13.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f1987fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:13.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f1987fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:44858/0 (socket says 172.21.15.91:44858) 2023-12-13T22:56:13.890 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.894+0000 7f1987fff640 1 -- 172.21.15.91:0/3867674634 learned_addr learned my addr 172.21.15.91:0/3867674634 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:13.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 -- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19880c40e0 msgr2=0x7f19880c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:13.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19880c40e0 0x7f19880c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 -- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1988151340 msgr2=0x7f19880c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:13.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1988151340 0x7f19880c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:13.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 -- 172.21.15.91:0/3867674634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009b30 con 0x7f1988151720 2023-12-13T22:56:13.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.898+0000 7f1987fff640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f198001b050 tx=0x7f1980019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:13.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.902+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800b8880 con 0x7f1988151720 2023-12-13T22:56:13.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.902+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19800b8a20 con 0x7f1988151720 2023-12-13T22:56:13.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.902+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880c3c80 con 0x7f1988151720 2023-12-13T22:56:13.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.902+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800b8dd0 con 0x7f1988151720 2023-12-13T22:56:13.899 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.902+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1988160a00 con 0x7f1988151720 2023-12-13T22:56:13.900 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.906+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19880c2390 con 0x7f1988151720 2023-12-13T22:56:13.919 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.922+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f19800c3460 con 0x7f1988151720 2023-12-13T22:56:13.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.922+0000 7f197ffff640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 0x7f1968068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:13.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.922+0000 7f19877fe640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 0x7f1968068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:13.920 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:13.926+0000 7f19877fe640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 0x7f1968068d00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1978009690 tx=0x7f1978006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:14.202 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.206+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19800f1720 con 0x7f1988151720 2023-12-13T22:56:14.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.206+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f19800ed360 con 0x7f1988151720 2023-12-13T22:56:14.359 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.362+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1988163b60 con 0x7f1968066840 2023-12-13T22:56:14.389 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.394+0000 7f197ffff640 1 -- 172.21.15.91:0/3867674634 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368194 (secure 0 0 0) 0x7f197800b3d0 con 0x7f1968066840 2023-12-13T22:56:14.393 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:56:14.395 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 msgr2=0x7f1968068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 0x7f1968068d00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1978009690 tx=0x7f1978006c00 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 msgr2=0x7f19880c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f198001b050 tx=0x7f1980019740 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 shutdown_connections 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f1968066840 0x7f1968068d00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f1988151720 0x7f19880c9ac0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1988151340 0x7f19880c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 --2- 172.21.15.91:0/3867674634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f19880c40e0 0x7f19880c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 >> 172.21.15.91:0/3867674634 conn(0x7f198806c6a0 msgr2=0x7f19880735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:14.397 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 shutdown_connections 2023-12-13T22:56:14.398 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:14.398+0000 7f198e0d5640 1 -- 172.21.15.91:0/3867674634 wait complete. 2023-12-13T22:56:14.413 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":957,"stamp":"2023-12-13T22:56:13.360274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13481,"ondisk_log_size":13481,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005504"},"pg_stats":[{"pgid":"2.1f","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.362830+0000","last_change":"2023-12-13T22:55:50.362882+0000","last_active":"2023-12-13T22:55:50.362830+0000","last_peered":"2023-12-13T22:55:50.362830+0000","last_clean":"2023-12-13T22:55:50.362830+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:50.362830+0000","last_undegraded":"2023-12-13T22:55:50.362830+0000","last_fullsized":"2023-12-13T22:55:50.362830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.362718+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:36:46.007828+0000","scrub_duration":0.0095031890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.086684+0000","last_change":"2023-12-13T22:55:57.086684+0000","last_active":"2023-12-13T22:55:57.086684+0000","last_peered":"2023-12-13T22:55:57.086684+0000","last_clean":"2023-12-13T22:55:57.086684+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:57.086684+0000","last_undegraded":"2023-12-13T22:55:57.086684+0000","last_fullsized":"2023-12-13T22:55:57.086684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.086433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:37.740171+0000","scrub_duration":0.0047689719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.878700+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:55:12.878700+0000","last_peered":"2023-12-13T22:55:12.878700+0000","last_clean":"2023-12-13T22:55:12.878700+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:55:12.878700+0000","last_undegraded":"2023-12-13T22:55:12.878700+0000","last_fullsized":"2023-12-13T22:55:12.878700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.130795+0000","last_change":"2023-12-13T22:56:04.130795+0000","last_active":"2023-12-13T22:56:04.130795+0000","last_peered":"2023-12-13T22:56:04.130795+0000","last_clean":"2023-12-13T22:56:04.130795+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:56:04.130795+0000","last_undegraded":"2023-12-13T22:56:04.130795+0000","last_fullsized":"2023-12-13T22:56:04.130795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'557","last_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_deep_scrub":"31'557","last_deep_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.130538+0000","objects_scrubbed":1,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:18.030140+0000","scrub_duration":0.017810682000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.384670+0000","last_change":"2023-12-13T22:55:53.384721+0000","last_active":"2023-12-13T22:55:53.384670+0000","last_peered":"2023-12-13T22:55:53.384670+0000","last_clean":"2023-12-13T22:55:53.384670+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:53.384670+0000","last_undegraded":"2023-12-13T22:55:53.384670+0000","last_fullsized":"2023-12-13T22:55:53.384670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.384483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:09.394000+0000","scrub_duration":0.0059998250000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.760349+0000","last_change":"2023-12-13T22:56:07.760404+0000","last_active":"2023-12-13T22:56:07.760349+0000","last_peered":"2023-12-13T22:56:07.760349+0000","last_clean":"2023-12-13T22:56:07.760349+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:56:07.760349+0000","last_undegraded":"2023-12-13T22:56:07.760349+0000","last_fullsized":"2023-12-13T22:56:07.760349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.760159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:54.961389+0000","scrub_duration":0.0082528020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'14","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.006531+0000","last_change":"2023-12-13T22:56:01.006646+0000","last_active":"2023-12-13T22:56:01.006531+0000","last_peered":"2023-12-13T22:56:01.006531+0000","last_clean":"2023-12-13T22:56:01.006531+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:56:01.006531+0000","last_undegraded":"2023-12-13T22:56:01.006531+0000","last_fullsized":"2023-12-13T22:56:01.006531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.006244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:30.213593+0000","scrub_duration":0.0084082649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.240266+0000","last_change":"2023-12-13T22:26:00.401277+0000","last_active":"2023-12-13T22:55:51.240266+0000","last_peered":"2023-12-13T22:55:51.240266+0000","last_clean":"2023-12-13T22:55:51.240266+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:55:51.240266+0000","last_undegraded":"2023-12-13T22:55:51.240266+0000","last_fullsized":"2023-12-13T22:55:51.240266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.773631+0000","last_change":"2023-12-13T22:56:11.773767+0000","last_active":"2023-12-13T22:56:11.773631+0000","last_peered":"2023-12-13T22:56:11.773631+0000","last_clean":"2023-12-13T22:56:11.773631+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:56:11.773631+0000","last_undegraded":"2023-12-13T22:56:11.773631+0000","last_fullsized":"2023-12-13T22:56:11.773631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.773409+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:10.025016+0000","scrub_duration":0.0070233229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.975345+0000","last_change":"2023-12-13T22:56:04.975403+0000","last_active":"2023-12-13T22:56:04.975345+0000","last_peered":"2023-12-13T22:56:04.975345+0000","last_clean":"2023-12-13T22:56:04.975345+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:56:04.975345+0000","last_undegraded":"2023-12-13T22:56:04.975345+0000","last_fullsized":"2023-12-13T22:56:04.975345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.975161+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:29.194959+0000","scrub_duration":0.005625924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.419817+0000","last_change":"2023-12-13T22:56:09.419869+0000","last_active":"2023-12-13T22:56:09.419817+0000","last_peered":"2023-12-13T22:56:09.419817+0000","last_clean":"2023-12-13T22:56:09.419817+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:56:09.419817+0000","last_undegraded":"2023-12-13T22:56:09.419817+0000","last_fullsized":"2023-12-13T22:56:09.419817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.419615+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:50.791071+0000","scrub_duration":0.0033404609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.746368+0000","last_change":"2023-12-13T22:56:05.746368+0000","last_active":"2023-12-13T22:56:05.746368+0000","last_peered":"2023-12-13T22:56:05.746368+0000","last_clean":"2023-12-13T22:56:05.746368+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:56:05.746368+0000","last_undegraded":"2023-12-13T22:56:05.746368+0000","last_fullsized":"2023-12-13T22:56:05.746368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'104","last_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_deep_scrub":"31'104","last_deep_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.746112+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:53.792152+0000","scrub_duration":0.0090762269999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624523+0000","last_change":"2023-12-13T22:26:00.395662+0000","last_active":"2023-12-13T22:55:35.624523+0000","last_peered":"2023-12-13T22:55:35.624523+0000","last_clean":"2023-12-13T22:55:35.624523+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:55:35.624523+0000","last_undegraded":"2023-12-13T22:55:35.624523+0000","last_fullsized":"2023-12-13T22:55:35.624523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'674","reported_seq":717,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.032320+0000","last_change":"2023-12-13T22:56:10.032381+0000","last_active":"2023-12-13T22:56:10.032320+0000","last_peered":"2023-12-13T22:56:10.032320+0000","last_clean":"2023-12-13T22:56:10.032320+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:56:10.032320+0000","last_undegraded":"2023-12-13T22:56:10.032320+0000","last_fullsized":"2023-12-13T22:56:10.032320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'674","last_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_deep_scrub":"31'674","last_deep_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.032136+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:02:10.233919+0000","scrub_duration":0.019140582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.679391+0000","last_change":"2023-12-13T22:26:05.946603+0000","last_active":"2023-12-13T22:55:22.679391+0000","last_peered":"2023-12-13T22:55:22.679391+0000","last_clean":"2023-12-13T22:55:22.679391+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:55:22.679391+0000","last_undegraded":"2023-12-13T22:55:22.679391+0000","last_fullsized":"2023-12-13T22:55:22.679391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.118429+0000","last_change":"2023-12-13T22:56:00.118478+0000","last_active":"2023-12-13T22:56:00.118429+0000","last_peered":"2023-12-13T22:56:00.118429+0000","last_clean":"2023-12-13T22:56:00.118429+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:56:00.118429+0000","last_undegraded":"2023-12-13T22:56:00.118429+0000","last_fullsized":"2023-12-13T22:56:00.118429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.118246+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:17:52.123696+0000","scrub_duration":0.003500979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'231","reported_seq":274,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.700981+0000","last_change":"2023-12-13T22:55:53.701006+0000","last_active":"2023-12-13T22:55:53.700981+0000","last_peered":"2023-12-13T22:55:53.700981+0000","last_clean":"2023-12-13T22:55:53.700981+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:53.700981+0000","last_undegraded":"2023-12-13T22:55:53.700981+0000","last_fullsized":"2023-12-13T22:55:53.700981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.700899+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:00.803310+0000","scrub_duration":0.0056378890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.679261+0000","last_change":"2023-12-13T22:26:05.937480+0000","last_active":"2023-12-13T22:55:22.679261+0000","last_peered":"2023-12-13T22:55:22.679261+0000","last_clean":"2023-12-13T22:55:22.679261+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:55:22.679261+0000","last_undegraded":"2023-12-13T22:55:22.679261+0000","last_fullsized":"2023-12-13T22:55:22.679261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.067931+0000","last_change":"2023-12-13T22:56:05.067985+0000","last_active":"2023-12-13T22:56:05.067931+0000","last_peered":"2023-12-13T22:56:05.067931+0000","last_clean":"2023-12-13T22:56:05.067931+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:56:05.067931+0000","last_undegraded":"2023-12-13T22:56:05.067931+0000","last_fullsized":"2023-12-13T22:56:05.067931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.067730+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:26.243855+0000","scrub_duration":0.0036404760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'167","reported_seq":210,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.826904+0000","last_change":"2023-12-13T22:56:02.826963+0000","last_active":"2023-12-13T22:56:02.826904+0000","last_peered":"2023-12-13T22:56:02.826904+0000","last_clean":"2023-12-13T22:56:02.826904+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:56:02.826904+0000","last_undegraded":"2023-12-13T22:56:02.826904+0000","last_fullsized":"2023-12-13T22:56:02.826904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.826714+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:46.888140+0000","scrub_duration":0.0074117790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.749290+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:55:32.749290+0000","last_peered":"2023-12-13T22:55:32.749290+0000","last_clean":"2023-12-13T22:55:32.749290+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:55:32.749290+0000","last_undegraded":"2023-12-13T22:55:32.749290+0000","last_fullsized":"2023-12-13T22:55:32.749290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.896339+0000","last_change":"2023-12-13T22:55:57.896395+0000","last_active":"2023-12-13T22:55:57.896339+0000","last_peered":"2023-12-13T22:55:57.896339+0000","last_clean":"2023-12-13T22:55:57.896339+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:57.896339+0000","last_undegraded":"2023-12-13T22:55:57.896339+0000","last_fullsized":"2023-12-13T22:55:57.896339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.896154+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:41.957580+0000","scrub_duration":0.0027243580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'5","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.011447+0000","last_change":"2023-12-13T22:55:58.011503+0000","last_active":"2023-12-13T22:55:58.011447+0000","last_peered":"2023-12-13T22:55:58.011447+0000","last_clean":"2023-12-13T22:55:58.011447+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:58.011447+0000","last_undegraded":"2023-12-13T22:55:58.011447+0000","last_fullsized":"2023-12-13T22:55:58.011447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.011259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:22.491272+0000","scrub_duration":0.0058936780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.776408+0000","last_change":"2023-12-13T22:56:09.776464+0000","last_active":"2023-12-13T22:56:09.776408+0000","last_peered":"2023-12-13T22:56:09.776408+0000","last_clean":"2023-12-13T22:56:09.776408+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:56:09.776408+0000","last_undegraded":"2023-12-13T22:56:09.776408+0000","last_fullsized":"2023-12-13T22:56:09.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.776205+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:27.344349+0000","scrub_duration":0.0082280419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.394548+0000","last_change":"2023-12-13T22:55:54.394605+0000","last_active":"2023-12-13T22:55:54.394548+0000","last_peered":"2023-12-13T22:55:54.394548+0000","last_clean":"2023-12-13T22:55:54.394548+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:54.394548+0000","last_undegraded":"2023-12-13T22:55:54.394548+0000","last_fullsized":"2023-12-13T22:55:54.394548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.394350+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:38:08.105528+0000","scrub_duration":0.0036387030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'11","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.233397+0000","last_change":"2023-12-13T22:55:54.233515+0000","last_active":"2023-12-13T22:55:54.233397+0000","last_peered":"2023-12-13T22:55:54.233397+0000","last_clean":"2023-12-13T22:55:54.233397+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:54.233397+0000","last_undegraded":"2023-12-13T22:55:54.233397+0000","last_fullsized":"2023-12-13T22:55:54.233397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.233177+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:03.688679+0000","scrub_duration":0.0080965169999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.677584+0000","last_change":"2023-12-13T22:26:06.554259+0000","last_active":"2023-12-13T22:55:17.677584+0000","last_peered":"2023-12-13T22:55:17.677584+0000","last_clean":"2023-12-13T22:55:17.677584+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:55:17.677584+0000","last_undegraded":"2023-12-13T22:55:17.677584+0000","last_fullsized":"2023-12-13T22:55:17.677584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.694793+0000","last_change":"2023-12-13T22:26:00.410030+0000","last_active":"2023-12-13T22:55:35.694793+0000","last_peered":"2023-12-13T22:55:35.694793+0000","last_clean":"2023-12-13T22:55:35.694793+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:55:35.694793+0000","last_undegraded":"2023-12-13T22:55:35.694793+0000","last_fullsized":"2023-12-13T22:55:35.694793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'188","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:34.786514+0000","last_change":"2023-12-13T22:25:57.862378+0000","last_active":"2023-12-13T22:55:34.786514+0000","last_peered":"2023-12-13T22:55:34.786514+0000","last_clean":"2023-12-13T22:55:34.786514+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:55:34.786514+0000","last_undegraded":"2023-12-13T22:55:34.786514+0000","last_fullsized":"2023-12-13T22:55:34.786514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:14.718761+0000","last_change":"2023-12-13T22:26:06.565524+0000","last_active":"2023-12-13T22:54:14.718761+0000","last_peered":"2023-12-13T22:54:14.718761+0000","last_clean":"2023-12-13T22:54:14.718761+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:54:14.718761+0000","last_undegraded":"2023-12-13T22:54:14.718761+0000","last_fullsized":"2023-12-13T22:54:14.718761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501792+0000","last_change":"2023-12-13T22:26:00.411897+0000","last_active":"2023-12-13T22:55:35.501792+0000","last_peered":"2023-12-13T22:55:35.501792+0000","last_clean":"2023-12-13T22:55:35.501792+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:55:35.501792+0000","last_undegraded":"2023-12-13T22:55:35.501792+0000","last_fullsized":"2023-12-13T22:55:35.501792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.953673+0000","last_change":"2023-12-13T22:56:03.953801+0000","last_active":"2023-12-13T22:56:03.953673+0000","last_peered":"2023-12-13T22:56:03.953673+0000","last_clean":"2023-12-13T22:56:03.953673+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:56:03.953673+0000","last_undegraded":"2023-12-13T22:56:03.953673+0000","last_fullsized":"2023-12-13T22:56:03.953673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.953362+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:55:24.663154+0000","scrub_duration":0.0065831049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:14.806416+0000","last_change":"2023-12-13T22:26:06.553544+0000","last_active":"2023-12-13T22:55:14.806416+0000","last_peered":"2023-12-13T22:55:14.806416+0000","last_clean":"2023-12-13T22:55:14.806416+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:55:14.806416+0000","last_undegraded":"2023-12-13T22:55:14.806416+0000","last_fullsized":"2023-12-13T22:55:14.806416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.427281+0000","last_change":"2023-12-13T22:56:07.427334+0000","last_active":"2023-12-13T22:56:07.427281+0000","last_peered":"2023-12-13T22:56:07.427281+0000","last_clean":"2023-12-13T22:56:07.427281+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:56:07.427281+0000","last_undegraded":"2023-12-13T22:56:07.427281+0000","last_fullsized":"2023-12-13T22:56:07.427281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.427084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:24.995228+0000","scrub_duration":0.0038031240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.882716+0000","last_change":"2023-12-13T22:56:11.882820+0000","last_active":"2023-12-13T22:56:11.882716+0000","last_peered":"2023-12-13T22:56:11.882716+0000","last_clean":"2023-12-13T22:56:11.882716+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:56:11.882716+0000","last_undegraded":"2023-12-13T22:56:11.882716+0000","last_fullsized":"2023-12-13T22:56:11.882716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.882492+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:59.928532+0000","scrub_duration":0.0034021170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:48.176410+0000","last_change":"2023-12-13T22:27:03.566251+0000","last_active":"2023-12-13T22:55:48.176410+0000","last_peered":"2023-12-13T22:55:48.176410+0000","last_clean":"2023-12-13T22:55:48.176410+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:55:48.176410+0000","last_undegraded":"2023-12-13T22:55:48.176410+0000","last_fullsized":"2023-12-13T22:55:48.176410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.985034+0000","last_change":"2023-12-13T22:55:52.985096+0000","last_active":"2023-12-13T22:55:52.985034+0000","last_peered":"2023-12-13T22:55:52.985034+0000","last_clean":"2023-12-13T22:55:52.985034+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:52.985034+0000","last_undegraded":"2023-12-13T22:55:52.985034+0000","last_fullsized":"2023-12-13T22:55:52.985034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.984842+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:22:25.512989+0000","scrub_duration":0.0033867749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.371704+0000","last_change":"2023-12-13T22:55:57.371756+0000","last_active":"2023-12-13T22:55:57.371704+0000","last_peered":"2023-12-13T22:55:57.371704+0000","last_clean":"2023-12-13T22:55:57.371704+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:57.371704+0000","last_undegraded":"2023-12-13T22:55:57.371704+0000","last_fullsized":"2023-12-13T22:55:57.371704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.371503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:29:53.556509+0000","scrub_duration":0.0029694280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.746486+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:55:17.746486+0000","last_peered":"2023-12-13T22:55:17.746486+0000","last_clean":"2023-12-13T22:55:17.746486+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:55:17.746486+0000","last_undegraded":"2023-12-13T22:55:17.746486+0000","last_fullsized":"2023-12-13T22:55:17.746486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.281298+0000","last_change":"2023-12-13T22:26:00.411787+0000","last_active":"2023-12-13T22:55:47.281298+0000","last_peered":"2023-12-13T22:55:47.281298+0000","last_clean":"2023-12-13T22:55:47.281298+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:55:47.281298+0000","last_undegraded":"2023-12-13T22:55:47.281298+0000","last_fullsized":"2023-12-13T22:55:47.281298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'253","reported_seq":450,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.928398+0000","last_change":"2023-12-13T22:55:54.928461+0000","last_active":"2023-12-13T22:55:54.928398+0000","last_peered":"2023-12-13T22:55:54.928398+0000","last_clean":"2023-12-13T22:55:54.928398+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:54.928398+0000","last_undegraded":"2023-12-13T22:55:54.928398+0000","last_fullsized":"2023-12-13T22:55:54.928398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'253","last_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_deep_scrub":"31'253","last_deep_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.928226+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:21:19.453012+0000","scrub_duration":0.0082018130000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":115,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:17.923670+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:54:17.923670+0000","last_peered":"2023-12-13T22:54:17.923670+0000","last_clean":"2023-12-13T22:54:17.923670+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:54:17.923670+0000","last_undegraded":"2023-12-13T22:54:17.923670+0000","last_fullsized":"2023-12-13T22:54:17.923670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.423054+0000","last_change":"2023-12-13T22:55:52.423106+0000","last_active":"2023-12-13T22:55:52.423054+0000","last_peered":"2023-12-13T22:55:52.423054+0000","last_clean":"2023-12-13T22:55:52.423054+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:52.423054+0000","last_undegraded":"2023-12-13T22:55:52.423054+0000","last_fullsized":"2023-12-13T22:55:52.423054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.422920+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:03:02.820205+0000","scrub_duration":0.0018780209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.989925+0000","last_change":"2023-12-13T22:55:58.989925+0000","last_active":"2023-12-13T22:55:58.989925+0000","last_peered":"2023-12-13T22:55:58.989925+0000","last_clean":"2023-12-13T22:55:58.989925+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:55:58.989925+0000","last_undegraded":"2023-12-13T22:55:58.989925+0000","last_fullsized":"2023-12-13T22:55:58.989925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.989650+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:05.695391+0000","scrub_duration":0.0073674609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.048818+0000","last_change":"2023-12-13T22:26:06.556394+0000","last_active":"2023-12-13T22:54:23.048818+0000","last_peered":"2023-12-13T22:54:23.048818+0000","last_clean":"2023-12-13T22:54:23.048818+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:54:23.048818+0000","last_undegraded":"2023-12-13T22:54:23.048818+0000","last_fullsized":"2023-12-13T22:54:23.048818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.698623+0000","last_change":"2023-12-13T22:26:00.403327+0000","last_active":"2023-12-13T22:55:35.698623+0000","last_peered":"2023-12-13T22:55:35.698623+0000","last_clean":"2023-12-13T22:55:35.698623+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:55:35.698623+0000","last_undegraded":"2023-12-13T22:55:35.698623+0000","last_fullsized":"2023-12-13T22:55:35.698623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.359601+0000","last_change":"2023-12-13T22:55:52.359631+0000","last_active":"2023-12-13T22:55:52.359601+0000","last_peered":"2023-12-13T22:55:52.359601+0000","last_clean":"2023-12-13T22:55:52.359601+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:52.359601+0000","last_undegraded":"2023-12-13T22:55:52.359601+0000","last_fullsized":"2023-12-13T22:55:52.359601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.359516+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:37.445461+0000","scrub_duration":0.0062306879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.936095+0000","last_change":"2023-12-13T22:55:54.936170+0000","last_active":"2023-12-13T22:55:54.936095+0000","last_peered":"2023-12-13T22:55:54.936095+0000","last_clean":"2023-12-13T22:55:54.936095+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:55:54.936095+0000","last_undegraded":"2023-12-13T22:55:54.936095+0000","last_fullsized":"2023-12-13T22:55:54.936095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.935901+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:40.021847+0000","scrub_duration":0.011317162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.599238+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:55:22.599238+0000","last_peered":"2023-12-13T22:55:22.599238+0000","last_clean":"2023-12-13T22:55:22.599238+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:55:22.599238+0000","last_undegraded":"2023-12-13T22:55:22.599238+0000","last_fullsized":"2023-12-13T22:55:22.599238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.629580+0000","last_change":"2023-12-13T22:26:00.419649+0000","last_active":"2023-12-13T22:55:35.629580+0000","last_peered":"2023-12-13T22:55:35.629580+0000","last_clean":"2023-12-13T22:55:35.629580+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:55:35.629580+0000","last_undegraded":"2023-12-13T22:55:35.629580+0000","last_fullsized":"2023-12-13T22:55:35.629580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.779403+0000","last_change":"2023-12-13T22:56:00.779462+0000","last_active":"2023-12-13T22:56:00.779403+0000","last_peered":"2023-12-13T22:56:00.779403+0000","last_clean":"2023-12-13T22:56:00.779403+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:56:00.779403+0000","last_undegraded":"2023-12-13T22:56:00.779403+0000","last_fullsized":"2023-12-13T22:56:00.779403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.779224+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:55:53.386922+0000","scrub_duration":0.0076204089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:19.997454+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:54:19.997454+0000","last_peered":"2023-12-13T22:54:19.997454+0000","last_clean":"2023-12-13T22:54:19.997454+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:54:19.997454+0000","last_undegraded":"2023-12-13T22:54:19.997454+0000","last_fullsized":"2023-12-13T22:54:19.997454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.366939+0000","last_change":"2023-12-13T22:55:51.367028+0000","last_active":"2023-12-13T22:55:51.366939+0000","last_peered":"2023-12-13T22:55:51.366939+0000","last_clean":"2023-12-13T22:55:51.366939+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:51.366939+0000","last_undegraded":"2023-12-13T22:55:51.366939+0000","last_fullsized":"2023-12-13T22:55:51.366939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.366729+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:41:58.469140+0000","scrub_duration":0.0033407179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.895758+0000","last_change":"2023-12-13T22:56:04.895812+0000","last_active":"2023-12-13T22:56:04.895758+0000","last_peered":"2023-12-13T22:56:04.895758+0000","last_clean":"2023-12-13T22:56:04.895758+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:56:04.895758+0000","last_undegraded":"2023-12-13T22:56:04.895758+0000","last_fullsized":"2023-12-13T22:56:04.895758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.895573+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:29.086931+0000","scrub_duration":0.0061804989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.434836+0000","last_change":"2023-12-13T22:56:09.434895+0000","last_active":"2023-12-13T22:56:09.434836+0000","last_peered":"2023-12-13T22:56:09.434836+0000","last_clean":"2023-12-13T22:56:09.434836+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:56:09.434836+0000","last_undegraded":"2023-12-13T22:56:09.434836+0000","last_fullsized":"2023-12-13T22:56:09.434836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.434626+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:11:58.367162+0000","scrub_duration":0.0066969239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543919+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.543919+0000","last_peered":"2023-12-13T22:55:35.543919+0000","last_clean":"2023-12-13T22:55:35.543919+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.543919+0000","last_undegraded":"2023-12-13T22:55:35.543919+0000","last_fullsized":"2023-12-13T22:55:35.543919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'5","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.901897+0000","last_change":"2023-12-13T22:55:51.901953+0000","last_active":"2023-12-13T22:55:51.901897+0000","last_peered":"2023-12-13T22:55:51.901897+0000","last_clean":"2023-12-13T22:55:51.901897+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:55:51.901897+0000","last_undegraded":"2023-12-13T22:55:51.901897+0000","last_fullsized":"2023-12-13T22:55:51.901897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.901720+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:54:32.031652+0000","scrub_duration":0.0054560959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.404683+0000","last_change":"2023-12-13T22:26:06.545663+0000","last_active":"2023-12-13T22:54:24.404683+0000","last_peered":"2023-12-13T22:54:24.404683+0000","last_clean":"2023-12-13T22:54:24.404683+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:54:24.404683+0000","last_undegraded":"2023-12-13T22:54:24.404683+0000","last_fullsized":"2023-12-13T22:54:24.404683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503670+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:35.503670+0000","last_peered":"2023-12-13T22:55:35.503670+0000","last_clean":"2023-12-13T22:55:35.503670+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:35.503670+0000","last_undegraded":"2023-12-13T22:55:35.503670+0000","last_fullsized":"2023-12-13T22:55:35.503670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'265","reported_seq":308,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.957704+0000","last_change":"2023-12-13T22:55:50.957847+0000","last_active":"2023-12-13T22:55:50.957704+0000","last_peered":"2023-12-13T22:55:50.957704+0000","last_clean":"2023-12-13T22:55:50.957704+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:50.957704+0000","last_undegraded":"2023-12-13T22:55:50.957704+0000","last_fullsized":"2023-12-13T22:55:50.957704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'265","last_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_deep_scrub":"31'265","last_deep_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.957478+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:05:25.538846+0000","scrub_duration":0.01053072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:19.995909+0000","last_change":"2023-12-13T22:26:05.937598+0000","last_active":"2023-12-13T22:54:19.995909+0000","last_peered":"2023-12-13T22:54:19.995909+0000","last_clean":"2023-12-13T22:54:19.995909+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:54:19.995909+0000","last_undegraded":"2023-12-13T22:54:19.995909+0000","last_fullsized":"2023-12-13T22:54:19.995909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.912609+0000","last_change":"2023-12-13T22:55:53.912661+0000","last_active":"2023-12-13T22:55:53.912609+0000","last_peered":"2023-12-13T22:55:53.912609+0000","last_clean":"2023-12-13T22:55:53.912609+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:53.912609+0000","last_undegraded":"2023-12-13T22:55:53.912609+0000","last_fullsized":"2023-12-13T22:55:53.912609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.912416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:01.014828+0000","scrub_duration":0.002904542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'268","reported_seq":310,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.722589+0000","last_change":"2023-12-13T22:56:02.722659+0000","last_active":"2023-12-13T22:56:02.722589+0000","last_peered":"2023-12-13T22:56:02.722589+0000","last_clean":"2023-12-13T22:56:02.722589+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:56:02.722589+0000","last_undegraded":"2023-12-13T22:56:02.722589+0000","last_fullsized":"2023-12-13T22:56:02.722589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'268","last_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_deep_scrub":"31'268","last_deep_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.722401+0000","objects_scrubbed":8,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:57:04.531070+0000","scrub_duration":0.015955368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:04.804479+0000","last_change":"2023-12-13T22:26:05.936916+0000","last_active":"2023-12-13T22:55:04.804479+0000","last_peered":"2023-12-13T22:55:04.804479+0000","last_clean":"2023-12-13T22:55:04.804479+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:55:04.804479+0000","last_undegraded":"2023-12-13T22:55:04.804479+0000","last_fullsized":"2023-12-13T22:55:04.804479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.614629+0000","last_change":"2023-12-13T22:26:00.376063+0000","last_active":"2023-12-13T22:55:35.614629+0000","last_peered":"2023-12-13T22:55:35.614629+0000","last_clean":"2023-12-13T22:55:35.614629+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:55:35.614629+0000","last_undegraded":"2023-12-13T22:55:35.614629+0000","last_fullsized":"2023-12-13T22:55:35.614629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1021","reported_seq":1063,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.174084+0000","last_change":"2023-12-13T22:56:06.174135+0000","last_active":"2023-12-13T22:56:06.174084+0000","last_peered":"2023-12-13T22:56:06.174084+0000","last_clean":"2023-12-13T22:56:06.174084+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:56:06.174084+0000","last_undegraded":"2023-12-13T22:56:06.174084+0000","last_fullsized":"2023-12-13T22:56:06.174084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1021","last_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_deep_scrub":"31'1021","last_deep_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.173900+0000","objects_scrubbed":2,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:30.653912+0000","scrub_duration":0.027900313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:07.877831+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:55:07.877831+0000","last_peered":"2023-12-13T22:55:07.877831+0000","last_clean":"2023-12-13T22:55:07.877831+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:55:07.877831+0000","last_undegraded":"2023-12-13T22:55:07.877831+0000","last_fullsized":"2023-12-13T22:55:07.877831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.546086+0000","last_change":"2023-12-13T22:26:00.418830+0000","last_active":"2023-12-13T22:55:35.546086+0000","last_peered":"2023-12-13T22:55:35.546086+0000","last_clean":"2023-12-13T22:55:35.546086+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:55:35.546086+0000","last_undegraded":"2023-12-13T22:55:35.546086+0000","last_fullsized":"2023-12-13T22:55:35.546086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.398697+0000","last_change":"2023-12-13T22:55:55.398798+0000","last_active":"2023-12-13T22:55:55.398697+0000","last_peered":"2023-12-13T22:55:55.398697+0000","last_clean":"2023-12-13T22:55:55.398697+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:55.398697+0000","last_undegraded":"2023-12-13T22:55:55.398697+0000","last_fullsized":"2023-12-13T22:55:55.398697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.398473+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:02.104213+0000","scrub_duration":0.0061603880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.390781+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.390781+0000","last_peered":"2023-12-13T22:54:24.390781+0000","last_clean":"2023-12-13T22:54:24.390781+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.390781+0000","last_undegraded":"2023-12-13T22:54:24.390781+0000","last_fullsized":"2023-12-13T22:54:24.390781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.361618+0000","last_change":"2023-12-13T22:55:58.361680+0000","last_active":"2023-12-13T22:55:58.361618+0000","last_peered":"2023-12-13T22:55:58.361618+0000","last_clean":"2023-12-13T22:55:58.361618+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:58.361618+0000","last_undegraded":"2023-12-13T22:55:58.361618+0000","last_fullsized":"2023-12-13T22:55:58.361618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.361421+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:57:39.970158+0000","scrub_duration":0.003149827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'12","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.403222+0000","last_change":"2023-12-13T22:55:49.403251+0000","last_active":"2023-12-13T22:55:49.403222+0000","last_peered":"2023-12-13T22:55:49.403222+0000","last_clean":"2023-12-13T22:55:49.403222+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:55:49.403222+0000","last_undegraded":"2023-12-13T22:55:49.403222+0000","last_fullsized":"2023-12-13T22:55:49.403222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_clean_scrub_stamp":"2023-12-13T22:55:49.403136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:06:21.586077+0000","scrub_duration":0.0076955030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":106,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:08.064220+0000","last_change":"2023-12-13T22:26:06.551439+0000","last_active":"2023-12-13T22:55:08.064220+0000","last_peered":"2023-12-13T22:55:08.064220+0000","last_clean":"2023-12-13T22:55:08.064220+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:55:08.064220+0000","last_undegraded":"2023-12-13T22:55:08.064220+0000","last_fullsized":"2023-12-13T22:55:08.064220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.545286+0000","last_change":"2023-12-13T22:26:00.412628+0000","last_active":"2023-12-13T22:55:35.545286+0000","last_peered":"2023-12-13T22:55:35.545286+0000","last_clean":"2023-12-13T22:55:35.545286+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:55:35.545286+0000","last_undegraded":"2023-12-13T22:55:35.545286+0000","last_fullsized":"2023-12-13T22:55:35.545286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1187","reported_seq":1229,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.224732+0000","last_change":"2023-12-13T22:55:53.224878+0000","last_active":"2023-12-13T22:55:53.224732+0000","last_peered":"2023-12-13T22:55:53.224732+0000","last_clean":"2023-12-13T22:55:53.224732+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:53.224732+0000","last_undegraded":"2023-12-13T22:55:53.224732+0000","last_fullsized":"2023-12-13T22:55:53.224732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1187","last_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_deep_scrub":"31'1187","last_deep_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.224528+0000","objects_scrubbed":5,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:15:59.076548+0000","scrub_duration":0.029787111000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.391265+0000","last_change":"2023-12-13T22:26:05.938808+0000","last_active":"2023-12-13T22:54:24.391265+0000","last_peered":"2023-12-13T22:54:24.391265+0000","last_clean":"2023-12-13T22:54:24.391265+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:54:24.391265+0000","last_undegraded":"2023-12-13T22:54:24.391265+0000","last_fullsized":"2023-12-13T22:54:24.391265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:56.934016+0000","last_change":"2023-12-13T22:55:56.934053+0000","last_active":"2023-12-13T22:55:56.934016+0000","last_peered":"2023-12-13T22:55:56.934016+0000","last_clean":"2023-12-13T22:55:56.934016+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:56.934016+0000","last_undegraded":"2023-12-13T22:55:56.934016+0000","last_fullsized":"2023-12-13T22:55:56.934016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_clean_scrub_stamp":"2023-12-13T22:55:56.933891+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:27:43.656236+0000","scrub_duration":0.002368658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'130","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.782407+0000","last_change":"2023-12-13T22:55:59.782469+0000","last_active":"2023-12-13T22:55:59.782407+0000","last_peered":"2023-12-13T22:55:59.782407+0000","last_clean":"2023-12-13T22:55:59.782407+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:59.782407+0000","last_undegraded":"2023-12-13T22:55:59.782407+0000","last_fullsized":"2023-12-13T22:55:59.782407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'130","last_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_deep_scrub":"31'130","last_deep_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.782224+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:14.537967+0000","scrub_duration":0.0092044889999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.752022+0000","last_change":"2023-12-13T22:56:06.752082+0000","last_active":"2023-12-13T22:56:06.752022+0000","last_peered":"2023-12-13T22:56:06.752022+0000","last_clean":"2023-12-13T22:56:06.752022+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:56:06.752022+0000","last_undegraded":"2023-12-13T22:56:06.752022+0000","last_fullsized":"2023-12-13T22:56:06.752022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.751811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:52.144373+0000","scrub_duration":0.0073970829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.446914+0000","last_change":"2023-12-13T22:56:07.446965+0000","last_active":"2023-12-13T22:56:07.446914+0000","last_peered":"2023-12-13T22:56:07.446914+0000","last_clean":"2023-12-13T22:56:07.446914+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:56:07.446914+0000","last_undegraded":"2023-12-13T22:56:07.446914+0000","last_fullsized":"2023-12-13T22:56:07.446914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.446725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:18:14.638863+0000","scrub_duration":0.0036426369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.377308+0000","last_change":"2023-12-13T22:55:53.377429+0000","last_active":"2023-12-13T22:55:53.377308+0000","last_peered":"2023-12-13T22:55:53.377308+0000","last_clean":"2023-12-13T22:55:53.377308+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:53.377308+0000","last_undegraded":"2023-12-13T22:55:53.377308+0000","last_fullsized":"2023-12-13T22:55:53.377308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.377020+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:08.132763+0000","scrub_duration":0.0054373049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.331139+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:54:24.331139+0000","last_peered":"2023-12-13T22:54:24.331139+0000","last_clean":"2023-12-13T22:54:24.331139+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:54:24.331139+0000","last_undegraded":"2023-12-13T22:54:24.331139+0000","last_fullsized":"2023-12-13T22:54:24.331139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.471767+0000","last_change":"2023-12-13T22:56:06.471822+0000","last_active":"2023-12-13T22:56:06.471767+0000","last_peered":"2023-12-13T22:56:06.471767+0000","last_clean":"2023-12-13T22:56:06.471767+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:56:06.471767+0000","last_undegraded":"2023-12-13T22:56:06.471767+0000","last_fullsized":"2023-12-13T22:56:06.471767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.471493+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:53.672723+0000","scrub_duration":0.0040682790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'92","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.175160+0000","last_change":"2023-12-13T22:56:11.175209+0000","last_active":"2023-12-13T22:56:11.175160+0000","last_peered":"2023-12-13T22:56:11.175160+0000","last_clean":"2023-12-13T22:56:11.175160+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:56:11.175160+0000","last_undegraded":"2023-12-13T22:56:11.175160+0000","last_fullsized":"2023-12-13T22:56:11.175160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'92","last_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_deep_scrub":"31'92","last_deep_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.175043+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:40.382392+0000","scrub_duration":0.0069995819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:23.062331+0000","last_change":"2023-12-13T22:26:06.554387+0000","last_active":"2023-12-13T22:54:23.062331+0000","last_peered":"2023-12-13T22:54:23.062331+0000","last_clean":"2023-12-13T22:54:23.062331+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:54:23.062331+0000","last_undegraded":"2023-12-13T22:54:23.062331+0000","last_fullsized":"2023-12-13T22:54:23.062331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.299429+0000","last_change":"2023-12-13T22:26:06.554871+0000","last_active":"2023-12-13T22:55:46.299429+0000","last_peered":"2023-12-13T22:55:46.299429+0000","last_clean":"2023-12-13T22:55:46.299429+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:55:46.299429+0000","last_undegraded":"2023-12-13T22:55:46.299429+0000","last_fullsized":"2023-12-13T22:55:46.299429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.617154+0000","last_change":"2023-12-13T22:55:47.617203+0000","last_active":"2023-12-13T22:55:47.617154+0000","last_peered":"2023-12-13T22:55:47.617154+0000","last_clean":"2023-12-13T22:55:47.617154+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:47.617154+0000","last_undegraded":"2023-12-13T22:55:47.617154+0000","last_fullsized":"2023-12-13T22:55:47.617154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_clean_scrub_stamp":"2023-12-13T22:55:47.617039+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:57.072541+0000","scrub_duration":0.0027396679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.453354+0000","last_change":"2023-12-13T22:56:01.453406+0000","last_active":"2023-12-13T22:56:01.453354+0000","last_peered":"2023-12-13T22:56:01.453354+0000","last_clean":"2023-12-13T22:56:01.453354+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:56:01.453354+0000","last_undegraded":"2023-12-13T22:56:01.453354+0000","last_fullsized":"2023-12-13T22:56:01.453354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.453158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:13.446611+0000","scrub_duration":0.0027122370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.598315+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:55:17.598315+0000","last_peered":"2023-12-13T22:55:17.598315+0000","last_clean":"2023-12-13T22:55:17.598315+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:55:17.598315+0000","last_undegraded":"2023-12-13T22:55:17.598315+0000","last_fullsized":"2023-12-13T22:55:17.598315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.695642+0000","last_change":"2023-12-13T22:26:00.394347+0000","last_active":"2023-12-13T22:55:35.695642+0000","last_peered":"2023-12-13T22:55:35.695642+0000","last_clean":"2023-12-13T22:55:35.695642+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:55:35.695642+0000","last_undegraded":"2023-12-13T22:55:35.695642+0000","last_fullsized":"2023-12-13T22:55:35.695642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'211","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.108706+0000","last_change":"2023-12-13T22:56:02.108772+0000","last_active":"2023-12-13T22:56:02.108706+0000","last_peered":"2023-12-13T22:56:02.108706+0000","last_clean":"2023-12-13T22:56:02.108706+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:56:02.108706+0000","last_undegraded":"2023-12-13T22:56:02.108706+0000","last_fullsized":"2023-12-13T22:56:02.108706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.108492+0000","objects_scrubbed":2,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:43.479948+0000","scrub_duration":0.0095572120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'305","reported_seq":635,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.142440+0000","last_change":"2023-12-13T22:25:57.850008+0000","last_active":"2023-12-13T22:55:52.142440+0000","last_peered":"2023-12-13T22:55:52.142440+0000","last_clean":"2023-12-13T22:55:52.142440+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:55:52.142440+0000","last_undegraded":"2023-12-13T22:55:52.142440+0000","last_fullsized":"2023-12-13T22:55:52.142440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:56.191268+0000","last_clean_scrub_stamp":"2023-12-13T22:25:56.191268+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.377972+0000","last_change":"2023-12-13T22:55:51.377972+0000","last_active":"2023-12-13T22:55:51.377972+0000","last_peered":"2023-12-13T22:55:51.377972+0000","last_clean":"2023-12-13T22:55:51.377972+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:51.377972+0000","last_undegraded":"2023-12-13T22:55:51.377972+0000","last_fullsized":"2023-12-13T22:55:51.377972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.377829+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:25:56.812795+0000","scrub_duration":0.002123673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:48.176402+0000","last_change":"2023-12-13T22:26:05.940711+0000","last_active":"2023-12-13T22:55:48.176402+0000","last_peered":"2023-12-13T22:55:48.176402+0000","last_clean":"2023-12-13T22:55:48.176402+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:55:48.176402+0000","last_undegraded":"2023-12-13T22:55:48.176402+0000","last_fullsized":"2023-12-13T22:55:48.176402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2405","reported_seq":2447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.130328+0000","last_change":"2023-12-13T22:56:01.130400+0000","last_active":"2023-12-13T22:56:01.130328+0000","last_peered":"2023-12-13T22:56:01.130328+0000","last_clean":"2023-12-13T22:56:01.130328+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:56:01.130328+0000","last_undegraded":"2023-12-13T22:56:01.130328+0000","last_fullsized":"2023-12-13T22:56:01.130328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2405","last_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_deep_scrub":"31'2405","last_deep_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.130136+0000","objects_scrubbed":4,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:22:59.381743+0000","scrub_duration":0.058223199000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.925504+0000","last_change":"2023-12-13T22:55:55.925504+0000","last_active":"2023-12-13T22:55:55.925504+0000","last_peered":"2023-12-13T22:55:55.925504+0000","last_clean":"2023-12-13T22:55:55.925504+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:55.925504+0000","last_undegraded":"2023-12-13T22:55:55.925504+0000","last_fullsized":"2023-12-13T22:55:55.925504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.925325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:05.665814+0000","scrub_duration":0.003351882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.263701+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:55:49.263701+0000","last_peered":"2023-12-13T22:55:49.263701+0000","last_clean":"2023-12-13T22:55:49.263701+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:55:49.263701+0000","last_undegraded":"2023-12-13T22:55:49.263701+0000","last_fullsized":"2023-12-13T22:55:49.263701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624606+0000","last_change":"2023-12-13T22:26:00.375434+0000","last_active":"2023-12-13T22:55:35.624606+0000","last_peered":"2023-12-13T22:55:35.624606+0000","last_clean":"2023-12-13T22:55:35.624606+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:55:35.624606+0000","last_undegraded":"2023-12-13T22:55:35.624606+0000","last_fullsized":"2023-12-13T22:55:35.624606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.686736+0000","last_change":"2023-12-13T22:56:06.686792+0000","last_active":"2023-12-13T22:56:06.686736+0000","last_peered":"2023-12-13T22:56:06.686736+0000","last_clean":"2023-12-13T22:56:06.686736+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:56:06.686736+0000","last_undegraded":"2023-12-13T22:56:06.686736+0000","last_fullsized":"2023-12-13T22:56:06.686736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.686540+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:12.538560+0000","scrub_duration":0.0033057130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631151+0000","last_change":"2023-12-13T22:26:00.417333+0000","last_active":"2023-12-13T22:55:35.631151+0000","last_peered":"2023-12-13T22:55:35.631151+0000","last_clean":"2023-12-13T22:55:35.631151+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:55:35.631151+0000","last_undegraded":"2023-12-13T22:55:35.631151+0000","last_fullsized":"2023-12-13T22:55:35.631151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.371452+0000","last_change":"2023-12-13T22:56:05.371573+0000","last_active":"2023-12-13T22:56:05.371452+0000","last_peered":"2023-12-13T22:56:05.371452+0000","last_clean":"2023-12-13T22:56:05.371452+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:56:05.371452+0000","last_undegraded":"2023-12-13T22:56:05.371452+0000","last_fullsized":"2023-12-13T22:56:05.371452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.371135+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:26:38.933074+0000","scrub_duration":0.003783182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.973766+0000","last_change":"2023-12-13T22:55:51.973818+0000","last_active":"2023-12-13T22:55:51.973766+0000","last_peered":"2023-12-13T22:55:51.973766+0000","last_clean":"2023-12-13T22:55:51.973766+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:51.973766+0000","last_undegraded":"2023-12-13T22:55:51.973766+0000","last_fullsized":"2023-12-13T22:55:51.973766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.973584+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:03.967036+0000","scrub_duration":0.0031747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.501639+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:35.501639+0000","last_peered":"2023-12-13T22:55:35.501639+0000","last_clean":"2023-12-13T22:55:35.501639+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:35.501639+0000","last_undegraded":"2023-12-13T22:55:35.501639+0000","last_fullsized":"2023-12-13T22:55:35.501639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631179+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:35.631179+0000","last_peered":"2023-12-13T22:55:35.631179+0000","last_clean":"2023-12-13T22:55:35.631179+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:35.631179+0000","last_undegraded":"2023-12-13T22:55:35.631179+0000","last_fullsized":"2023-12-13T22:55:35.631179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.094622+0000","last_change":"2023-12-13T22:55:59.094675+0000","last_active":"2023-12-13T22:55:59.094622+0000","last_peered":"2023-12-13T22:55:59.094622+0000","last_clean":"2023-12-13T22:55:59.094622+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:59.094622+0000","last_undegraded":"2023-12-13T22:55:59.094622+0000","last_fullsized":"2023-12-13T22:55:59.094622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.094434+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:46.295665+0000","scrub_duration":0.004669416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.444683+0000","last_change":"2023-12-13T22:56:03.444743+0000","last_active":"2023-12-13T22:56:03.444683+0000","last_peered":"2023-12-13T22:56:03.444683+0000","last_clean":"2023-12-13T22:56:03.444683+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:56:03.444683+0000","last_undegraded":"2023-12-13T22:56:03.444683+0000","last_fullsized":"2023-12-13T22:56:03.444683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.444479+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:27.664278+0000","scrub_duration":0.0038001070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.060063+0000","last_change":"2023-12-13T22:56:12.060115+0000","last_active":"2023-12-13T22:56:12.060063+0000","last_peered":"2023-12-13T22:56:12.060063+0000","last_clean":"2023-12-13T22:56:12.060063+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:12.060063+0000","last_undegraded":"2023-12-13T22:56:12.060063+0000","last_fullsized":"2023-12-13T22:56:12.060063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.059861+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:58.603714+0000","scrub_duration":0.0032058569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631226+0000","last_change":"2023-12-13T22:26:00.417023+0000","last_active":"2023-12-13T22:55:35.631226+0000","last_peered":"2023-12-13T22:55:35.631226+0000","last_clean":"2023-12-13T22:55:35.631226+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:55:35.631226+0000","last_undegraded":"2023-12-13T22:55:35.631226+0000","last_fullsized":"2023-12-13T22:55:35.631226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.419542+0000","last_change":"2023-12-13T22:56:08.419598+0000","last_active":"2023-12-13T22:56:08.419542+0000","last_peered":"2023-12-13T22:56:08.419542+0000","last_clean":"2023-12-13T22:56:08.419542+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:56:08.419542+0000","last_undegraded":"2023-12-13T22:56:08.419542+0000","last_fullsized":"2023-12-13T22:56:08.419542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.419342+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:30:31.998132+0000","scrub_duration":0.0036186209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.624448+0000","last_change":"2023-12-13T22:26:00.399964+0000","last_active":"2023-12-13T22:55:35.624448+0000","last_peered":"2023-12-13T22:55:35.624448+0000","last_clean":"2023-12-13T22:55:35.624448+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:55:35.624448+0000","last_undegraded":"2023-12-13T22:55:35.624448+0000","last_fullsized":"2023-12-13T22:55:35.624448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.547080+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.547080+0000","last_peered":"2023-12-13T22:55:35.547080+0000","last_clean":"2023-12-13T22:55:35.547080+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.547080+0000","last_undegraded":"2023-12-13T22:55:35.547080+0000","last_fullsized":"2023-12-13T22:55:35.547080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.714429+0000","last_change":"2023-12-13T22:56:05.714541+0000","last_active":"2023-12-13T22:56:05.714429+0000","last_peered":"2023-12-13T22:56:05.714429+0000","last_clean":"2023-12-13T22:56:05.714429+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:56:05.714429+0000","last_undegraded":"2023-12-13T22:56:05.714429+0000","last_fullsized":"2023-12-13T22:56:05.714429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.714201+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:34:46.397683+0000","scrub_duration":0.0032594479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.759084+0000","last_change":"2023-12-13T22:27:03.509440+0000","last_active":"2023-12-13T22:55:35.759084+0000","last_peered":"2023-12-13T22:55:35.759084+0000","last_clean":"2023-12-13T22:55:35.759084+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:55:35.759084+0000","last_undegraded":"2023-12-13T22:55:35.759084+0000","last_fullsized":"2023-12-13T22:55:35.759084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.447782+0000","last_change":"2023-12-13T22:56:04.447837+0000","last_active":"2023-12-13T22:56:04.447782+0000","last_peered":"2023-12-13T22:56:04.447782+0000","last_clean":"2023-12-13T22:56:04.447782+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:56:04.447782+0000","last_undegraded":"2023-12-13T22:56:04.447782+0000","last_fullsized":"2023-12-13T22:56:04.447782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.447580+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:45.101318+0000","scrub_duration":0.0029573310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.502195+0000","last_change":"2023-12-13T22:26:00.416648+0000","last_active":"2023-12-13T22:55:35.502195+0000","last_peered":"2023-12-13T22:55:35.502195+0000","last_clean":"2023-12-13T22:55:35.502195+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:55:35.502195+0000","last_undegraded":"2023-12-13T22:55:35.502195+0000","last_fullsized":"2023-12-13T22:55:35.502195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.425461+0000","last_change":"2023-12-13T22:55:46.425498+0000","last_active":"2023-12-13T22:55:46.425461+0000","last_peered":"2023-12-13T22:55:46.425461+0000","last_clean":"2023-12-13T22:55:46.425461+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:46.425461+0000","last_undegraded":"2023-12-13T22:55:46.425461+0000","last_fullsized":"2023-12-13T22:55:46.425461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_clean_scrub_stamp":"2023-12-13T22:55:46.425334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:25:04.502584+0000","scrub_duration":0.0031700270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.045257+0000","last_change":"2023-12-13T22:55:55.045309+0000","last_active":"2023-12-13T22:55:55.045257+0000","last_peered":"2023-12-13T22:55:55.045257+0000","last_clean":"2023-12-13T22:55:55.045257+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:55.045257+0000","last_undegraded":"2023-12-13T22:55:55.045257+0000","last_fullsized":"2023-12-13T22:55:55.045257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.045057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:19.264855+0000","scrub_duration":0.0059794330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.814231+0000","last_change":"2023-12-13T22:56:00.814334+0000","last_active":"2023-12-13T22:56:00.814231+0000","last_peered":"2023-12-13T22:56:00.814231+0000","last_clean":"2023-12-13T22:56:00.814231+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:56:00.814231+0000","last_undegraded":"2023-12-13T22:56:00.814231+0000","last_fullsized":"2023-12-13T22:56:00.814231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.814016+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:25.005375+0000","scrub_duration":0.0031933970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.635546+0000","last_change":"2023-12-13T22:26:00.396221+0000","last_active":"2023-12-13T22:55:35.635546+0000","last_peered":"2023-12-13T22:55:35.635546+0000","last_clean":"2023-12-13T22:55:35.635546+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:55:35.635546+0000","last_undegraded":"2023-12-13T22:55:35.635546+0000","last_fullsized":"2023-12-13T22:55:35.635546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631639+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631639+0000","last_peered":"2023-12-13T22:55:35.631639+0000","last_clean":"2023-12-13T22:55:35.631639+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631639+0000","last_undegraded":"2023-12-13T22:55:35.631639+0000","last_fullsized":"2023-12-13T22:55:35.631639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580745+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580745+0000","last_peered":"2023-12-13T22:55:35.580745+0000","last_clean":"2023-12-13T22:55:35.580745+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580745+0000","last_undegraded":"2023-12-13T22:55:35.580745+0000","last_fullsized":"2023-12-13T22:55:35.580745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.263839+0000","last_change":"2023-12-13T22:26:00.398657+0000","last_active":"2023-12-13T22:55:49.263839+0000","last_peered":"2023-12-13T22:55:49.263839+0000","last_clean":"2023-12-13T22:55:49.263839+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:55:49.263839+0000","last_undegraded":"2023-12-13T22:55:49.263839+0000","last_fullsized":"2023-12-13T22:55:49.263839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.016553+0000","last_change":"2023-12-13T22:26:00.410131+0000","last_active":"2023-12-13T22:55:53.016553+0000","last_peered":"2023-12-13T22:55:53.016553+0000","last_clean":"2023-12-13T22:55:53.016553+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:55:53.016553+0000","last_undegraded":"2023-12-13T22:55:53.016553+0000","last_fullsized":"2023-12-13T22:55:53.016553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.760647+0000","last_change":"2023-12-13T22:27:03.070128+0000","last_active":"2023-12-13T22:55:35.760647+0000","last_peered":"2023-12-13T22:55:35.760647+0000","last_clean":"2023-12-13T22:55:35.760647+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:55:35.760647+0000","last_undegraded":"2023-12-13T22:55:35.760647+0000","last_fullsized":"2023-12-13T22:55:35.760647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.016669+0000","last_change":"2023-12-13T22:26:00.407517+0000","last_active":"2023-12-13T22:55:53.016669+0000","last_peered":"2023-12-13T22:55:53.016669+0000","last_clean":"2023-12-13T22:55:53.016669+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:55:53.016669+0000","last_undegraded":"2023-12-13T22:55:53.016669+0000","last_fullsized":"2023-12-13T22:55:53.016669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.390246+0000","last_change":"2023-12-13T22:56:08.390301+0000","last_active":"2023-12-13T22:56:08.390246+0000","last_peered":"2023-12-13T22:56:08.390246+0000","last_clean":"2023-12-13T22:56:08.390246+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:56:08.390246+0000","last_undegraded":"2023-12-13T22:56:08.390246+0000","last_fullsized":"2023-12-13T22:56:08.390246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.390048+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:06.641655+0000","scrub_duration":0.0035378689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.329893+0000","last_change":"2023-12-13T22:56:00.329949+0000","last_active":"2023-12-13T22:56:00.329893+0000","last_peered":"2023-12-13T22:56:00.329893+0000","last_clean":"2023-12-13T22:56:00.329893+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:56:00.329893+0000","last_undegraded":"2023-12-13T22:56:00.329893+0000","last_fullsized":"2023-12-13T22:56:00.329893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.329685+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:23:06.433638+0000","scrub_duration":0.003895417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.503600+0000","last_change":"2023-12-13T22:26:00.410283+0000","last_active":"2023-12-13T22:55:35.503600+0000","last_peered":"2023-12-13T22:55:35.503600+0000","last_clean":"2023-12-13T22:55:35.503600+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:55:35.503600+0000","last_undegraded":"2023-12-13T22:55:35.503600+0000","last_fullsized":"2023-12-13T22:55:35.503600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539073+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.539073+0000","last_peered":"2023-12-13T22:55:35.539073+0000","last_clean":"2023-12-13T22:55:35.539073+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.539073+0000","last_undegraded":"2023-12-13T22:55:35.539073+0000","last_fullsized":"2023-12-13T22:55:35.539073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8090,"ondisk_log_size":8090,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477113,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.38100000000000001},"max":{"1min":1.3180000000000001,"5min":1.73,"15min":1.7689999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.65100000000000002,"5min":0.55900000000000005,"15min":0.41099999999999998},"max":{"1min":1.381,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.3149999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.628,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.2350000000000001,"5min":2.165,"15min":2.165},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.022,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.63300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.369,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.97299999999999998,"15min":0.97699999999999998},"min":{"1min":0.66000000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.361,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0269999999999999,"15min":1.0309999999999999},"min":{"1min":0.68600000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.383,"5min":1.649,"15min":2.1269999999999998},"last":1.423}]},{"osd":3,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.95899999999999996,"15min":0.97999999999999998},"min":{"1min":0.76700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.266,"5min":1.792,"15min":1.792},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0069999999999999,"15min":1.032},"min":{"1min":0.74299999999999999,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.3700000000000001,"5min":1.496,"15min":2.996},"last":1.044}]},{"osd":4,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.6819999999999999,"5min":1.847,"15min":1.8480000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.0860000000000001},"min":{"1min":0.72699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.8120000000000001},"last":1.228}]},{"osd":5,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0189999999999999,"15min":1.04},"min":{"1min":0.68100000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6339999999999999,"15min":2.21},"last":1.575},{"interface":"front","average":{"1min":1.159,"5min":1.111,"15min":1.107},"min":{"1min":0.625,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.591,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.5089999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:31 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.145,"15min":1.143},"min":{"1min":0.77100000000000002,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.506,"5min":2.056,"15min":2.0590000000000002},"last":1.617},{"interface":"front","average":{"1min":1.167,"5min":1.133,"15min":1.129},"min":{"1min":0.60599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.73,"5min":1.798,"15min":2.169},"last":1.365}]}]},{"osd":6,"up_from":16,"seq":68719477113,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.93600000000000005,"15min":0.95399999999999996},"min":{"1min":0.67400000000000004,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.272,"5min":1.575,"15min":2.1970000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.60499999999999998,"5min":0.433,"15min":0.433},"max":{"1min":1.3109999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1220000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.873,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.23,"5min":1.319,"15min":1.5109999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.0289999999999999,"15min":1.0129999999999999},"min":{"1min":0.52300000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.397,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":1.1459999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4650000000000001,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.04,"15min":1.014},"min":{"1min":0.79100000000000004,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.506,"5min":1.506,"15min":1.8540000000000001},"last":1.042}]},{"osd":3,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0700000000000001,"15min":1.0649999999999999},"min":{"1min":0.61699999999999999,"5min":0.59099999999999997,"15min":0.44800000000000001},"max":{"1min":1.4930000000000001,"5min":1.587,"15min":1.841},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.75800000000000001,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.3320000000000001,"5min":1.405,"15min":1.784},"last":1.071}]},{"osd":4,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.755,"5min":0.47499999999999998,"15min":0.375},"max":{"1min":1.6279999999999999,"5min":1.7350000000000001,"15min":2.504},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.72799999999999998,"5min":0.47099999999999997,"15min":0.33000000000000002},"max":{"1min":1.5569999999999999,"5min":1.708,"15min":2.044},"last":0.92500000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.03,"15min":1.03},"min":{"1min":0.63200000000000001,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.9239999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1879999999999999,"15min":1.2010000000000001},"min":{"1min":0.72499999999999998,"5min":0.52200000000000002,"15min":0.44500000000000001},"max":{"1min":1.593,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.212}]},{"osd":7,"last update":"Wed Dec 13 22:55:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.21,"15min":1.2},"min":{"1min":0.69799999999999995,"5min":0.45000000000000001,"15min":0.42299999999999999},"max":{"1min":1.6339999999999999,"5min":1.766,"15min":2.956},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.99399999999999999,"5min":0.495,"15min":0.442},"max":{"1min":1.6779999999999999,"5min":1.788,"15min":1.9350000000000001},"last":0.72199999999999998}]}]},{"osd":5,"up_from":16,"seq":68719477113,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.59399999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.264,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.494},"last":1.0389999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.94899999999999995,"15min":0.95699999999999996},"min":{"1min":0.75800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.667},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93999999999999995,"15min":0.96899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.95499999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0009999999999999,"15min":1.012},"min":{"1min":0.61499999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94399999999999995,"15min":0.95199999999999996},"min":{"1min":0.69099999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3089999999999999,"5min":1.4350000000000001,"15min":1.5009999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98799999999999999,"15min":1.028},"min":{"1min":0.57499999999999996,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.599},"last":0.754},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0649999999999999,"15min":1.089},"min":{"1min":0.625,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3360000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.0700000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.89400000000000002,"15min":0.92500000000000004},"min":{"1min":0.57199999999999995,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3779999999999999,"5min":1.482,"15min":1.53},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.0469999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.1160000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.024,"15min":1.0680000000000001},"min":{"1min":0.46600000000000003,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0469999999999999,"15min":1.077},"min":{"1min":0.63300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.466,"5min":1.552,"15min":1.8480000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Dec 13 22:55:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.1459999999999999},"min":{"1min":0.60199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.9339999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.181,"15min":1.214},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.26}]}]},{"osd":4,"up_from":16,"seq":68719477114,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.88900000000000001,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4630000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.61499999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.282,"5min":1.373,"15min":1.488},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1200000000000001,"5min":1.75,"15min":1.75},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.97999999999999998,"15min":0.99199999999999999},"min":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.359,"5min":1.3959999999999999,"15min":1.831},"last":0.78900000000000003}]},{"osd":2,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.95699999999999996,"15min":0.97399999999999998},"min":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.347,"5min":1.3480000000000001,"15min":1.645},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.72399999999999998,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.23,"5min":1.5149999999999999,"15min":1.75},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.69899999999999995,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.629,"15min":1.639},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.099,"15min":1.1220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.371,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":1.2689999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0229999999999999,"15min":1.014},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.5189999999999999,"5min":2.218,"15min":2.218},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.014,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.4099999999999999,"5min":1.5,"15min":1.643},"last":1.012}]},{"osd":6,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.345,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.165,"15min":1.1599999999999999},"min":{"1min":0.70699999999999996,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.575,"5min":2.137,"15min":2.137},"last":0.97199999999999998}]},{"osd":7,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1060000000000001,"15min":1.1200000000000001},"min":{"1min":0.73199999999999998,"5min":0.628,"15min":0.504},"max":{"1min":1.52,"5min":1.8049999999999999,"15min":1.857},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1859999999999999,"15min":1.2090000000000001},"min":{"1min":0.749,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.7270000000000001,"5min":1.927,"15min":2.3079999999999998},"last":1.3680000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477113,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.41799999999999998,"5min":0.33300000000000002,"15min":0.32200000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.878},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.081,"5min":1.3149999999999999,"15min":1.524},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.52500000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88200000000000001,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.3120000000000001,"5min":1.3859999999999999,"15min":1.4379999999999999},"last":0.95499999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.82999999999999996,"15min":0.86699999999999999},"min":{"1min":0.61599999999999999,"5min":0.373,"15min":0.34200000000000003},"max":{"1min":1.085,"5min":1.3029999999999999,"15min":5.085},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.95099999999999996,"15min":0.92900000000000005},"min":{"1min":0.63600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.78200000000000003}]},{"osd":4,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.81599999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3069999999999999,"5min":1.6359999999999999,"15min":1.77},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0760000000000001,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3180000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.0800000000000001,"15min":1.091},"min":{"1min":0.76800000000000002,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.3919999999999999,"5min":1.532,"15min":1.8400000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1830000000000001,"15min":1.177},"min":{"1min":0.84999999999999998,"5min":0.63200000000000001,"15min":0.38200000000000001},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.0289999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.23,"15min":1.204},"min":{"1min":0.98999999999999999,"5min":0.60299999999999998,"15min":0.47199999999999998},"max":{"1min":1.5720000000000001,"5min":1.8149999999999999,"15min":2.181},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.1499999999999999,"15min":1.1879999999999999},"min":{"1min":0.96399999999999997,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.407,"5min":1.742,"15min":2.1230000000000002},"last":1.242}]},{"osd":7,"last update":"Wed Dec 13 22:55:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1859999999999999,"15min":1.224},"min":{"1min":0.81699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4870000000000001,"5min":1.841,"15min":2.1779999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.1759999999999999,"15min":1.1890000000000001},"min":{"1min":1.0189999999999999,"5min":0.65200000000000002,"15min":0.55600000000000005},"max":{"1min":1.5169999999999999,"5min":1.7909999999999999,"15min":1.948},"last":1.0760000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477114,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.78200000000000003,"15min":0.76500000000000001},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0860000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83699999999999997,"15min":0.82499999999999996},"min":{"1min":0.53000000000000003,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":1.054,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.75600000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72499999999999998,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1559999999999999,"5min":1.401,"15min":1.5580000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.397,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.61599999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1160000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.872,"15min":0.87},"min":{"1min":0.58099999999999996,"5min":0.308,"15min":0.308},"max":{"1min":1.1120000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.111}]},{"osd":4,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0049999999999999,"15min":1.0089999999999999},"min":{"1min":0.746,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.3169999999999999,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.018,"15min":1.032},"min":{"1min":0.60299999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3260000000000001,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0609999999999999,"15min":1.089},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.6599999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.181,"15min":1.1799999999999999},"min":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"max":{"1min":1.4710000000000001,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.077}]},{"osd":6,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.089,"15min":1.117},"min":{"1min":0.79000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.468,"5min":1.706,"15min":1.7649999999999999},"last":1.331},{"interface":"front","average":{"1min":1.099,"5min":1.1859999999999999,"15min":1.2130000000000001},"min":{"1min":0.66400000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.4339999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.99099999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:55:22 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1539999999999999,"15min":1.1799999999999999},"min":{"1min":0.88500000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.409,"5min":1.8,"15min":1.8520000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.1519999999999999,"15min":1.173},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4239999999999999,"5min":2.774,"15min":2.774},"last":1.1990000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509816,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.24,"5min":1.24,"15min":2.8730000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.89500000000000002}]},{"osd":1,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.042,"5min":1.47,"15min":1.964},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.2609999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.503,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1619999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1759999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.63400000000000001,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.105,"5min":1.718,"15min":1.869},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.034,"15min":1.0669999999999999},"min":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":1.8340000000000001},"last":1.0900000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.091},"min":{"1min":0.71999999999999997,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.573,"5min":1.772,"15min":2.1030000000000002},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":2.0779999999999998},"last":1.2030000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.1499999999999999},"min":{"1min":0.80300000000000005,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.518,"5min":1.764,"15min":1.835},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1060000000000001,"15min":1.1419999999999999},"min":{"1min":0.72999999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.319,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.736}]},{"osd":7,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1599999999999999,"15min":1.1910000000000001},"min":{"1min":0.83199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.704,"15min":2.5640000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1479999999999999,"15min":1.2050000000000001},"min":{"1min":0.81200000000000006,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":1.986,"15min":5.3310000000000004},"last":1.6459999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542519,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.36299999999999999,"15min":0.25700000000000001},"max":{"1min":1.048,"5min":1.897,"15min":1.897},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.77000000000000002},"min":{"1min":0.51700000000000002,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.099,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.747,"15min":0.748},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.204,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.86799999999999999},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.1020000000000001,"5min":1.79,"15min":1.9099999999999999},"last":1.024}]},{"osd":3,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.92000000000000004,"15min":0.91900000000000004},"min":{"1min":0.38100000000000001,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.0680000000000001,"5min":1.867,"15min":2.6320000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.92400000000000004,"15min":0.88700000000000001},"min":{"1min":0.64800000000000002,"5min":0.34899999999999998,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.91100000000000003}]},{"osd":4,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.73099999999999998,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.3680000000000001,"5min":1.5389999999999999,"15min":2.0659999999999998},"last":0.877},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.101,"15min":1.0960000000000001},"min":{"1min":0.71199999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.4490000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.099,"15min":1.0760000000000001},"min":{"1min":0.70999999999999996,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.5309999999999999,"5min":1.554,"15min":1.625},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.113},"min":{"1min":0.85999999999999999,"5min":0.53000000000000003,"15min":0.46800000000000003},"max":{"1min":1.5049999999999999,"5min":2.0259999999999998,"15min":2.1539999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.139,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.599,"5min":1.8420000000000001,"15min":2.2250000000000001},"last":0.997},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.232,"15min":1.212},"min":{"1min":0.93799999999999994,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.5669999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.0720000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:55:21 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.1910000000000001,"15min":1.165},"min":{"1min":0.91800000000000004,"5min":0.56899999999999995,"15min":0.55400000000000005},"max":{"1min":1.6739999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.048},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.232,"15min":1.228},"min":{"1min":0.89200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.6419999999999999,"5min":2.1259999999999999,"15min":2.339},"last":1.095}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:56:14.420 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.420 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.420 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.421 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.422 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.425 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.426 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-13T22:25:56.191268+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=56, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.427 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.428 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:14.429 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T22:56:34.430 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:56:34.560 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 Processor -- start 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 -- start start 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 0x7fdac0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdac015c5a0 0x7fdac015af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac015a4a0 con 0x7fdac015b450 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac006d560 con 0x7fdac015c5a0 2023-12-13T22:56:34.561 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdac5fab640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac006cc00 con 0x7fdac015c1c0 2023-12-13T22:56:34.562 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdab6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdac015c5a0 0x7fdac015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.563 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.565+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 0x7fdac0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.569+0000 7fdab6ffd640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fdac015c5a0 0x7fdac015af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53574/0 (socket says 172.21.15.91:53574) 2023-12-13T22:56:34.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.569+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 0x7fdac0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:52518/0 (socket says 172.21.15.91:52518) 2023-12-13T22:56:34.564 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.569+0000 7fdab6ffd640 1 -- 172.21.15.91:0/2575188255 learned_addr learned my addr 172.21.15.91:0/2575188255 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:34.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.573+0000 7fdab6ffd640 1 -- 172.21.15.91:0/2575188255 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 msgr2=0x7fdac0159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:56:34.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.573+0000 7fdab6ffd640 1 --2- 172.21.15.91:0/2575188255 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 0x7fdac0159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:34.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.573+0000 7fdab6ffd640 1 -- 172.21.15.91:0/2575188255 >> v1:172.21.15.152:6789/0 conn(0x7fdac015b450 legacy=0x7fdac00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:34.570 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.573+0000 7fdab6ffd640 1 -- 172.21.15.91:0/2575188255 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac015b900 con 0x7fdac015c5a0 2023-12-13T22:56:34.574 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.577+0000 7fdab6ffd640 1 --2- 172.21.15.91:0/2575188255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015c5a0 0x7fdac015af10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009870 tx=0x7fdaa801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c3f00e767b8e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:34.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdabeffd640 1 -- 172.21.15.91:0/2575188255 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80ab5f0 con 0x7fdac015c5a0 2023-12-13T22:56:34.578 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdabeffd640 1 -- 172.21.15.91:0/2575188255 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80ab750 con 0x7fdac015c5a0 2023-12-13T22:56:34.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdabeffd640 1 -- 172.21.15.91:0/2575188255 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80abae0 con 0x7fdac015c5a0 2023-12-13T22:56:34.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 -- 172.21.15.91:0/2575188255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015c5a0 msgr2=0x7fdac015af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:34.579 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 --2- 172.21.15.91:0/2575188255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015c5a0 0x7fdac015af10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009870 tx=0x7fdaa801c540 comp rx=0 tx=0).stop 2023-12-13T22:56:34.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 -- 172.21.15.91:0/2575188255 shutdown_connections 2023-12-13T22:56:34.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 --2- 172.21.15.91:0/2575188255 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015c5a0 0x7fdac015af10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:34.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 --2- 172.21.15.91:0/2575188255 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c1c0 0x7fdac0159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:34.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 -- 172.21.15.91:0/2575188255 >> 172.21.15.91:0/2575188255 conn(0x7fdac0060fd0 msgr2=0x7fdac00613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:34.580 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 -- 172.21.15.91:0/2575188255 shutdown_connections 2023-12-13T22:56:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.581+0000 7fdac5fab640 1 -- 172.21.15.91:0/2575188255 wait complete. 2023-12-13T22:56:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 Processor -- start 2023-12-13T22:56:34.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 -- start start 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac015c1c0 0x7fdac0150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c5a0 0x7fdac01507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac014f1f0 con 0x7fdac015b450 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac014f4d0 con 0x7fdac015c1c0 2023-12-13T22:56:34.582 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdac5fab640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac014f7b0 con 0x7fdac015c5a0 2023-12-13T22:56:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:53588/0 (socket says 172.21.15.91:53588) 2023-12-13T22:56:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdabf7fe640 1 -- 172.21.15.91:0/235619981 learned_addr learned my addr 172.21.15.91:0/235619981 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdab6ffd640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac015c1c0 0x7fdac0150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.583 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.585+0000 7fdabffff640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c5a0 0x7fdac01507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.589+0000 7fdabf7fe640 1 -- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c5a0 msgr2=0x7fdac01507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:34.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.589+0000 7fdabf7fe640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c5a0 0x7fdac01507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:34.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.589+0000 7fdabf7fe640 1 -- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac015c1c0 msgr2=0x7fdac0150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:34.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.589+0000 7fdabf7fe640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac015c1c0 0x7fdac0150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:34.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.589+0000 7fdabf7fe640 1 -- 172.21.15.91:0/235619981 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80094d0 con 0x7fdac015b450 2023-12-13T22:56:34.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.593+0000 7fdabf7fe640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdab000e930 tx=0x7fdab000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0009690 con 0x7fdac015b450 2023-12-13T22:56:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab000ca00 con 0x7fdac015b450 2023-12-13T22:56:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac014fa90 con 0x7fdac015b450 2023-12-13T22:56:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab000cd70 con 0x7fdac015b450 2023-12-13T22:56:34.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac014e9c0 con 0x7fdac015b450 2023-12-13T22:56:34.594 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.597+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0067d50 con 0x7fdac015b450 2023-12-13T22:56:34.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.617+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdab0013470 con 0x7fdac015b450 2023-12-13T22:56:34.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.617+0000 7fdabcff9640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 0x7fdaa4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:34.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.617+0000 7fdab6ffd640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 0x7fdaa4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:34.616 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.617+0000 7fdab6ffd640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 0x7fdaa4068d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80af000 tx=0x7fdaa80b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:34.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.621+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdab0055b60 con 0x7fdac015b450 2023-12-13T22:56:34.880 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:34.885+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdab0051ea0 con 0x7fdac015b450 2023-12-13T22:56:35.051 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.053+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdac00ca5d0 con 0x7fdaa4066840 2023-12-13T22:56:35.065 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.069+0000 7fdabcff9640 1 -- 172.21.15.91:0/235619981 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370830 (secure 0 0 0) 0x7fdac00ca5d0 con 0x7fdaa4066840 2023-12-13T22:56:35.070 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:56:35.073 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 msgr2=0x7fdaa4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 0x7fdaa4068d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80af000 tx=0x7fdaa80b6040 comp rx=0 tx=0).stop 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 msgr2=0x7fdac00cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdab000e930 tx=0x7fdab000edf0 comp rx=0 tx=0).stop 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 shutdown_connections 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fdaa4066840 0x7fdaa4068d00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdac015c5a0 0x7fdac01507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:35.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdac015c1c0 0x7fdac0150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:35.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 --2- 172.21.15.91:0/235619981 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fdac015b450 0x7fdac00cde50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:35.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 >> 172.21.15.91:0/235619981 conn(0x7fdac0060fd0 msgr2=0x7fdac01582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:35.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 shutdown_connections 2023-12-13T22:56:35.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:35.073+0000 7fdac5fab640 1 -- 172.21.15.91:0/235619981 wait complete. 2023-12-13T22:56:35.090 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":967,"stamp":"2023-12-13T22:56:33.368918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13485,"ondisk_log_size":13485,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005004"},"pg_stats":[{"pgid":"2.1f","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.362830+0000","last_change":"2023-12-13T22:55:50.362882+0000","last_active":"2023-12-13T22:55:50.362830+0000","last_peered":"2023-12-13T22:55:50.362830+0000","last_clean":"2023-12-13T22:55:50.362830+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:50.362830+0000","last_undegraded":"2023-12-13T22:55:50.362830+0000","last_fullsized":"2023-12-13T22:55:50.362830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.362718+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:36:46.007828+0000","scrub_duration":0.0095031890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.086684+0000","last_change":"2023-12-13T22:55:57.086684+0000","last_active":"2023-12-13T22:55:57.086684+0000","last_peered":"2023-12-13T22:55:57.086684+0000","last_clean":"2023-12-13T22:55:57.086684+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:57.086684+0000","last_undegraded":"2023-12-13T22:55:57.086684+0000","last_fullsized":"2023-12-13T22:55:57.086684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.086433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:37.740171+0000","scrub_duration":0.0047689719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:12.878700+0000","last_change":"2023-12-13T22:26:06.564670+0000","last_active":"2023-12-13T22:55:12.878700+0000","last_peered":"2023-12-13T22:55:12.878700+0000","last_clean":"2023-12-13T22:55:12.878700+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:55:12.878700+0000","last_undegraded":"2023-12-13T22:55:12.878700+0000","last_fullsized":"2023-12-13T22:55:12.878700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.130795+0000","last_change":"2023-12-13T22:56:04.130795+0000","last_active":"2023-12-13T22:56:04.130795+0000","last_peered":"2023-12-13T22:56:04.130795+0000","last_clean":"2023-12-13T22:56:04.130795+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:56:04.130795+0000","last_undegraded":"2023-12-13T22:56:04.130795+0000","last_fullsized":"2023-12-13T22:56:04.130795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'557","last_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_deep_scrub":"31'557","last_deep_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.130538+0000","objects_scrubbed":1,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:18.030140+0000","scrub_duration":0.017810682000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.384670+0000","last_change":"2023-12-13T22:55:53.384721+0000","last_active":"2023-12-13T22:55:53.384670+0000","last_peered":"2023-12-13T22:55:53.384670+0000","last_clean":"2023-12-13T22:55:53.384670+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:53.384670+0000","last_undegraded":"2023-12-13T22:55:53.384670+0000","last_fullsized":"2023-12-13T22:55:53.384670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.384483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:09.394000+0000","scrub_duration":0.0059998250000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.760349+0000","last_change":"2023-12-13T22:56:07.760404+0000","last_active":"2023-12-13T22:56:07.760349+0000","last_peered":"2023-12-13T22:56:07.760349+0000","last_clean":"2023-12-13T22:56:07.760349+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:56:07.760349+0000","last_undegraded":"2023-12-13T22:56:07.760349+0000","last_fullsized":"2023-12-13T22:56:07.760349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.760159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:54.961389+0000","scrub_duration":0.0082528020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'14","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.006531+0000","last_change":"2023-12-13T22:56:01.006646+0000","last_active":"2023-12-13T22:56:01.006531+0000","last_peered":"2023-12-13T22:56:01.006531+0000","last_clean":"2023-12-13T22:56:01.006531+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:56:01.006531+0000","last_undegraded":"2023-12-13T22:56:01.006531+0000","last_fullsized":"2023-12-13T22:56:01.006531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.006244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:30.213593+0000","scrub_duration":0.0084082649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:13.460520+0000","last_change":"2023-12-13T22:56:13.460572+0000","last_active":"2023-12-13T22:56:13.460520+0000","last_peered":"2023-12-13T22:56:13.460520+0000","last_clean":"2023-12-13T22:56:13.460520+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:56:13.460520+0000","last_undegraded":"2023-12-13T22:56:13.460520+0000","last_fullsized":"2023-12-13T22:56:13.460520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_clean_scrub_stamp":"2023-12-13T22:56:13.460331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:27.359933+0000","scrub_duration":0.0028389130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.773631+0000","last_change":"2023-12-13T22:56:11.773767+0000","last_active":"2023-12-13T22:56:11.773631+0000","last_peered":"2023-12-13T22:56:11.773631+0000","last_clean":"2023-12-13T22:56:11.773631+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:56:11.773631+0000","last_undegraded":"2023-12-13T22:56:11.773631+0000","last_fullsized":"2023-12-13T22:56:11.773631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.773409+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:10.025016+0000","scrub_duration":0.0070233229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.975345+0000","last_change":"2023-12-13T22:56:04.975403+0000","last_active":"2023-12-13T22:56:04.975345+0000","last_peered":"2023-12-13T22:56:04.975345+0000","last_clean":"2023-12-13T22:56:04.975345+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:56:04.975345+0000","last_undegraded":"2023-12-13T22:56:04.975345+0000","last_fullsized":"2023-12-13T22:56:04.975345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.975161+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:29.194959+0000","scrub_duration":0.005625924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.419817+0000","last_change":"2023-12-13T22:56:09.419869+0000","last_active":"2023-12-13T22:56:09.419817+0000","last_peered":"2023-12-13T22:56:09.419817+0000","last_clean":"2023-12-13T22:56:09.419817+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:56:09.419817+0000","last_undegraded":"2023-12-13T22:56:09.419817+0000","last_fullsized":"2023-12-13T22:56:09.419817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.419615+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:50.791071+0000","scrub_duration":0.0033404609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.746368+0000","last_change":"2023-12-13T22:56:05.746368+0000","last_active":"2023-12-13T22:56:05.746368+0000","last_peered":"2023-12-13T22:56:05.746368+0000","last_clean":"2023-12-13T22:56:05.746368+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:56:05.746368+0000","last_undegraded":"2023-12-13T22:56:05.746368+0000","last_fullsized":"2023-12-13T22:56:05.746368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'104","last_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_deep_scrub":"31'104","last_deep_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.746112+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:53.792152+0000","scrub_duration":0.0090762269999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:26.187058+0000","last_change":"2023-12-13T22:56:26.187058+0000","last_active":"2023-12-13T22:56:26.187058+0000","last_peered":"2023-12-13T22:56:26.187058+0000","last_clean":"2023-12-13T22:56:26.187058+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:56:26.187058+0000","last_undegraded":"2023-12-13T22:56:26.187058+0000","last_fullsized":"2023-12-13T22:56:26.187058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_clean_scrub_stamp":"2023-12-13T22:56:26.186709+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:13.387939+0000","scrub_duration":0.0036531189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'674","reported_seq":717,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.032320+0000","last_change":"2023-12-13T22:56:10.032381+0000","last_active":"2023-12-13T22:56:10.032320+0000","last_peered":"2023-12-13T22:56:10.032320+0000","last_clean":"2023-12-13T22:56:10.032320+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:56:10.032320+0000","last_undegraded":"2023-12-13T22:56:10.032320+0000","last_fullsized":"2023-12-13T22:56:10.032320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'674","last_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_deep_scrub":"31'674","last_deep_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.032136+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:02:10.233919+0000","scrub_duration":0.019140582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:21.714127+0000","last_change":"2023-12-13T22:56:21.714183+0000","last_active":"2023-12-13T22:56:21.714127+0000","last_peered":"2023-12-13T22:56:21.714127+0000","last_clean":"2023-12-13T22:56:21.714127+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:56:21.714127+0000","last_undegraded":"2023-12-13T22:56:21.714127+0000","last_fullsized":"2023-12-13T22:56:21.714127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_clean_scrub_stamp":"2023-12-13T22:56:21.713927+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:42:02.256865+0000","scrub_duration":0.0076867139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.118429+0000","last_change":"2023-12-13T22:56:00.118478+0000","last_active":"2023-12-13T22:56:00.118429+0000","last_peered":"2023-12-13T22:56:00.118429+0000","last_clean":"2023-12-13T22:56:00.118429+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:56:00.118429+0000","last_undegraded":"2023-12-13T22:56:00.118429+0000","last_fullsized":"2023-12-13T22:56:00.118429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.118246+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:17:52.123696+0000","scrub_duration":0.003500979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'231","reported_seq":275,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.701006+0000","last_change":"2023-12-13T22:55:53.701006+0000","last_active":"2023-12-13T22:55:53.701006+0000","last_peered":"2023-12-13T22:55:53.701006+0000","last_clean":"2023-12-13T22:55:53.701006+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:53.701006+0000","last_undegraded":"2023-12-13T22:55:53.701006+0000","last_fullsized":"2023-12-13T22:55:53.701006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.700899+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:00.803310+0000","scrub_duration":0.0056378890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.677218+0000","last_change":"2023-12-13T22:56:18.677275+0000","last_active":"2023-12-13T22:56:18.677218+0000","last_peered":"2023-12-13T22:56:18.677218+0000","last_clean":"2023-12-13T22:56:18.677218+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:56:18.677218+0000","last_undegraded":"2023-12-13T22:56:18.677218+0000","last_fullsized":"2023-12-13T22:56:18.677218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.677054+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:32.576656+0000","scrub_duration":0.010044599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.067985+0000","last_change":"2023-12-13T22:56:05.067985+0000","last_active":"2023-12-13T22:56:05.067985+0000","last_peered":"2023-12-13T22:56:05.067985+0000","last_clean":"2023-12-13T22:56:05.067985+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:56:05.067985+0000","last_undegraded":"2023-12-13T22:56:05.067985+0000","last_fullsized":"2023-12-13T22:56:05.067985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.067730+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:26.243855+0000","scrub_duration":0.0036404760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'167","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.826963+0000","last_change":"2023-12-13T22:56:02.826963+0000","last_active":"2023-12-13T22:56:02.826963+0000","last_peered":"2023-12-13T22:56:02.826963+0000","last_clean":"2023-12-13T22:56:02.826963+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:56:02.826963+0000","last_undegraded":"2023-12-13T22:56:02.826963+0000","last_fullsized":"2023-12-13T22:56:02.826963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.826714+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:46.888140+0000","scrub_duration":0.0074117790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:32.749290+0000","last_change":"2023-12-13T22:26:06.555853+0000","last_active":"2023-12-13T22:55:32.749290+0000","last_peered":"2023-12-13T22:55:32.749290+0000","last_clean":"2023-12-13T22:55:32.749290+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:55:32.749290+0000","last_undegraded":"2023-12-13T22:55:32.749290+0000","last_fullsized":"2023-12-13T22:55:32.749290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.896395+0000","last_change":"2023-12-13T22:55:57.896395+0000","last_active":"2023-12-13T22:55:57.896395+0000","last_peered":"2023-12-13T22:55:57.896395+0000","last_clean":"2023-12-13T22:55:57.896395+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:57.896395+0000","last_undegraded":"2023-12-13T22:55:57.896395+0000","last_fullsized":"2023-12-13T22:55:57.896395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.896154+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:41.957580+0000","scrub_duration":0.0027243580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'5","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.011503+0000","last_change":"2023-12-13T22:55:58.011503+0000","last_active":"2023-12-13T22:55:58.011503+0000","last_peered":"2023-12-13T22:55:58.011503+0000","last_clean":"2023-12-13T22:55:58.011503+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:58.011503+0000","last_undegraded":"2023-12-13T22:55:58.011503+0000","last_fullsized":"2023-12-13T22:55:58.011503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.011259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:22.491272+0000","scrub_duration":0.0058936780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.776408+0000","last_change":"2023-12-13T22:56:09.776464+0000","last_active":"2023-12-13T22:56:09.776408+0000","last_peered":"2023-12-13T22:56:09.776408+0000","last_clean":"2023-12-13T22:56:09.776408+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:56:09.776408+0000","last_undegraded":"2023-12-13T22:56:09.776408+0000","last_fullsized":"2023-12-13T22:56:09.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.776205+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:27.344349+0000","scrub_duration":0.0082280419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.394605+0000","last_change":"2023-12-13T22:55:54.394605+0000","last_active":"2023-12-13T22:55:54.394605+0000","last_peered":"2023-12-13T22:55:54.394605+0000","last_clean":"2023-12-13T22:55:54.394605+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:54.394605+0000","last_undegraded":"2023-12-13T22:55:54.394605+0000","last_fullsized":"2023-12-13T22:55:54.394605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.394350+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:38:08.105528+0000","scrub_duration":0.0036387030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.233515+0000","last_change":"2023-12-13T22:55:54.233515+0000","last_active":"2023-12-13T22:55:54.233515+0000","last_peered":"2023-12-13T22:55:54.233515+0000","last_clean":"2023-12-13T22:55:54.233515+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:54.233515+0000","last_undegraded":"2023-12-13T22:55:54.233515+0000","last_fullsized":"2023-12-13T22:55:54.233515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.233177+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:03.688679+0000","scrub_duration":0.0080965169999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.700892+0000","last_change":"2023-12-13T22:56:22.700948+0000","last_active":"2023-12-13T22:56:22.700892+0000","last_peered":"2023-12-13T22:56:22.700892+0000","last_clean":"2023-12-13T22:56:22.700892+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:56:22.700892+0000","last_undegraded":"2023-12-13T22:56:22.700892+0000","last_fullsized":"2023-12-13T22:56:22.700892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.700701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:17:09.244554+0000","scrub_duration":0.0083719640000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.172376+0000","last_change":"2023-12-13T22:56:20.172376+0000","last_active":"2023-12-13T22:56:20.172376+0000","last_peered":"2023-12-13T22:56:20.172376+0000","last_clean":"2023-12-13T22:56:20.172376+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:56:20.172376+0000","last_undegraded":"2023-12-13T22:56:20.172376+0000","last_fullsized":"2023-12-13T22:56:20.172376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.172119+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:34:19.011880+0000","scrub_duration":0.0048316519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'190","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.940925+0000","last_change":"2023-12-13T22:56:12.940925+0000","last_active":"2023-12-13T22:56:12.940925+0000","last_peered":"2023-12-13T22:56:12.940925+0000","last_clean":"2023-12-13T22:56:12.940925+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:56:12.940925+0000","last_undegraded":"2023-12-13T22:56:12.940925+0000","last_fullsized":"2023-12-13T22:56:12.940925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.940512+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:58.333074+0000","scrub_duration":0.011165543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:28.160975+0000","last_change":"2023-12-13T22:56:28.161032+0000","last_active":"2023-12-13T22:56:28.160975+0000","last_peered":"2023-12-13T22:56:28.160975+0000","last_clean":"2023-12-13T22:56:28.160975+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:56:28.160975+0000","last_undegraded":"2023-12-13T22:56:28.160975+0000","last_fullsized":"2023-12-13T22:56:28.160975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_clean_scrub_stamp":"2023-12-13T22:56:28.160767+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:40:21.795633+0000","scrub_duration":0.0089128829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.858359+0000","last_change":"2023-12-13T22:56:23.858400+0000","last_active":"2023-12-13T22:56:23.858359+0000","last_peered":"2023-12-13T22:56:23.858359+0000","last_clean":"2023-12-13T22:56:23.858359+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:56:23.858359+0000","last_undegraded":"2023-12-13T22:56:23.858359+0000","last_fullsized":"2023-12-13T22:56:23.858359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.858227+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:32:56.691182+0000","scrub_duration":0.0033943609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.953673+0000","last_change":"2023-12-13T22:56:03.953801+0000","last_active":"2023-12-13T22:56:03.953673+0000","last_peered":"2023-12-13T22:56:03.953673+0000","last_clean":"2023-12-13T22:56:03.953673+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:56:03.953673+0000","last_undegraded":"2023-12-13T22:56:03.953673+0000","last_fullsized":"2023-12-13T22:56:03.953673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.953362+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:55:24.663154+0000","scrub_duration":0.0065831049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.436614+0000","last_change":"2023-12-13T22:56:12.436678+0000","last_active":"2023-12-13T22:56:12.436614+0000","last_peered":"2023-12-13T22:56:12.436614+0000","last_clean":"2023-12-13T22:56:12.436614+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:56:12.436614+0000","last_undegraded":"2023-12-13T22:56:12.436614+0000","last_fullsized":"2023-12-13T22:56:12.436614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.436388+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:36.054849+0000","scrub_duration":0.0067611340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.427281+0000","last_change":"2023-12-13T22:56:07.427334+0000","last_active":"2023-12-13T22:56:07.427281+0000","last_peered":"2023-12-13T22:56:07.427281+0000","last_clean":"2023-12-13T22:56:07.427281+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:56:07.427281+0000","last_undegraded":"2023-12-13T22:56:07.427281+0000","last_fullsized":"2023-12-13T22:56:07.427281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.427084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:24.995228+0000","scrub_duration":0.0038031240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.882716+0000","last_change":"2023-12-13T22:56:11.882820+0000","last_active":"2023-12-13T22:56:11.882716+0000","last_peered":"2023-12-13T22:56:11.882716+0000","last_clean":"2023-12-13T22:56:11.882716+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:56:11.882716+0000","last_undegraded":"2023-12-13T22:56:11.882716+0000","last_fullsized":"2023-12-13T22:56:11.882716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.882492+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:59.928532+0000","scrub_duration":0.0034021170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:19.682337+0000","last_change":"2023-12-13T22:56:19.682393+0000","last_active":"2023-12-13T22:56:19.682337+0000","last_peered":"2023-12-13T22:56:19.682337+0000","last_clean":"2023-12-13T22:56:19.682337+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:56:19.682337+0000","last_undegraded":"2023-12-13T22:56:19.682337+0000","last_fullsized":"2023-12-13T22:56:19.682337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:19.682136+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:26.387877+0000","scrub_duration":0.0093473989999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.985034+0000","last_change":"2023-12-13T22:55:52.985096+0000","last_active":"2023-12-13T22:55:52.985034+0000","last_peered":"2023-12-13T22:55:52.985034+0000","last_clean":"2023-12-13T22:55:52.985034+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:52.985034+0000","last_undegraded":"2023-12-13T22:55:52.985034+0000","last_fullsized":"2023-12-13T22:55:52.985034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.984842+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:22:25.512989+0000","scrub_duration":0.0033867749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.371704+0000","last_change":"2023-12-13T22:55:57.371756+0000","last_active":"2023-12-13T22:55:57.371704+0000","last_peered":"2023-12-13T22:55:57.371704+0000","last_clean":"2023-12-13T22:55:57.371704+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:57.371704+0000","last_undegraded":"2023-12-13T22:55:57.371704+0000","last_fullsized":"2023-12-13T22:55:57.371704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.371503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:29:53.556509+0000","scrub_duration":0.0029694280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.746486+0000","last_change":"2023-12-13T22:26:05.951101+0000","last_active":"2023-12-13T22:55:17.746486+0000","last_peered":"2023-12-13T22:55:17.746486+0000","last_clean":"2023-12-13T22:55:17.746486+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:55:17.746486+0000","last_undegraded":"2023-12-13T22:55:17.746486+0000","last_fullsized":"2023-12-13T22:55:17.746486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.934789+0000","last_change":"2023-12-13T22:56:14.934892+0000","last_active":"2023-12-13T22:56:14.934789+0000","last_peered":"2023-12-13T22:56:14.934789+0000","last_clean":"2023-12-13T22:56:14.934789+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:56:14.934789+0000","last_undegraded":"2023-12-13T22:56:14.934789+0000","last_fullsized":"2023-12-13T22:56:14.934789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.934537+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:02.135767+0000","scrub_duration":0.0038170019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'253","reported_seq":450,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.928398+0000","last_change":"2023-12-13T22:55:54.928461+0000","last_active":"2023-12-13T22:55:54.928398+0000","last_peered":"2023-12-13T22:55:54.928398+0000","last_clean":"2023-12-13T22:55:54.928398+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:54.928398+0000","last_undegraded":"2023-12-13T22:55:54.928398+0000","last_fullsized":"2023-12-13T22:55:54.928398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'253","last_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_deep_scrub":"31'253","last_deep_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.928226+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:21:19.453012+0000","scrub_duration":0.0082018130000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":116,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.281439+0000","last_change":"2023-12-13T22:26:05.941574+0000","last_active":"2023-12-13T22:55:47.281439+0000","last_peered":"2023-12-13T22:55:47.281439+0000","last_clean":"2023-12-13T22:55:47.281439+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:55:47.281439+0000","last_undegraded":"2023-12-13T22:55:47.281439+0000","last_fullsized":"2023-12-13T22:55:47.281439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.423054+0000","last_change":"2023-12-13T22:55:52.423106+0000","last_active":"2023-12-13T22:55:52.423054+0000","last_peered":"2023-12-13T22:55:52.423054+0000","last_clean":"2023-12-13T22:55:52.423054+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:52.423054+0000","last_undegraded":"2023-12-13T22:55:52.423054+0000","last_fullsized":"2023-12-13T22:55:52.423054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.422920+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:03:02.820205+0000","scrub_duration":0.0018780209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.989925+0000","last_change":"2023-12-13T22:55:58.989925+0000","last_active":"2023-12-13T22:55:58.989925+0000","last_peered":"2023-12-13T22:55:58.989925+0000","last_clean":"2023-12-13T22:55:58.989925+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:55:58.989925+0000","last_undegraded":"2023-12-13T22:55:58.989925+0000","last_fullsized":"2023-12-13T22:55:58.989925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.989650+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:05.695391+0000","scrub_duration":0.0073674609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.410712+0000","last_change":"2023-12-13T22:56:14.410712+0000","last_active":"2023-12-13T22:56:14.410712+0000","last_peered":"2023-12-13T22:56:14.410712+0000","last_clean":"2023-12-13T22:56:14.410712+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:56:14.410712+0000","last_undegraded":"2023-12-13T22:56:14.410712+0000","last_fullsized":"2023-12-13T22:56:14.410712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.410460+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:15:01.401860+0000","scrub_duration":0.004314399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.155911+0000","last_change":"2023-12-13T22:56:17.155963+0000","last_active":"2023-12-13T22:56:17.155911+0000","last_peered":"2023-12-13T22:56:17.155911+0000","last_clean":"2023-12-13T22:56:17.155911+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:56:17.155911+0000","last_undegraded":"2023-12-13T22:56:17.155911+0000","last_fullsized":"2023-12-13T22:56:17.155911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.155741+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:10.405334+0000","scrub_duration":0.0030467839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.359601+0000","last_change":"2023-12-13T22:55:52.359631+0000","last_active":"2023-12-13T22:55:52.359601+0000","last_peered":"2023-12-13T22:55:52.359601+0000","last_clean":"2023-12-13T22:55:52.359601+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:52.359601+0000","last_undegraded":"2023-12-13T22:55:52.359601+0000","last_fullsized":"2023-12-13T22:55:52.359601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.359516+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:37.445461+0000","scrub_duration":0.0062306879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.936095+0000","last_change":"2023-12-13T22:55:54.936170+0000","last_active":"2023-12-13T22:55:54.936095+0000","last_peered":"2023-12-13T22:55:54.936095+0000","last_clean":"2023-12-13T22:55:54.936095+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:55:54.936095+0000","last_undegraded":"2023-12-13T22:55:54.936095+0000","last_fullsized":"2023-12-13T22:55:54.936095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.935901+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:40.021847+0000","scrub_duration":0.011317162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.599238+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:55:22.599238+0000","last_peered":"2023-12-13T22:55:22.599238+0000","last_clean":"2023-12-13T22:55:22.599238+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:55:22.599238+0000","last_undegraded":"2023-12-13T22:55:22.599238+0000","last_fullsized":"2023-12-13T22:55:22.599238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:30.007729+0000","last_change":"2023-12-13T22:56:30.007834+0000","last_active":"2023-12-13T22:56:30.007729+0000","last_peered":"2023-12-13T22:56:30.007729+0000","last_clean":"2023-12-13T22:56:30.007729+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:56:30.007729+0000","last_undegraded":"2023-12-13T22:56:30.007729+0000","last_fullsized":"2023-12-13T22:56:30.007729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_clean_scrub_stamp":"2023-12-13T22:56:30.007437+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:00.924051+0000","scrub_duration":0.0034788699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.779403+0000","last_change":"2023-12-13T22:56:00.779462+0000","last_active":"2023-12-13T22:56:00.779403+0000","last_peered":"2023-12-13T22:56:00.779403+0000","last_clean":"2023-12-13T22:56:00.779403+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:56:00.779403+0000","last_undegraded":"2023-12-13T22:56:00.779403+0000","last_fullsized":"2023-12-13T22:56:00.779403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.779224+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:55:53.386922+0000","scrub_duration":0.0076204089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.142864+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:55:52.142864+0000","last_peered":"2023-12-13T22:55:52.142864+0000","last_clean":"2023-12-13T22:55:52.142864+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:55:52.142864+0000","last_undegraded":"2023-12-13T22:55:52.142864+0000","last_fullsized":"2023-12-13T22:55:52.142864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.366939+0000","last_change":"2023-12-13T22:55:51.367028+0000","last_active":"2023-12-13T22:55:51.366939+0000","last_peered":"2023-12-13T22:55:51.366939+0000","last_clean":"2023-12-13T22:55:51.366939+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:51.366939+0000","last_undegraded":"2023-12-13T22:55:51.366939+0000","last_fullsized":"2023-12-13T22:55:51.366939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.366729+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:41:58.469140+0000","scrub_duration":0.0033407179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.895758+0000","last_change":"2023-12-13T22:56:04.895812+0000","last_active":"2023-12-13T22:56:04.895758+0000","last_peered":"2023-12-13T22:56:04.895758+0000","last_clean":"2023-12-13T22:56:04.895758+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:56:04.895758+0000","last_undegraded":"2023-12-13T22:56:04.895758+0000","last_fullsized":"2023-12-13T22:56:04.895758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.895573+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:29.086931+0000","scrub_duration":0.0061804989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.434836+0000","last_change":"2023-12-13T22:56:09.434895+0000","last_active":"2023-12-13T22:56:09.434836+0000","last_peered":"2023-12-13T22:56:09.434836+0000","last_clean":"2023-12-13T22:56:09.434836+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:56:09.434836+0000","last_undegraded":"2023-12-13T22:56:09.434836+0000","last_fullsized":"2023-12-13T22:56:09.434836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.434626+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:11:58.367162+0000","scrub_duration":0.0066969239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543919+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.543919+0000","last_peered":"2023-12-13T22:55:35.543919+0000","last_clean":"2023-12-13T22:55:35.543919+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.543919+0000","last_undegraded":"2023-12-13T22:55:35.543919+0000","last_fullsized":"2023-12-13T22:55:35.543919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'5","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.901897+0000","last_change":"2023-12-13T22:55:51.901953+0000","last_active":"2023-12-13T22:55:51.901897+0000","last_peered":"2023-12-13T22:55:51.901897+0000","last_clean":"2023-12-13T22:55:51.901897+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:55:51.901897+0000","last_undegraded":"2023-12-13T22:55:51.901897+0000","last_fullsized":"2023-12-13T22:55:51.901897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.901720+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:54:32.031652+0000","scrub_duration":0.0054560959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.403393+0000","last_change":"2023-12-13T22:56:18.403393+0000","last_active":"2023-12-13T22:56:18.403393+0000","last_peered":"2023-12-13T22:56:18.403393+0000","last_clean":"2023-12-13T22:56:18.403393+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:56:18.403393+0000","last_undegraded":"2023-12-13T22:56:18.403393+0000","last_fullsized":"2023-12-13T22:56:18.403393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'110","last_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_deep_scrub":"31'110","last_deep_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.403123+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:23.426054+0000","scrub_duration":0.0094199109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.281148+0000","last_change":"2023-12-13T22:27:03.084028+0000","last_active":"2023-12-13T22:55:47.281148+0000","last_peered":"2023-12-13T22:55:47.281148+0000","last_clean":"2023-12-13T22:55:47.281148+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:55:47.281148+0000","last_undegraded":"2023-12-13T22:55:47.281148+0000","last_fullsized":"2023-12-13T22:55:47.281148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'265","reported_seq":308,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.957704+0000","last_change":"2023-12-13T22:55:50.957847+0000","last_active":"2023-12-13T22:55:50.957704+0000","last_peered":"2023-12-13T22:55:50.957704+0000","last_clean":"2023-12-13T22:55:50.957704+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:50.957704+0000","last_undegraded":"2023-12-13T22:55:50.957704+0000","last_fullsized":"2023-12-13T22:55:50.957704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'265","last_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_deep_scrub":"31'265","last_deep_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.957478+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:05:25.538846+0000","scrub_duration":0.01053072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.731840+0000","last_change":"2023-12-13T22:56:12.731840+0000","last_active":"2023-12-13T22:56:12.731840+0000","last_peered":"2023-12-13T22:56:12.731840+0000","last_clean":"2023-12-13T22:56:12.731840+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:56:12.731840+0000","last_undegraded":"2023-12-13T22:56:12.731840+0000","last_fullsized":"2023-12-13T22:56:12.731840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.731398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:54.102853+0000","scrub_duration":0.0074439079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.912661+0000","last_change":"2023-12-13T22:55:53.912661+0000","last_active":"2023-12-13T22:55:53.912661+0000","last_peered":"2023-12-13T22:55:53.912661+0000","last_clean":"2023-12-13T22:55:53.912661+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:53.912661+0000","last_undegraded":"2023-12-13T22:55:53.912661+0000","last_fullsized":"2023-12-13T22:55:53.912661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.912416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:01.014828+0000","scrub_duration":0.002904542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'268","reported_seq":311,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.722659+0000","last_change":"2023-12-13T22:56:02.722659+0000","last_active":"2023-12-13T22:56:02.722659+0000","last_peered":"2023-12-13T22:56:02.722659+0000","last_clean":"2023-12-13T22:56:02.722659+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:56:02.722659+0000","last_undegraded":"2023-12-13T22:56:02.722659+0000","last_fullsized":"2023-12-13T22:56:02.722659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'268","last_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_deep_scrub":"31'268","last_deep_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.722401+0000","objects_scrubbed":8,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:57:04.531070+0000","scrub_duration":0.015955368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.424794+0000","last_change":"2023-12-13T22:56:11.424852+0000","last_active":"2023-12-13T22:56:11.424794+0000","last_peered":"2023-12-13T22:56:11.424794+0000","last_clean":"2023-12-13T22:56:11.424794+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:56:11.424794+0000","last_undegraded":"2023-12-13T22:56:11.424794+0000","last_fullsized":"2023-12-13T22:56:11.424794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.424585+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:00.237813+0000","scrub_duration":0.0064149180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.193654+0000","last_change":"2023-12-13T22:56:27.193813+0000","last_active":"2023-12-13T22:56:27.193654+0000","last_peered":"2023-12-13T22:56:27.193654+0000","last_clean":"2023-12-13T22:56:27.193654+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:56:27.193654+0000","last_undegraded":"2023-12-13T22:56:27.193654+0000","last_fullsized":"2023-12-13T22:56:27.193654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.193306+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:44.761451+0000","scrub_duration":0.0042190769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1021","reported_seq":1064,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.174135+0000","last_change":"2023-12-13T22:56:06.174135+0000","last_active":"2023-12-13T22:56:06.174135+0000","last_peered":"2023-12-13T22:56:06.174135+0000","last_clean":"2023-12-13T22:56:06.174135+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:56:06.174135+0000","last_undegraded":"2023-12-13T22:56:06.174135+0000","last_fullsized":"2023-12-13T22:56:06.174135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1021","last_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_deep_scrub":"31'1021","last_deep_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.173900+0000","objects_scrubbed":2,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:30.653912+0000","scrub_duration":0.027900313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:07.877831+0000","last_change":"2023-12-13T22:26:06.554349+0000","last_active":"2023-12-13T22:55:07.877831+0000","last_peered":"2023-12-13T22:55:07.877831+0000","last_clean":"2023-12-13T22:55:07.877831+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:55:07.877831+0000","last_undegraded":"2023-12-13T22:55:07.877831+0000","last_fullsized":"2023-12-13T22:55:07.877831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.000650+0000","last_change":"2023-12-13T22:56:24.000702+0000","last_active":"2023-12-13T22:56:24.000650+0000","last_peered":"2023-12-13T22:56:24.000650+0000","last_clean":"2023-12-13T22:56:24.000650+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:56:24.000650+0000","last_undegraded":"2023-12-13T22:56:24.000650+0000","last_fullsized":"2023-12-13T22:56:24.000650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.000443+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:37.900045+0000","scrub_duration":0.0024080159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.398798+0000","last_change":"2023-12-13T22:55:55.398798+0000","last_active":"2023-12-13T22:55:55.398798+0000","last_peered":"2023-12-13T22:55:55.398798+0000","last_clean":"2023-12-13T22:55:55.398798+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:55.398798+0000","last_undegraded":"2023-12-13T22:55:55.398798+0000","last_fullsized":"2023-12-13T22:55:55.398798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.398473+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:02.104213+0000","scrub_duration":0.0061603880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:54:24.390781+0000","last_change":"2023-12-13T22:27:03.568134+0000","last_active":"2023-12-13T22:54:24.390781+0000","last_peered":"2023-12-13T22:54:24.390781+0000","last_clean":"2023-12-13T22:54:24.390781+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:54:24.390781+0000","last_undegraded":"2023-12-13T22:54:24.390781+0000","last_fullsized":"2023-12-13T22:54:24.390781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.361680+0000","last_change":"2023-12-13T22:55:58.361680+0000","last_active":"2023-12-13T22:55:58.361680+0000","last_peered":"2023-12-13T22:55:58.361680+0000","last_clean":"2023-12-13T22:55:58.361680+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:58.361680+0000","last_undegraded":"2023-12-13T22:55:58.361680+0000","last_fullsized":"2023-12-13T22:55:58.361680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.361421+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:57:39.970158+0000","scrub_duration":0.003149827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'12","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.403251+0000","last_change":"2023-12-13T22:55:49.403251+0000","last_active":"2023-12-13T22:55:49.403251+0000","last_peered":"2023-12-13T22:55:49.403251+0000","last_clean":"2023-12-13T22:55:49.403251+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:55:49.403251+0000","last_undegraded":"2023-12-13T22:55:49.403251+0000","last_fullsized":"2023-12-13T22:55:49.403251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_clean_scrub_stamp":"2023-12-13T22:55:49.403136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:06:21.586077+0000","scrub_duration":0.0076955030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.349625+0000","last_change":"2023-12-13T22:56:22.349726+0000","last_active":"2023-12-13T22:56:22.349625+0000","last_peered":"2023-12-13T22:56:22.349625+0000","last_clean":"2023-12-13T22:56:22.349625+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:56:22.349625+0000","last_undegraded":"2023-12-13T22:56:22.349625+0000","last_fullsized":"2023-12-13T22:56:22.349625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.349410+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:35:11.433767+0000","scrub_duration":0.008386325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.006958+0000","last_change":"2023-12-13T22:56:25.007013+0000","last_active":"2023-12-13T22:56:25.006958+0000","last_peered":"2023-12-13T22:56:25.006958+0000","last_clean":"2023-12-13T22:56:25.006958+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:56:25.006958+0000","last_undegraded":"2023-12-13T22:56:25.006958+0000","last_fullsized":"2023-12-13T22:56:25.006958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.006764+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:46.182889+0000","scrub_duration":0.004328892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1187","reported_seq":1230,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.224878+0000","last_change":"2023-12-13T22:55:53.224878+0000","last_active":"2023-12-13T22:55:53.224878+0000","last_peered":"2023-12-13T22:55:53.224878+0000","last_clean":"2023-12-13T22:55:53.224878+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:53.224878+0000","last_undegraded":"2023-12-13T22:55:53.224878+0000","last_fullsized":"2023-12-13T22:55:53.224878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1187","last_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_deep_scrub":"31'1187","last_deep_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.224528+0000","objects_scrubbed":5,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:15:59.076548+0000","scrub_duration":0.029787111000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.822613+0000","last_change":"2023-12-13T22:56:24.822613+0000","last_active":"2023-12-13T22:56:24.822613+0000","last_peered":"2023-12-13T22:56:24.822613+0000","last_clean":"2023-12-13T22:56:24.822613+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:56:24.822613+0000","last_undegraded":"2023-12-13T22:56:24.822613+0000","last_fullsized":"2023-12-13T22:56:24.822613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.822281+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:20.279273+0000","scrub_duration":0.0075375160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:56.934053+0000","last_change":"2023-12-13T22:55:56.934053+0000","last_active":"2023-12-13T22:55:56.934053+0000","last_peered":"2023-12-13T22:55:56.934053+0000","last_clean":"2023-12-13T22:55:56.934053+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:56.934053+0000","last_undegraded":"2023-12-13T22:55:56.934053+0000","last_fullsized":"2023-12-13T22:55:56.934053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_clean_scrub_stamp":"2023-12-13T22:55:56.933891+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:27:43.656236+0000","scrub_duration":0.002368658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'130","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.782407+0000","last_change":"2023-12-13T22:55:59.782469+0000","last_active":"2023-12-13T22:55:59.782407+0000","last_peered":"2023-12-13T22:55:59.782407+0000","last_clean":"2023-12-13T22:55:59.782407+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:59.782407+0000","last_undegraded":"2023-12-13T22:55:59.782407+0000","last_fullsized":"2023-12-13T22:55:59.782407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'130","last_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_deep_scrub":"31'130","last_deep_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.782224+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:14.537967+0000","scrub_duration":0.0092044889999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.752082+0000","last_change":"2023-12-13T22:56:06.752082+0000","last_active":"2023-12-13T22:56:06.752082+0000","last_peered":"2023-12-13T22:56:06.752082+0000","last_clean":"2023-12-13T22:56:06.752082+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:56:06.752082+0000","last_undegraded":"2023-12-13T22:56:06.752082+0000","last_fullsized":"2023-12-13T22:56:06.752082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.751811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:52.144373+0000","scrub_duration":0.0073970829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.446914+0000","last_change":"2023-12-13T22:56:07.446965+0000","last_active":"2023-12-13T22:56:07.446914+0000","last_peered":"2023-12-13T22:56:07.446914+0000","last_clean":"2023-12-13T22:56:07.446914+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:56:07.446914+0000","last_undegraded":"2023-12-13T22:56:07.446914+0000","last_fullsized":"2023-12-13T22:56:07.446914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.446725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:18:14.638863+0000","scrub_duration":0.0036426369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.377308+0000","last_change":"2023-12-13T22:55:53.377429+0000","last_active":"2023-12-13T22:55:53.377308+0000","last_peered":"2023-12-13T22:55:53.377308+0000","last_clean":"2023-12-13T22:55:53.377308+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:53.377308+0000","last_undegraded":"2023-12-13T22:55:53.377308+0000","last_fullsized":"2023-12-13T22:55:53.377308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.377020+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:08.132763+0000","scrub_duration":0.0054373049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.263913+0000","last_change":"2023-12-13T22:26:05.946520+0000","last_active":"2023-12-13T22:55:49.263913+0000","last_peered":"2023-12-13T22:55:49.263913+0000","last_clean":"2023-12-13T22:55:49.263913+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:55:49.263913+0000","last_undegraded":"2023-12-13T22:55:49.263913+0000","last_fullsized":"2023-12-13T22:55:49.263913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.471767+0000","last_change":"2023-12-13T22:56:06.471822+0000","last_active":"2023-12-13T22:56:06.471767+0000","last_peered":"2023-12-13T22:56:06.471767+0000","last_clean":"2023-12-13T22:56:06.471767+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:56:06.471767+0000","last_undegraded":"2023-12-13T22:56:06.471767+0000","last_fullsized":"2023-12-13T22:56:06.471767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.471493+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:53.672723+0000","scrub_duration":0.0040682790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'92","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.175160+0000","last_change":"2023-12-13T22:56:11.175209+0000","last_active":"2023-12-13T22:56:11.175160+0000","last_peered":"2023-12-13T22:56:11.175160+0000","last_clean":"2023-12-13T22:56:11.175160+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:56:11.175160+0000","last_undegraded":"2023-12-13T22:56:11.175160+0000","last_fullsized":"2023-12-13T22:56:11.175160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'92","last_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_deep_scrub":"31'92","last_deep_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.175043+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:40.382392+0000","scrub_duration":0.0069995819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.116512+0000","last_change":"2023-12-13T22:56:27.116512+0000","last_active":"2023-12-13T22:56:27.116512+0000","last_peered":"2023-12-13T22:56:27.116512+0000","last_clean":"2023-12-13T22:56:27.116512+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:56:27.116512+0000","last_undegraded":"2023-12-13T22:56:27.116512+0000","last_fullsized":"2023-12-13T22:56:27.116512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.116244+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:39:45.231694+0000","scrub_duration":0.0073969650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.461548+0000","last_change":"2023-12-13T22:56:10.461606+0000","last_active":"2023-12-13T22:56:10.461548+0000","last_peered":"2023-12-13T22:56:10.461548+0000","last_clean":"2023-12-13T22:56:10.461548+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:56:10.461548+0000","last_undegraded":"2023-12-13T22:56:10.461548+0000","last_fullsized":"2023-12-13T22:56:10.461548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.461318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:05:24.742614+0000","scrub_duration":0.007727856,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.617154+0000","last_change":"2023-12-13T22:55:47.617203+0000","last_active":"2023-12-13T22:55:47.617154+0000","last_peered":"2023-12-13T22:55:47.617154+0000","last_clean":"2023-12-13T22:55:47.617154+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:47.617154+0000","last_undegraded":"2023-12-13T22:55:47.617154+0000","last_fullsized":"2023-12-13T22:55:47.617154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_clean_scrub_stamp":"2023-12-13T22:55:47.617039+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:57.072541+0000","scrub_duration":0.0027396679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.453354+0000","last_change":"2023-12-13T22:56:01.453406+0000","last_active":"2023-12-13T22:56:01.453354+0000","last_peered":"2023-12-13T22:56:01.453354+0000","last_clean":"2023-12-13T22:56:01.453354+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:56:01.453354+0000","last_undegraded":"2023-12-13T22:56:01.453354+0000","last_fullsized":"2023-12-13T22:56:01.453354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.453158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:13.446611+0000","scrub_duration":0.0027122370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.598315+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:55:17.598315+0000","last_peered":"2023-12-13T22:55:17.598315+0000","last_clean":"2023-12-13T22:55:17.598315+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:55:17.598315+0000","last_undegraded":"2023-12-13T22:55:17.598315+0000","last_fullsized":"2023-12-13T22:55:17.598315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.131057+0000","last_change":"2023-12-13T22:56:25.131109+0000","last_active":"2023-12-13T22:56:25.131057+0000","last_peered":"2023-12-13T22:56:25.131057+0000","last_clean":"2023-12-13T22:56:25.131057+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:56:25.131057+0000","last_undegraded":"2023-12-13T22:56:25.131057+0000","last_fullsized":"2023-12-13T22:56:25.131057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.130834+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:47:07.106327+0000","scrub_duration":0.0032470709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'211","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.108706+0000","last_change":"2023-12-13T22:56:02.108772+0000","last_active":"2023-12-13T22:56:02.108706+0000","last_peered":"2023-12-13T22:56:02.108706+0000","last_clean":"2023-12-13T22:56:02.108706+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:56:02.108706+0000","last_undegraded":"2023-12-13T22:56:02.108706+0000","last_fullsized":"2023-12-13T22:56:02.108706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.108492+0000","objects_scrubbed":2,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:43.479948+0000","scrub_duration":0.0095572120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'307","reported_seq":645,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.204092+0000","last_change":"2023-12-13T22:56:15.204157+0000","last_active":"2023-12-13T22:56:15.204092+0000","last_peered":"2023-12-13T22:56:15.204092+0000","last_clean":"2023-12-13T22:56:15.204092+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:56:15.204092+0000","last_undegraded":"2023-12-13T22:56:15.204092+0000","last_fullsized":"2023-12-13T22:56:15.204092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'307","last_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_deep_scrub":"31'307","last_deep_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.203889+0000","objects_scrubbed":2,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:27.197342+0000","scrub_duration":0.0078670609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.377972+0000","last_change":"2023-12-13T22:55:51.377972+0000","last_active":"2023-12-13T22:55:51.377972+0000","last_peered":"2023-12-13T22:55:51.377972+0000","last_clean":"2023-12-13T22:55:51.377972+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:51.377972+0000","last_undegraded":"2023-12-13T22:55:51.377972+0000","last_fullsized":"2023-12-13T22:55:51.377972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.377829+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:25:56.812795+0000","scrub_duration":0.002123673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.728227+0000","last_change":"2023-12-13T22:56:12.728337+0000","last_active":"2023-12-13T22:56:12.728227+0000","last_peered":"2023-12-13T22:56:12.728227+0000","last_clean":"2023-12-13T22:56:12.728227+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:56:12.728227+0000","last_undegraded":"2023-12-13T22:56:12.728227+0000","last_fullsized":"2023-12-13T22:56:12.728227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.727919+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:31:35.351976+0000","scrub_duration":0.0075005030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2405","reported_seq":2447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.130328+0000","last_change":"2023-12-13T22:56:01.130400+0000","last_active":"2023-12-13T22:56:01.130328+0000","last_peered":"2023-12-13T22:56:01.130328+0000","last_clean":"2023-12-13T22:56:01.130328+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:56:01.130328+0000","last_undegraded":"2023-12-13T22:56:01.130328+0000","last_fullsized":"2023-12-13T22:56:01.130328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2405","last_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_deep_scrub":"31'2405","last_deep_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.130136+0000","objects_scrubbed":4,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:22:59.381743+0000","scrub_duration":0.058223199000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.925504+0000","last_change":"2023-12-13T22:55:55.925504+0000","last_active":"2023-12-13T22:55:55.925504+0000","last_peered":"2023-12-13T22:55:55.925504+0000","last_clean":"2023-12-13T22:55:55.925504+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:55.925504+0000","last_undegraded":"2023-12-13T22:55:55.925504+0000","last_fullsized":"2023-12-13T22:55:55.925504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.925325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:05.665814+0000","scrub_duration":0.003351882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.263701+0000","last_change":"2023-12-13T22:26:05.947938+0000","last_active":"2023-12-13T22:55:49.263701+0000","last_peered":"2023-12-13T22:55:49.263701+0000","last_clean":"2023-12-13T22:55:49.263701+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:55:49.263701+0000","last_undegraded":"2023-12-13T22:55:49.263701+0000","last_fullsized":"2023-12-13T22:55:49.263701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.141163+0000","last_change":"2023-12-13T22:56:17.141276+0000","last_active":"2023-12-13T22:56:17.141163+0000","last_peered":"2023-12-13T22:56:17.141163+0000","last_clean":"2023-12-13T22:56:17.141163+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:56:17.141163+0000","last_undegraded":"2023-12-13T22:56:17.141163+0000","last_fullsized":"2023-12-13T22:56:17.141163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.140931+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:41.360729+0000","scrub_duration":0.0032991119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.686736+0000","last_change":"2023-12-13T22:56:06.686792+0000","last_active":"2023-12-13T22:56:06.686736+0000","last_peered":"2023-12-13T22:56:06.686736+0000","last_clean":"2023-12-13T22:56:06.686736+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:56:06.686736+0000","last_undegraded":"2023-12-13T22:56:06.686736+0000","last_fullsized":"2023-12-13T22:56:06.686736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.686540+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:12.538560+0000","scrub_duration":0.0033057130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.437283+0000","last_change":"2023-12-13T22:56:15.437335+0000","last_active":"2023-12-13T22:56:15.437283+0000","last_peered":"2023-12-13T22:56:15.437283+0000","last_clean":"2023-12-13T22:56:15.437283+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:56:15.437283+0000","last_undegraded":"2023-12-13T22:56:15.437283+0000","last_fullsized":"2023-12-13T22:56:15.437283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.437095+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:36.613220+0000","scrub_duration":0.0030693510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.371452+0000","last_change":"2023-12-13T22:56:05.371573+0000","last_active":"2023-12-13T22:56:05.371452+0000","last_peered":"2023-12-13T22:56:05.371452+0000","last_clean":"2023-12-13T22:56:05.371452+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:56:05.371452+0000","last_undegraded":"2023-12-13T22:56:05.371452+0000","last_fullsized":"2023-12-13T22:56:05.371452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.371135+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:26:38.933074+0000","scrub_duration":0.003783182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.973818+0000","last_change":"2023-12-13T22:55:51.973818+0000","last_active":"2023-12-13T22:55:51.973818+0000","last_peered":"2023-12-13T22:55:51.973818+0000","last_clean":"2023-12-13T22:55:51.973818+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:51.973818+0000","last_undegraded":"2023-12-13T22:55:51.973818+0000","last_fullsized":"2023-12-13T22:55:51.973818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.973584+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:03.967036+0000","scrub_duration":0.0031747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.281272+0000","last_change":"2023-12-13T22:27:03.084922+0000","last_active":"2023-12-13T22:55:47.281272+0000","last_peered":"2023-12-13T22:55:47.281272+0000","last_clean":"2023-12-13T22:55:47.281272+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:55:47.281272+0000","last_undegraded":"2023-12-13T22:55:47.281272+0000","last_fullsized":"2023-12-13T22:55:47.281272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.142569+0000","last_change":"2023-12-13T22:26:00.405889+0000","last_active":"2023-12-13T22:55:52.142569+0000","last_peered":"2023-12-13T22:55:52.142569+0000","last_clean":"2023-12-13T22:55:52.142569+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:55:52.142569+0000","last_undegraded":"2023-12-13T22:55:52.142569+0000","last_fullsized":"2023-12-13T22:55:52.142569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.094675+0000","last_change":"2023-12-13T22:55:59.094675+0000","last_active":"2023-12-13T22:55:59.094675+0000","last_peered":"2023-12-13T22:55:59.094675+0000","last_clean":"2023-12-13T22:55:59.094675+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:59.094675+0000","last_undegraded":"2023-12-13T22:55:59.094675+0000","last_fullsized":"2023-12-13T22:55:59.094675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.094434+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:46.295665+0000","scrub_duration":0.004669416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.444743+0000","last_change":"2023-12-13T22:56:03.444743+0000","last_active":"2023-12-13T22:56:03.444743+0000","last_peered":"2023-12-13T22:56:03.444743+0000","last_clean":"2023-12-13T22:56:03.444743+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:56:03.444743+0000","last_undegraded":"2023-12-13T22:56:03.444743+0000","last_fullsized":"2023-12-13T22:56:03.444743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.444479+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:27.664278+0000","scrub_duration":0.0038001070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.060063+0000","last_change":"2023-12-13T22:56:12.060115+0000","last_active":"2023-12-13T22:56:12.060063+0000","last_peered":"2023-12-13T22:56:12.060063+0000","last_clean":"2023-12-13T22:56:12.060063+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:12.060063+0000","last_undegraded":"2023-12-13T22:56:12.060063+0000","last_fullsized":"2023-12-13T22:56:12.060063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.059861+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:58.603714+0000","scrub_duration":0.0032058569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.404719+0000","last_change":"2023-12-13T22:56:17.404772+0000","last_active":"2023-12-13T22:56:17.404719+0000","last_peered":"2023-12-13T22:56:17.404719+0000","last_clean":"2023-12-13T22:56:17.404719+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:56:17.404719+0000","last_undegraded":"2023-12-13T22:56:17.404719+0000","last_fullsized":"2023-12-13T22:56:17.404719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.404502+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:57.947441+0000","scrub_duration":0.0028916459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.419542+0000","last_change":"2023-12-13T22:56:08.419598+0000","last_active":"2023-12-13T22:56:08.419542+0000","last_peered":"2023-12-13T22:56:08.419542+0000","last_clean":"2023-12-13T22:56:08.419542+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:56:08.419542+0000","last_undegraded":"2023-12-13T22:56:08.419542+0000","last_fullsized":"2023-12-13T22:56:08.419542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.419342+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:30:31.998132+0000","scrub_duration":0.0036186209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:29.143708+0000","last_change":"2023-12-13T22:56:29.143762+0000","last_active":"2023-12-13T22:56:29.143708+0000","last_peered":"2023-12-13T22:56:29.143708+0000","last_clean":"2023-12-13T22:56:29.143708+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:56:29.143708+0000","last_undegraded":"2023-12-13T22:56:29.143708+0000","last_fullsized":"2023-12-13T22:56:29.143708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_clean_scrub_stamp":"2023-12-13T22:56:29.143490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:27.395097+0000","scrub_duration":0.002849107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.547080+0000","last_change":"2023-12-13T22:26:00.408501+0000","last_active":"2023-12-13T22:55:35.547080+0000","last_peered":"2023-12-13T22:55:35.547080+0000","last_clean":"2023-12-13T22:55:35.547080+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:55:35.547080+0000","last_undegraded":"2023-12-13T22:55:35.547080+0000","last_fullsized":"2023-12-13T22:55:35.547080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.714541+0000","last_change":"2023-12-13T22:56:05.714541+0000","last_active":"2023-12-13T22:56:05.714541+0000","last_peered":"2023-12-13T22:56:05.714541+0000","last_clean":"2023-12-13T22:56:05.714541+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:56:05.714541+0000","last_undegraded":"2023-12-13T22:56:05.714541+0000","last_fullsized":"2023-12-13T22:56:05.714541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.714201+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:34:46.397683+0000","scrub_duration":0.0032594479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.791895+0000","last_change":"2023-12-13T22:56:23.792009+0000","last_active":"2023-12-13T22:56:23.791895+0000","last_peered":"2023-12-13T22:56:23.791895+0000","last_clean":"2023-12-13T22:56:23.791895+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:56:23.791895+0000","last_undegraded":"2023-12-13T22:56:23.791895+0000","last_fullsized":"2023-12-13T22:56:23.791895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.791658+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:30:19.976664+0000","scrub_duration":0.0052480870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.447837+0000","last_change":"2023-12-13T22:56:04.447837+0000","last_active":"2023-12-13T22:56:04.447837+0000","last_peered":"2023-12-13T22:56:04.447837+0000","last_clean":"2023-12-13T22:56:04.447837+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:56:04.447837+0000","last_undegraded":"2023-12-13T22:56:04.447837+0000","last_fullsized":"2023-12-13T22:56:04.447837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.447580+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:45.101318+0000","scrub_duration":0.0029573310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.932165+0000","last_change":"2023-12-13T22:56:15.932165+0000","last_active":"2023-12-13T22:56:15.932165+0000","last_peered":"2023-12-13T22:56:15.932165+0000","last_clean":"2023-12-13T22:56:15.932165+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:56:15.932165+0000","last_undegraded":"2023-12-13T22:56:15.932165+0000","last_fullsized":"2023-12-13T22:56:15.932165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.931903+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:33.500048+0000","scrub_duration":0.0045191739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.425498+0000","last_change":"2023-12-13T22:55:46.425498+0000","last_active":"2023-12-13T22:55:46.425498+0000","last_peered":"2023-12-13T22:55:46.425498+0000","last_clean":"2023-12-13T22:55:46.425498+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:46.425498+0000","last_undegraded":"2023-12-13T22:55:46.425498+0000","last_fullsized":"2023-12-13T22:55:46.425498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_clean_scrub_stamp":"2023-12-13T22:55:46.425334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:25:04.502584+0000","scrub_duration":0.0031700270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.045257+0000","last_change":"2023-12-13T22:55:55.045309+0000","last_active":"2023-12-13T22:55:55.045257+0000","last_peered":"2023-12-13T22:55:55.045257+0000","last_clean":"2023-12-13T22:55:55.045257+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:55.045257+0000","last_undegraded":"2023-12-13T22:55:55.045257+0000","last_fullsized":"2023-12-13T22:55:55.045257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.045057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:19.264855+0000","scrub_duration":0.0059794330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.814231+0000","last_change":"2023-12-13T22:56:00.814334+0000","last_active":"2023-12-13T22:56:00.814231+0000","last_peered":"2023-12-13T22:56:00.814231+0000","last_clean":"2023-12-13T22:56:00.814231+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:56:00.814231+0000","last_undegraded":"2023-12-13T22:56:00.814231+0000","last_fullsized":"2023-12-13T22:56:00.814231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.814016+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:25.005375+0000","scrub_duration":0.0031933970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:32.107940+0000","last_change":"2023-12-13T22:56:32.107990+0000","last_active":"2023-12-13T22:56:32.107940+0000","last_peered":"2023-12-13T22:56:32.107940+0000","last_clean":"2023-12-13T22:56:32.107940+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:56:32.107940+0000","last_undegraded":"2023-12-13T22:56:32.107940+0000","last_fullsized":"2023-12-13T22:56:32.107940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_clean_scrub_stamp":"2023-12-13T22:56:32.107754+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:13.479210+0000","scrub_duration":0.0060879649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.631639+0000","last_change":"2023-12-13T22:26:00.396022+0000","last_active":"2023-12-13T22:55:35.631639+0000","last_peered":"2023-12-13T22:55:35.631639+0000","last_clean":"2023-12-13T22:55:35.631639+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:55:35.631639+0000","last_undegraded":"2023-12-13T22:55:35.631639+0000","last_fullsized":"2023-12-13T22:55:35.631639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.580745+0000","last_change":"2023-12-13T22:26:00.420469+0000","last_active":"2023-12-13T22:55:35.580745+0000","last_peered":"2023-12-13T22:55:35.580745+0000","last_clean":"2023-12-13T22:55:35.580745+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:55:35.580745+0000","last_undegraded":"2023-12-13T22:55:35.580745+0000","last_fullsized":"2023-12-13T22:55:35.580745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.166004+0000","last_change":"2023-12-13T22:56:18.166056+0000","last_active":"2023-12-13T22:56:18.166004+0000","last_peered":"2023-12-13T22:56:18.166004+0000","last_clean":"2023-12-13T22:56:18.166004+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:18.166004+0000","last_undegraded":"2023-12-13T22:56:18.166004+0000","last_fullsized":"2023-12-13T22:56:18.166004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.165819+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:52:05.012128+0000","scrub_duration":0.0031531789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.953679+0000","last_change":"2023-12-13T22:56:14.953804+0000","last_active":"2023-12-13T22:56:14.953679+0000","last_peered":"2023-12-13T22:56:14.953679+0000","last_clean":"2023-12-13T22:56:14.953679+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:56:14.953679+0000","last_undegraded":"2023-12-13T22:56:14.953679+0000","last_fullsized":"2023-12-13T22:56:14.953679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.953450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:18:06.958901+0000","scrub_duration":0.0034872829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.746354+0000","last_change":"2023-12-13T22:56:15.746406+0000","last_active":"2023-12-13T22:56:15.746354+0000","last_peered":"2023-12-13T22:56:15.746354+0000","last_clean":"2023-12-13T22:56:15.746354+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:56:15.746354+0000","last_undegraded":"2023-12-13T22:56:15.746354+0000","last_fullsized":"2023-12-13T22:56:15.746354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.746151+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:30.501894+0000","scrub_duration":0.0031168839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.011702+0000","last_change":"2023-12-13T22:56:22.011755+0000","last_active":"2023-12-13T22:56:22.011702+0000","last_peered":"2023-12-13T22:56:22.011702+0000","last_clean":"2023-12-13T22:56:22.011702+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:56:22.011702+0000","last_undegraded":"2023-12-13T22:56:22.011702+0000","last_fullsized":"2023-12-13T22:56:22.011702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.011507+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:03.382963+0000","scrub_duration":0.0049321959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.390246+0000","last_change":"2023-12-13T22:56:08.390301+0000","last_active":"2023-12-13T22:56:08.390246+0000","last_peered":"2023-12-13T22:56:08.390246+0000","last_clean":"2023-12-13T22:56:08.390246+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:56:08.390246+0000","last_undegraded":"2023-12-13T22:56:08.390246+0000","last_fullsized":"2023-12-13T22:56:08.390246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.390048+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:06.641655+0000","scrub_duration":0.0035378689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.329893+0000","last_change":"2023-12-13T22:56:00.329949+0000","last_active":"2023-12-13T22:56:00.329893+0000","last_peered":"2023-12-13T22:56:00.329893+0000","last_clean":"2023-12-13T22:56:00.329893+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:56:00.329893+0000","last_undegraded":"2023-12-13T22:56:00.329893+0000","last_fullsized":"2023-12-13T22:56:00.329893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.329685+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:23:06.433638+0000","scrub_duration":0.003895417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.885365+0000","last_change":"2023-12-13T22:56:20.885454+0000","last_active":"2023-12-13T22:56:20.885365+0000","last_peered":"2023-12-13T22:56:20.885365+0000","last_clean":"2023-12-13T22:56:20.885365+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:56:20.885365+0000","last_undegraded":"2023-12-13T22:56:20.885365+0000","last_fullsized":"2023-12-13T22:56:20.885365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.885143+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:19.136750+0000","scrub_duration":0.0032445460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.539073+0000","last_change":"2023-12-13T22:26:00.414562+0000","last_active":"2023-12-13T22:55:35.539073+0000","last_peered":"2023-12-13T22:55:35.539073+0000","last_clean":"2023-12-13T22:55:35.539073+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:55:35.539073+0000","last_undegraded":"2023-12-13T22:55:35.539073+0000","last_fullsized":"2023-12-13T22:55:35.539073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8094,"ondisk_log_size":8094,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477117,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.873},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":1.3200000000000001,"5min":1.73,"15min":1.73},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.94099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":1.3859999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":1.0600000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.91600000000000004},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.409,"5min":2.165,"15min":2.165},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.002,"15min":0.98699999999999999},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1910000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.1910000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97099999999999997,"15min":0.97799999999999998},"min":{"1min":0.64800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2789999999999999,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0449999999999999,"15min":1.032},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.472,"5min":1.55,"15min":2.1269999999999998},"last":1.105}]},{"osd":3,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.73299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.3700000000000001,"15min":1.792},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.999,"15min":1.0209999999999999},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.478,"5min":1.496,"15min":1.821},"last":1.2270000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.76300000000000001,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.2170000000000001,"5min":1.847,"15min":1.8480000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.087,"5min":1.085,"15min":1.085},"min":{"1min":0.66900000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3779999999999999,"5min":1.464,"15min":1.8120000000000001},"last":1.2729999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0409999999999999,"15min":1.044},"min":{"1min":0.57999999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.575,"5min":1.575,"15min":2.21},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.127,"15min":1.111},"min":{"1min":0.79600000000000004,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.5089999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3740000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.617,"5min":2.056,"15min":2.0590000000000002},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.159,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.569,"5min":1.798,"15min":1.798},"last":1.337}]}]},{"osd":6,"up_from":16,"seq":68719477117,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.345,"5min":1.454,"15min":2.1970000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.6419999999999999},"last":1.056}]},{"osd":1,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.109,"5min":1.319,"15min":1.5109999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.002,"15min":1.006},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.218,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":0.95899999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.01,"15min":1.026},"min":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.325,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.024,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.2909999999999999,"5min":1.506,"15min":1.8540000000000001},"last":1.2130000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.034,"15min":1.056},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.44800000000000001},"max":{"1min":1.2150000000000001,"5min":1.587,"15min":1.841},"last":1.3380000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.002,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.321,"5min":1.405,"15min":1.784},"last":1.1579999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0489999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.375},"max":{"1min":1.4159999999999999,"5min":1.6279999999999999,"15min":2.504},"last":1.115},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6319999999999999,"15min":2.044},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.421,"5min":1.52,"15min":1.9239999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44500000000000001},"max":{"1min":1.5,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.288}]},{"osd":7,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.1519999999999999,"15min":1.181},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3620000000000001,"5min":1.7569999999999999,"15min":2.956},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1200000000000001,"15min":1.165},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.2410000000000001,"5min":1.788,"15min":1.9350000000000001},"last":1.2450000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477117,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.57199999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2709999999999999,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.746},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.2030000000000001,"5min":1.4239999999999999,"15min":1.4750000000000001},"last":0.86899999999999999}]},{"osd":1,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.56299999999999994,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.96899999999999997},"min":{"1min":0.65500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.369,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.016,"15min":1.012},"min":{"1min":0.78600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3049999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.67300000000000004,"5min":0.48999999999999999,"15min":0.41499999999999998},"max":{"1min":1.25,"5min":1.3089999999999999,"15min":1.5009999999999999},"last":1.079}]},{"osd":3,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.98199999999999998,"15min":1.016},"min":{"1min":0.754,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.341,"5min":1.4770000000000001,"15min":1.5820000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0760000000000001,"15min":1.089},"min":{"1min":0.90100000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3180000000000001,"5min":1.482,"15min":1.53},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.075,"15min":1.0680000000000001},"min":{"1min":0.86899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2959999999999998,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.1200000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.036,"15min":1.0609999999999999},"min":{"1min":0.81100000000000005,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.387,"5min":1.873,"15min":1.873},"last":1.032},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0309999999999999,"15min":1.073},"min":{"1min":0.84699999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.349,"5min":1.55,"15min":1.8480000000000001},"last":0.98999999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":1.02,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.232},{"interface":"front","average":{"1min":1.206,"5min":1.173,"15min":1.208},"min":{"1min":0.78800000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.49,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.258}]}]},{"osd":4,"up_from":16,"seq":68719477118,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.88900000000000001,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4630000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.61499999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.282,"5min":1.373,"15min":1.488},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1200000000000001,"5min":1.75,"15min":1.75},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.97999999999999998,"15min":0.99199999999999999},"min":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.359,"5min":1.3959999999999999,"15min":1.831},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.95699999999999996,"15min":0.97399999999999998},"min":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.347,"5min":1.3480000000000001,"15min":1.645},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.72399999999999998,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.23,"5min":1.5149999999999999,"15min":1.75},"last":0.80000000000000004}]},{"osd":3,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.69899999999999995,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.629,"15min":1.639},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.099,"15min":1.1220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.371,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0229999999999999,"15min":1.014},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.5189999999999999,"5min":2.218,"15min":2.218},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.014,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.4099999999999999,"5min":1.5,"15min":1.643},"last":0.54000000000000004}]},{"osd":6,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.345,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.143,"5min":1.165,"15min":1.1599999999999999},"min":{"1min":0.70699999999999996,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.575,"5min":2.137,"15min":2.137},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1060000000000001,"15min":1.1200000000000001},"min":{"1min":0.73199999999999998,"5min":0.628,"15min":0.504},"max":{"1min":1.52,"5min":1.8049999999999999,"15min":1.857},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.1859999999999999,"15min":1.2090000000000001},"min":{"1min":0.749,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.7270000000000001,"5min":1.927,"15min":2.3079999999999998},"last":1.0780000000000001}]}]},{"osd":3,"up_from":16,"seq":68719477117,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.878,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":1.171,"5min":1.3149999999999999,"15min":1.524},"last":0.877}]},{"osd":1,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.23,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.264,"5min":1.3120000000000001,"15min":1.4379999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.3029999999999999,"15min":5.085},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.92800000000000005},"min":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.647,"15min":1.647},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.53600000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.228,"5min":1.633,"15min":1.77},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.995,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.68200000000000005,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3700000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.72299999999999998,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.466,"5min":1.532,"15min":1.8400000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1539999999999999,"15min":1.173},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.38200000000000001},"max":{"1min":1.2689999999999999,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2,"15min":1.202},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.47199999999999998},"max":{"1min":1.325,"5min":1.8149999999999999,"15min":2.181},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.121,"15min":1.1879999999999999},"min":{"1min":0.61099999999999999,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.337,"5min":1.7270000000000001,"15min":2.1230000000000002},"last":1.0309999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1539999999999999,"15min":1.2190000000000001},"min":{"1min":0.76400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3680000000000001,"5min":1.841,"15min":2.1779999999999999},"last":1.087},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1519999999999999,"15min":1.1870000000000001},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.55600000000000005},"max":{"1min":1.5640000000000001,"5min":1.7909999999999999,"15min":1.948},"last":1.0680000000000001}]}]},{"osd":1,"up_from":16,"seq":68719477118,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0940000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":0.98599999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.127}]},{"osd":2,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.401,"15min":1.5580000000000001},"last":0.627},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":0.85399999999999998},"min":{"1min":0.39100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.76400000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.876,"15min":0.89700000000000002},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0149999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.308},"max":{"1min":1.111,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.2370000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.68000000000000005,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.2430000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2509999999999999,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.67800000000000005,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.2350000000000001,"5min":1.629,"15min":1.6599999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.64100000000000001},"max":{"1min":1.528,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.071,"15min":1.109},"min":{"1min":0.65100000000000002,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.706,"15min":1.7649999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.161,"15min":1.202},"min":{"1min":0.85899999999999999,"5min":0.57099999999999995,"15min":0.501},"max":{"1min":1.585,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.93100000000000005}]},{"osd":7,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.169},"min":{"1min":0.77600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4059999999999999,"5min":1.8,"15min":1.8520000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.78800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1990000000000001,"5min":2.774,"15min":2.774},"last":1.0169999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509820,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0760000000000001,"5min":1.24,"15min":2.8730000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.45900000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.206,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77200000000000002,"15min":0.78100000000000003},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.042,"5min":1.47,"15min":1.964},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.33500000000000002},"max":{"1min":1.2609999999999999,"5min":1.4399999999999999,"15min":2.0049999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.503,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1619999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.755},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.58599999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1759999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.2729999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.63400000000000001,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.105,"5min":1.718,"15min":1.869},"last":0.872},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.034,"15min":1.0669999999999999},"min":{"1min":0.68999999999999995,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":1.8340000000000001},"last":1.216}]},{"osd":5,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.091},"min":{"1min":0.71999999999999997,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.573,"5min":1.772,"15min":2.1030000000000002},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.77300000000000002,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2909999999999999,"5min":1.635,"15min":2.0779999999999998},"last":1.1439999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.1499999999999999},"min":{"1min":0.80300000000000005,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.518,"5min":1.764,"15min":1.835},"last":1.117},{"interface":"front","average":{"1min":1.085,"5min":1.1060000000000001,"15min":1.1419999999999999},"min":{"1min":0.72999999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.319,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.246}]},{"osd":7,"last update":"Wed Dec 13 22:55:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1599999999999999,"15min":1.1910000000000001},"min":{"1min":0.83199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.552,"5min":1.704,"15min":2.5640000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1479999999999999,"15min":1.2050000000000001},"min":{"1min":0.81200000000000006,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.468,"5min":1.986,"15min":5.3310000000000004},"last":1.081}]}]},{"osd":0,"up_from":14,"seq":60129542523,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.25700000000000001},"max":{"1min":0.98799999999999999,"5min":1.897,"15min":1.897},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.089,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed Dec 13 22:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.747,"15min":0.748},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.204,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.86799999999999999},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.1020000000000001,"5min":1.79,"15min":1.9099999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.88500000000000001,"15min":0.91000000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.151,"5min":1.8129999999999999,"15min":2.6320000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.90200000000000002,"15min":0.88300000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.284,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.90000000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.99399999999999999},"min":{"1min":0.59299999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.399,"15min":2.0659999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.58599999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.032}]},{"osd":5,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0760000000000001,"15min":1.075},"min":{"1min":0.755,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.4099999999999999,"5min":1.554,"15min":1.625},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.1040000000000001},"min":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.46800000000000003},"max":{"1min":1.306,"5min":1.5609999999999999,"15min":2.1539999999999999},"last":1.5609999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.103,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.28,"5min":1.599,"15min":2.2250000000000001},"last":1.502},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1919999999999999,"15min":1.2090000000000001},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3540000000000001,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.252}]},{"osd":7,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.171,"15min":1.163},"min":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.55400000000000005},"max":{"1min":1.577,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.22},"min":{"1min":0.89900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3839999999999999,"5min":1.841,"15min":2.339},"last":1.6100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:56:35.097 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.098 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.098 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.099 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.100 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.100 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.101 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.101 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.101 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.102 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.102 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.102 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.103 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:35.103 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T22:56:35.921 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:56:35.924 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:56:55.104 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:56:55.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 Processor -- start 2023-12-13T22:56:55.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 -- start start 2023-12-13T22:56:55.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f836c1511e0 0x7f836c06a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.237 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f836c06b7a0 0x7f836c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c157450 con 0x7f836c1515c0 2023-12-13T22:56:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c158290 con 0x7f836c1511e0 2023-12-13T22:56:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f8372a58640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c157710 con 0x7f836c06b7a0 2023-12-13T22:56:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f836bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f836c1511e0 0x7f836c06a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:55.238 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f836bfff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f836c1511e0 0x7f836c06a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:39094/0 (socket says 172.21.15.91:39094) 2023-12-13T22:56:55.239 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.241+0000 7f836bfff640 1 -- 172.21.15.91:0/1932158855 learned_addr learned my addr 172.21.15.91:0/1932158855 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.245+0000 7f836bfff640 1 -- 172.21.15.91:0/1932158855 >> v2:172.21.15.152:3300/0 conn(0x7f836c06b7a0 msgr2=0x7f836c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:56:55.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.245+0000 7f836bfff640 1 --2- 172.21.15.91:0/1932158855 >> v2:172.21.15.152:3300/0 conn(0x7f836c06b7a0 0x7f836c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.245+0000 7f836bfff640 1 -- 172.21.15.91:0/1932158855 >> v1:172.21.15.152:6789/0 conn(0x7f836c1515c0 legacy=0x7f836c0c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:56:55.242 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.245+0000 7f836bfff640 1 -- 172.21.15.91:0/1932158855 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c1579f0 con 0x7f836c1511e0 2023-12-13T22:56:55.244 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.249+0000 7f836bfff640 1 --2- 172.21.15.91:0/1932158855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1511e0 0x7f836c06a560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f836c0c8c00 tx=0x7f835c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8b7bc5eca96c4c server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:55.250 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.249+0000 7f836affd640 1 -- 172.21.15.91:0/1932158855 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0a89b0 con 0x7f836c1511e0 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f836affd640 1 -- 172.21.15.91:0/1932158855 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0a8b10 con 0x7f836c1511e0 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f836affd640 1 -- 172.21.15.91:0/1932158855 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0a8ea0 con 0x7f836c1511e0 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- 172.21.15.91:0/1932158855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1511e0 msgr2=0x7f836c06a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- 172.21.15.91:0/1932158855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1511e0 0x7f836c06a560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f836c0c8c00 tx=0x7f835c01ecb0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- 172.21.15.91:0/1932158855 shutdown_connections 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- 172.21.15.91:0/1932158855 >> v2:172.21.15.152:3300/0 conn(0x7f836c06b7a0 0x7f836c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- 172.21.15.91:0/1932158855 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1511e0 0x7f836c06a560 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- 172.21.15.91:0/1932158855 >> 172.21.15.91:0/1932158855 conn(0x7f836c06d220 msgr2=0x7f836c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- 172.21.15.91:0/1932158855 shutdown_connections 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- 172.21.15.91:0/1932158855 wait complete. 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 Processor -- start 2023-12-13T22:56:55.251 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- start start 2023-12-13T22:56:55.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1515c0 0x7f836c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f836c06f7c0 0x7f836c144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c3610 con 0x7f836c1515c0 2023-12-13T22:56:55.252 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1eea80 con 0x7f836c06f7c0 2023-12-13T22:56:55.253 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.253+0000 7f8372a58640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1eed60 con 0x7f836c06b7a0 2023-12-13T22:56:55.254 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.257+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1515c0 0x7f836c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:55.255 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.257+0000 7f836bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:55.256 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.261+0000 7f836bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:41942/0 (socket says 172.21.15.91:41942) 2023-12-13T22:56:55.257 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.261+0000 7f836bfff640 1 -- 172.21.15.91:0/1879100238 learned_addr learned my addr 172.21.15.91:0/1879100238 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:56:55.258 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.261+0000 7f8370ff5640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f836c06f7c0 0x7f836c144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:55.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.269+0000 7f836bfff640 1 -- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f836c06f7c0 msgr2=0x7f836c144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:55.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.269+0000 7f836bfff640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f836c06f7c0 0x7f836c144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.269+0000 7f836bfff640 1 -- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1515c0 msgr2=0x7f836c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:55.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.269+0000 7f836bfff640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1515c0 0x7f836c13d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:55.266 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.269+0000 7f836bfff640 1 -- 172.21.15.91:0/1879100238 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0094d0 con 0x7f836c06b7a0 2023-12-13T22:56:55.272 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.277+0000 7f836bfff640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f835c01d360 tx=0x7f835c01ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:55.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0b0e20 con 0x7f836c06b7a0 2023-12-13T22:56:55.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0ba440 con 0x7f836c06b7a0 2023-12-13T22:56:55.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0ba7f0 con 0x7f836c06b7a0 2023-12-13T22:56:55.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c1ef040 con 0x7f836c06b7a0 2023-12-13T22:56:55.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c1ef600 con 0x7f836c06b7a0 2023-12-13T22:56:55.419 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.421+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c14c320 con 0x7f836c06b7a0 2023-12-13T22:56:55.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.733+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f835c0ba950 con 0x7f836c06b7a0 2023-12-13T22:56:55.731 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.733+0000 7f8368ff9640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 0x7f8358068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:56:55.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.733+0000 7f836b7fe640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 0x7f8358068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:56:55.732 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.737+0000 7f836b7fe640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 0x7f8358068d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f836c0c7c80 tx=0x7f8360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:56:55.739 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.741+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f835c0f4130 con 0x7f836c06b7a0 2023-12-13T22:56:55.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.773+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f835c0efd70 con 0x7f836c06b7a0 2023-12-13T22:56:55.957 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.961+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f836c06aaa0 con 0x7f8358066870 2023-12-13T22:56:55.984 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.989+0000 7f8368ff9640 1 -- 172.21.15.91:0/1879100238 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371763 (secure 0 0 0) 0x7f836000be10 con 0x7f8358066870 2023-12-13T22:56:55.989 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:56:55.992 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 msgr2=0x7f8358068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 0x7f8358068d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f836c0c7c80 tx=0x7f8360008040 comp rx=0 tx=0).stop 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 msgr2=0x7f836c0c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f835c01d360 tx=0x7f835c01ba50 comp rx=0 tx=0).stop 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 shutdown_connections 2023-12-13T22:56:56.021 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f8358066870 0x7f8358068d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f836c06f7c0 0x7f836c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f836c1515c0 0x7f836c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 --2- 172.21.15.91:0/1879100238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f836c06b7a0 0x7f836c0c30d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 >> 172.21.15.91:0/1879100238 conn(0x7f836c06d220 msgr2=0x7f836c0c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 shutdown_connections 2023-12-13T22:56:56.022 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:56:55.993+0000 7f8372a58640 1 -- 172.21.15.91:0/1879100238 wait complete. 2023-12-13T22:56:56.043 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":978,"stamp":"2023-12-13T22:56:55.378733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13485,"ondisk_log_size":13485,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005657"},"pg_stats":[{"pgid":"2.1f","version":"31'14","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.362830+0000","last_change":"2023-12-13T22:55:50.362882+0000","last_active":"2023-12-13T22:55:50.362830+0000","last_peered":"2023-12-13T22:55:50.362830+0000","last_clean":"2023-12-13T22:55:50.362830+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:50.362830+0000","last_undegraded":"2023-12-13T22:55:50.362830+0000","last_fullsized":"2023-12-13T22:55:50.362830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.362718+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:36:46.007828+0000","scrub_duration":0.0095031890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.086684+0000","last_change":"2023-12-13T22:55:57.086684+0000","last_active":"2023-12-13T22:55:57.086684+0000","last_peered":"2023-12-13T22:55:57.086684+0000","last_clean":"2023-12-13T22:55:57.086684+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:57.086684+0000","last_undegraded":"2023-12-13T22:55:57.086684+0000","last_fullsized":"2023-12-13T22:55:57.086684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.086433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:37.740171+0000","scrub_duration":0.0047689719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:50.187395+0000","last_change":"2023-12-13T22:56:50.187453+0000","last_active":"2023-12-13T22:56:50.187395+0000","last_peered":"2023-12-13T22:56:50.187395+0000","last_clean":"2023-12-13T22:56:50.187395+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:56:50.187395+0000","last_undegraded":"2023-12-13T22:56:50.187395+0000","last_fullsized":"2023-12-13T22:56:50.187395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-12-13T22:56:50.187188+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-12-13T22:56:50.187188+0000","last_clean_scrub_stamp":"2023-12-13T22:56:50.187188+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:26:57.425095+0000","scrub_duration":0.0068803980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.130795+0000","last_change":"2023-12-13T22:56:04.130795+0000","last_active":"2023-12-13T22:56:04.130795+0000","last_peered":"2023-12-13T22:56:04.130795+0000","last_clean":"2023-12-13T22:56:04.130795+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:56:04.130795+0000","last_undegraded":"2023-12-13T22:56:04.130795+0000","last_fullsized":"2023-12-13T22:56:04.130795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'557","last_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_deep_scrub":"31'557","last_deep_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.130538+0000","objects_scrubbed":1,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:18.030140+0000","scrub_duration":0.017810682000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.384670+0000","last_change":"2023-12-13T22:55:53.384721+0000","last_active":"2023-12-13T22:55:53.384670+0000","last_peered":"2023-12-13T22:55:53.384670+0000","last_clean":"2023-12-13T22:55:53.384670+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:53.384670+0000","last_undegraded":"2023-12-13T22:55:53.384670+0000","last_fullsized":"2023-12-13T22:55:53.384670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.384483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:09.394000+0000","scrub_duration":0.0059998250000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.760349+0000","last_change":"2023-12-13T22:56:07.760404+0000","last_active":"2023-12-13T22:56:07.760349+0000","last_peered":"2023-12-13T22:56:07.760349+0000","last_clean":"2023-12-13T22:56:07.760349+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:56:07.760349+0000","last_undegraded":"2023-12-13T22:56:07.760349+0000","last_fullsized":"2023-12-13T22:56:07.760349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.760159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:54.961389+0000","scrub_duration":0.0082528020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'14","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.006531+0000","last_change":"2023-12-13T22:56:01.006646+0000","last_active":"2023-12-13T22:56:01.006531+0000","last_peered":"2023-12-13T22:56:01.006531+0000","last_clean":"2023-12-13T22:56:01.006531+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:56:01.006531+0000","last_undegraded":"2023-12-13T22:56:01.006531+0000","last_fullsized":"2023-12-13T22:56:01.006531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.006244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:30.213593+0000","scrub_duration":0.0084082649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:13.460520+0000","last_change":"2023-12-13T22:56:13.460572+0000","last_active":"2023-12-13T22:56:13.460520+0000","last_peered":"2023-12-13T22:56:13.460520+0000","last_clean":"2023-12-13T22:56:13.460520+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:56:13.460520+0000","last_undegraded":"2023-12-13T22:56:13.460520+0000","last_fullsized":"2023-12-13T22:56:13.460520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_clean_scrub_stamp":"2023-12-13T22:56:13.460331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:27.359933+0000","scrub_duration":0.0028389130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.773631+0000","last_change":"2023-12-13T22:56:11.773767+0000","last_active":"2023-12-13T22:56:11.773631+0000","last_peered":"2023-12-13T22:56:11.773631+0000","last_clean":"2023-12-13T22:56:11.773631+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:56:11.773631+0000","last_undegraded":"2023-12-13T22:56:11.773631+0000","last_fullsized":"2023-12-13T22:56:11.773631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.773409+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:10.025016+0000","scrub_duration":0.0070233229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.975345+0000","last_change":"2023-12-13T22:56:04.975403+0000","last_active":"2023-12-13T22:56:04.975345+0000","last_peered":"2023-12-13T22:56:04.975345+0000","last_clean":"2023-12-13T22:56:04.975345+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:56:04.975345+0000","last_undegraded":"2023-12-13T22:56:04.975345+0000","last_fullsized":"2023-12-13T22:56:04.975345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.975161+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:29.194959+0000","scrub_duration":0.005625924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.419817+0000","last_change":"2023-12-13T22:56:09.419869+0000","last_active":"2023-12-13T22:56:09.419817+0000","last_peered":"2023-12-13T22:56:09.419817+0000","last_clean":"2023-12-13T22:56:09.419817+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:56:09.419817+0000","last_undegraded":"2023-12-13T22:56:09.419817+0000","last_fullsized":"2023-12-13T22:56:09.419817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.419615+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:50.791071+0000","scrub_duration":0.0033404609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.746368+0000","last_change":"2023-12-13T22:56:05.746368+0000","last_active":"2023-12-13T22:56:05.746368+0000","last_peered":"2023-12-13T22:56:05.746368+0000","last_clean":"2023-12-13T22:56:05.746368+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:56:05.746368+0000","last_undegraded":"2023-12-13T22:56:05.746368+0000","last_fullsized":"2023-12-13T22:56:05.746368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'104","last_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_deep_scrub":"31'104","last_deep_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.746112+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:53.792152+0000","scrub_duration":0.0090762269999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:26.187058+0000","last_change":"2023-12-13T22:56:26.187058+0000","last_active":"2023-12-13T22:56:26.187058+0000","last_peered":"2023-12-13T22:56:26.187058+0000","last_clean":"2023-12-13T22:56:26.187058+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:56:26.187058+0000","last_undegraded":"2023-12-13T22:56:26.187058+0000","last_fullsized":"2023-12-13T22:56:26.187058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_clean_scrub_stamp":"2023-12-13T22:56:26.186709+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:13.387939+0000","scrub_duration":0.0036531189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'674","reported_seq":717,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.032320+0000","last_change":"2023-12-13T22:56:10.032381+0000","last_active":"2023-12-13T22:56:10.032320+0000","last_peered":"2023-12-13T22:56:10.032320+0000","last_clean":"2023-12-13T22:56:10.032320+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:56:10.032320+0000","last_undegraded":"2023-12-13T22:56:10.032320+0000","last_fullsized":"2023-12-13T22:56:10.032320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'674","last_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_deep_scrub":"31'674","last_deep_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.032136+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:02:10.233919+0000","scrub_duration":0.019140582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:21.714127+0000","last_change":"2023-12-13T22:56:21.714183+0000","last_active":"2023-12-13T22:56:21.714127+0000","last_peered":"2023-12-13T22:56:21.714127+0000","last_clean":"2023-12-13T22:56:21.714127+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:56:21.714127+0000","last_undegraded":"2023-12-13T22:56:21.714127+0000","last_fullsized":"2023-12-13T22:56:21.714127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_clean_scrub_stamp":"2023-12-13T22:56:21.713927+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:42:02.256865+0000","scrub_duration":0.0076867139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.118429+0000","last_change":"2023-12-13T22:56:00.118478+0000","last_active":"2023-12-13T22:56:00.118429+0000","last_peered":"2023-12-13T22:56:00.118429+0000","last_clean":"2023-12-13T22:56:00.118429+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:56:00.118429+0000","last_undegraded":"2023-12-13T22:56:00.118429+0000","last_fullsized":"2023-12-13T22:56:00.118429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.118246+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:17:52.123696+0000","scrub_duration":0.003500979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'231","reported_seq":275,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.701006+0000","last_change":"2023-12-13T22:55:53.701006+0000","last_active":"2023-12-13T22:55:53.701006+0000","last_peered":"2023-12-13T22:55:53.701006+0000","last_clean":"2023-12-13T22:55:53.701006+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:53.701006+0000","last_undegraded":"2023-12-13T22:55:53.701006+0000","last_fullsized":"2023-12-13T22:55:53.701006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.700899+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:00.803310+0000","scrub_duration":0.0056378890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.677218+0000","last_change":"2023-12-13T22:56:18.677275+0000","last_active":"2023-12-13T22:56:18.677218+0000","last_peered":"2023-12-13T22:56:18.677218+0000","last_clean":"2023-12-13T22:56:18.677218+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:56:18.677218+0000","last_undegraded":"2023-12-13T22:56:18.677218+0000","last_fullsized":"2023-12-13T22:56:18.677218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.677054+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:32.576656+0000","scrub_duration":0.010044599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.067985+0000","last_change":"2023-12-13T22:56:05.067985+0000","last_active":"2023-12-13T22:56:05.067985+0000","last_peered":"2023-12-13T22:56:05.067985+0000","last_clean":"2023-12-13T22:56:05.067985+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:56:05.067985+0000","last_undegraded":"2023-12-13T22:56:05.067985+0000","last_fullsized":"2023-12-13T22:56:05.067985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.067730+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:26.243855+0000","scrub_duration":0.0036404760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'167","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.826963+0000","last_change":"2023-12-13T22:56:02.826963+0000","last_active":"2023-12-13T22:56:02.826963+0000","last_peered":"2023-12-13T22:56:02.826963+0000","last_clean":"2023-12-13T22:56:02.826963+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:56:02.826963+0000","last_undegraded":"2023-12-13T22:56:02.826963+0000","last_fullsized":"2023-12-13T22:56:02.826963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.826714+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:46.888140+0000","scrub_duration":0.0074117790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:34.606743+0000","last_change":"2023-12-13T22:56:34.606782+0000","last_active":"2023-12-13T22:56:34.606743+0000","last_peered":"2023-12-13T22:56:34.606743+0000","last_clean":"2023-12-13T22:56:34.606743+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:56:34.606743+0000","last_undegraded":"2023-12-13T22:56:34.606743+0000","last_fullsized":"2023-12-13T22:56:34.606743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-12-13T22:56:34.606644+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-12-13T22:56:34.606644+0000","last_clean_scrub_stamp":"2023-12-13T22:56:34.606644+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:40:52.245623+0000","scrub_duration":0.0044389599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.896395+0000","last_change":"2023-12-13T22:55:57.896395+0000","last_active":"2023-12-13T22:55:57.896395+0000","last_peered":"2023-12-13T22:55:57.896395+0000","last_clean":"2023-12-13T22:55:57.896395+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:57.896395+0000","last_undegraded":"2023-12-13T22:55:57.896395+0000","last_fullsized":"2023-12-13T22:55:57.896395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.896154+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:41.957580+0000","scrub_duration":0.0027243580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'5","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.011503+0000","last_change":"2023-12-13T22:55:58.011503+0000","last_active":"2023-12-13T22:55:58.011503+0000","last_peered":"2023-12-13T22:55:58.011503+0000","last_clean":"2023-12-13T22:55:58.011503+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:58.011503+0000","last_undegraded":"2023-12-13T22:55:58.011503+0000","last_fullsized":"2023-12-13T22:55:58.011503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.011259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:22.491272+0000","scrub_duration":0.0058936780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.776408+0000","last_change":"2023-12-13T22:56:09.776464+0000","last_active":"2023-12-13T22:56:09.776408+0000","last_peered":"2023-12-13T22:56:09.776408+0000","last_clean":"2023-12-13T22:56:09.776408+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:56:09.776408+0000","last_undegraded":"2023-12-13T22:56:09.776408+0000","last_fullsized":"2023-12-13T22:56:09.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.776205+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:27.344349+0000","scrub_duration":0.0082280419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.394605+0000","last_change":"2023-12-13T22:55:54.394605+0000","last_active":"2023-12-13T22:55:54.394605+0000","last_peered":"2023-12-13T22:55:54.394605+0000","last_clean":"2023-12-13T22:55:54.394605+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:54.394605+0000","last_undegraded":"2023-12-13T22:55:54.394605+0000","last_fullsized":"2023-12-13T22:55:54.394605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.394350+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:38:08.105528+0000","scrub_duration":0.0036387030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.233515+0000","last_change":"2023-12-13T22:55:54.233515+0000","last_active":"2023-12-13T22:55:54.233515+0000","last_peered":"2023-12-13T22:55:54.233515+0000","last_clean":"2023-12-13T22:55:54.233515+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:54.233515+0000","last_undegraded":"2023-12-13T22:55:54.233515+0000","last_fullsized":"2023-12-13T22:55:54.233515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.233177+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:03.688679+0000","scrub_duration":0.0080965169999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.700892+0000","last_change":"2023-12-13T22:56:22.700948+0000","last_active":"2023-12-13T22:56:22.700892+0000","last_peered":"2023-12-13T22:56:22.700892+0000","last_clean":"2023-12-13T22:56:22.700892+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:56:22.700892+0000","last_undegraded":"2023-12-13T22:56:22.700892+0000","last_fullsized":"2023-12-13T22:56:22.700892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.700701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:17:09.244554+0000","scrub_duration":0.0083719640000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.172376+0000","last_change":"2023-12-13T22:56:20.172376+0000","last_active":"2023-12-13T22:56:20.172376+0000","last_peered":"2023-12-13T22:56:20.172376+0000","last_clean":"2023-12-13T22:56:20.172376+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:56:20.172376+0000","last_undegraded":"2023-12-13T22:56:20.172376+0000","last_fullsized":"2023-12-13T22:56:20.172376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.172119+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:34:19.011880+0000","scrub_duration":0.0048316519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'190","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.940925+0000","last_change":"2023-12-13T22:56:12.940925+0000","last_active":"2023-12-13T22:56:12.940925+0000","last_peered":"2023-12-13T22:56:12.940925+0000","last_clean":"2023-12-13T22:56:12.940925+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:56:12.940925+0000","last_undegraded":"2023-12-13T22:56:12.940925+0000","last_fullsized":"2023-12-13T22:56:12.940925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.940512+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:58.333074+0000","scrub_duration":0.011165543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:28.160975+0000","last_change":"2023-12-13T22:56:28.161032+0000","last_active":"2023-12-13T22:56:28.160975+0000","last_peered":"2023-12-13T22:56:28.160975+0000","last_clean":"2023-12-13T22:56:28.160975+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:56:28.160975+0000","last_undegraded":"2023-12-13T22:56:28.160975+0000","last_fullsized":"2023-12-13T22:56:28.160975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_clean_scrub_stamp":"2023-12-13T22:56:28.160767+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:40:21.795633+0000","scrub_duration":0.0089128829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.858359+0000","last_change":"2023-12-13T22:56:23.858400+0000","last_active":"2023-12-13T22:56:23.858359+0000","last_peered":"2023-12-13T22:56:23.858359+0000","last_clean":"2023-12-13T22:56:23.858359+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:56:23.858359+0000","last_undegraded":"2023-12-13T22:56:23.858359+0000","last_fullsized":"2023-12-13T22:56:23.858359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.858227+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:32:56.691182+0000","scrub_duration":0.0033943609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.953673+0000","last_change":"2023-12-13T22:56:03.953801+0000","last_active":"2023-12-13T22:56:03.953673+0000","last_peered":"2023-12-13T22:56:03.953673+0000","last_clean":"2023-12-13T22:56:03.953673+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:56:03.953673+0000","last_undegraded":"2023-12-13T22:56:03.953673+0000","last_fullsized":"2023-12-13T22:56:03.953673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.953362+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:55:24.663154+0000","scrub_duration":0.0065831049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.436614+0000","last_change":"2023-12-13T22:56:12.436678+0000","last_active":"2023-12-13T22:56:12.436614+0000","last_peered":"2023-12-13T22:56:12.436614+0000","last_clean":"2023-12-13T22:56:12.436614+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:56:12.436614+0000","last_undegraded":"2023-12-13T22:56:12.436614+0000","last_fullsized":"2023-12-13T22:56:12.436614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.436388+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:36.054849+0000","scrub_duration":0.0067611340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.427281+0000","last_change":"2023-12-13T22:56:07.427334+0000","last_active":"2023-12-13T22:56:07.427281+0000","last_peered":"2023-12-13T22:56:07.427281+0000","last_clean":"2023-12-13T22:56:07.427281+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:56:07.427281+0000","last_undegraded":"2023-12-13T22:56:07.427281+0000","last_fullsized":"2023-12-13T22:56:07.427281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.427084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:24.995228+0000","scrub_duration":0.0038031240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.882716+0000","last_change":"2023-12-13T22:56:11.882820+0000","last_active":"2023-12-13T22:56:11.882716+0000","last_peered":"2023-12-13T22:56:11.882716+0000","last_clean":"2023-12-13T22:56:11.882716+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:56:11.882716+0000","last_undegraded":"2023-12-13T22:56:11.882716+0000","last_fullsized":"2023-12-13T22:56:11.882716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.882492+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:59.928532+0000","scrub_duration":0.0034021170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:19.682337+0000","last_change":"2023-12-13T22:56:19.682393+0000","last_active":"2023-12-13T22:56:19.682337+0000","last_peered":"2023-12-13T22:56:19.682337+0000","last_clean":"2023-12-13T22:56:19.682337+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:56:19.682337+0000","last_undegraded":"2023-12-13T22:56:19.682337+0000","last_fullsized":"2023-12-13T22:56:19.682337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:19.682136+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:26.387877+0000","scrub_duration":0.0093473989999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.985034+0000","last_change":"2023-12-13T22:55:52.985096+0000","last_active":"2023-12-13T22:55:52.985034+0000","last_peered":"2023-12-13T22:55:52.985034+0000","last_clean":"2023-12-13T22:55:52.985034+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:52.985034+0000","last_undegraded":"2023-12-13T22:55:52.985034+0000","last_fullsized":"2023-12-13T22:55:52.985034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.984842+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:22:25.512989+0000","scrub_duration":0.0033867749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.371704+0000","last_change":"2023-12-13T22:55:57.371756+0000","last_active":"2023-12-13T22:55:57.371704+0000","last_peered":"2023-12-13T22:55:57.371704+0000","last_clean":"2023-12-13T22:55:57.371704+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:57.371704+0000","last_undegraded":"2023-12-13T22:55:57.371704+0000","last_fullsized":"2023-12-13T22:55:57.371704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.371503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:29:53.556509+0000","scrub_duration":0.0029694280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:37.558656+0000","last_change":"2023-12-13T22:56:37.558775+0000","last_active":"2023-12-13T22:56:37.558656+0000","last_peered":"2023-12-13T22:56:37.558656+0000","last_clean":"2023-12-13T22:56:37.558656+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:56:37.558656+0000","last_undegraded":"2023-12-13T22:56:37.558656+0000","last_fullsized":"2023-12-13T22:56:37.558656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2023-12-13T22:56:37.558336+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2023-12-13T22:56:37.558336+0000","last_clean_scrub_stamp":"2023-12-13T22:56:37.558336+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:52:24.404645+0000","scrub_duration":0.0077587120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.934789+0000","last_change":"2023-12-13T22:56:14.934892+0000","last_active":"2023-12-13T22:56:14.934789+0000","last_peered":"2023-12-13T22:56:14.934789+0000","last_clean":"2023-12-13T22:56:14.934789+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:56:14.934789+0000","last_undegraded":"2023-12-13T22:56:14.934789+0000","last_fullsized":"2023-12-13T22:56:14.934789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.934537+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:02.135767+0000","scrub_duration":0.0038170019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'253","reported_seq":450,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.928398+0000","last_change":"2023-12-13T22:55:54.928461+0000","last_active":"2023-12-13T22:55:54.928398+0000","last_peered":"2023-12-13T22:55:54.928398+0000","last_clean":"2023-12-13T22:55:54.928398+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:54.928398+0000","last_undegraded":"2023-12-13T22:55:54.928398+0000","last_fullsized":"2023-12-13T22:55:54.928398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'253","last_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_deep_scrub":"31'253","last_deep_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.928226+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:21:19.453012+0000","scrub_duration":0.0082018130000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:33.615892+0000","last_change":"2023-12-13T22:56:33.615946+0000","last_active":"2023-12-13T22:56:33.615892+0000","last_peered":"2023-12-13T22:56:33.615892+0000","last_clean":"2023-12-13T22:56:33.615892+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:56:33.615892+0000","last_undegraded":"2023-12-13T22:56:33.615892+0000","last_fullsized":"2023-12-13T22:56:33.615892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:33.615691+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:33.615691+0000","last_clean_scrub_stamp":"2023-12-13T22:56:33.615691+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:17:20.159544+0000","scrub_duration":0.006863264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.423054+0000","last_change":"2023-12-13T22:55:52.423106+0000","last_active":"2023-12-13T22:55:52.423054+0000","last_peered":"2023-12-13T22:55:52.423054+0000","last_clean":"2023-12-13T22:55:52.423054+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:52.423054+0000","last_undegraded":"2023-12-13T22:55:52.423054+0000","last_fullsized":"2023-12-13T22:55:52.423054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.422920+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:03:02.820205+0000","scrub_duration":0.0018780209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.989925+0000","last_change":"2023-12-13T22:55:58.989925+0000","last_active":"2023-12-13T22:55:58.989925+0000","last_peered":"2023-12-13T22:55:58.989925+0000","last_clean":"2023-12-13T22:55:58.989925+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:55:58.989925+0000","last_undegraded":"2023-12-13T22:55:58.989925+0000","last_fullsized":"2023-12-13T22:55:58.989925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.989650+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:05.695391+0000","scrub_duration":0.0073674609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.410712+0000","last_change":"2023-12-13T22:56:14.410712+0000","last_active":"2023-12-13T22:56:14.410712+0000","last_peered":"2023-12-13T22:56:14.410712+0000","last_clean":"2023-12-13T22:56:14.410712+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:56:14.410712+0000","last_undegraded":"2023-12-13T22:56:14.410712+0000","last_fullsized":"2023-12-13T22:56:14.410712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.410460+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:15:01.401860+0000","scrub_duration":0.004314399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.155911+0000","last_change":"2023-12-13T22:56:17.155963+0000","last_active":"2023-12-13T22:56:17.155911+0000","last_peered":"2023-12-13T22:56:17.155911+0000","last_clean":"2023-12-13T22:56:17.155911+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:56:17.155911+0000","last_undegraded":"2023-12-13T22:56:17.155911+0000","last_fullsized":"2023-12-13T22:56:17.155911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.155741+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:10.405334+0000","scrub_duration":0.0030467839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.359601+0000","last_change":"2023-12-13T22:55:52.359631+0000","last_active":"2023-12-13T22:55:52.359601+0000","last_peered":"2023-12-13T22:55:52.359601+0000","last_clean":"2023-12-13T22:55:52.359601+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:52.359601+0000","last_undegraded":"2023-12-13T22:55:52.359601+0000","last_fullsized":"2023-12-13T22:55:52.359601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.359516+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:37.445461+0000","scrub_duration":0.0062306879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.936095+0000","last_change":"2023-12-13T22:55:54.936170+0000","last_active":"2023-12-13T22:55:54.936095+0000","last_peered":"2023-12-13T22:55:54.936095+0000","last_clean":"2023-12-13T22:55:54.936095+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:55:54.936095+0000","last_undegraded":"2023-12-13T22:55:54.936095+0000","last_fullsized":"2023-12-13T22:55:54.936095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.935901+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:40.021847+0000","scrub_duration":0.011317162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:22.599238+0000","last_change":"2023-12-13T22:26:06.557330+0000","last_active":"2023-12-13T22:55:22.599238+0000","last_peered":"2023-12-13T22:55:22.599238+0000","last_clean":"2023-12-13T22:55:22.599238+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:55:22.599238+0000","last_undegraded":"2023-12-13T22:55:22.599238+0000","last_fullsized":"2023-12-13T22:55:22.599238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:30.007729+0000","last_change":"2023-12-13T22:56:30.007834+0000","last_active":"2023-12-13T22:56:30.007729+0000","last_peered":"2023-12-13T22:56:30.007729+0000","last_clean":"2023-12-13T22:56:30.007729+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:56:30.007729+0000","last_undegraded":"2023-12-13T22:56:30.007729+0000","last_fullsized":"2023-12-13T22:56:30.007729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_clean_scrub_stamp":"2023-12-13T22:56:30.007437+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:00.924051+0000","scrub_duration":0.0034788699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.779403+0000","last_change":"2023-12-13T22:56:00.779462+0000","last_active":"2023-12-13T22:56:00.779403+0000","last_peered":"2023-12-13T22:56:00.779403+0000","last_clean":"2023-12-13T22:56:00.779403+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:56:00.779403+0000","last_undegraded":"2023-12-13T22:56:00.779403+0000","last_fullsized":"2023-12-13T22:56:00.779403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.779224+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:55:53.386922+0000","scrub_duration":0.0076204089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.142864+0000","last_change":"2023-12-13T22:26:06.552979+0000","last_active":"2023-12-13T22:55:52.142864+0000","last_peered":"2023-12-13T22:55:52.142864+0000","last_clean":"2023-12-13T22:55:52.142864+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:55:52.142864+0000","last_undegraded":"2023-12-13T22:55:52.142864+0000","last_fullsized":"2023-12-13T22:55:52.142864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.366939+0000","last_change":"2023-12-13T22:55:51.367028+0000","last_active":"2023-12-13T22:55:51.366939+0000","last_peered":"2023-12-13T22:55:51.366939+0000","last_clean":"2023-12-13T22:55:51.366939+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:51.366939+0000","last_undegraded":"2023-12-13T22:55:51.366939+0000","last_fullsized":"2023-12-13T22:55:51.366939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.366729+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:41:58.469140+0000","scrub_duration":0.0033407179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.895758+0000","last_change":"2023-12-13T22:56:04.895812+0000","last_active":"2023-12-13T22:56:04.895758+0000","last_peered":"2023-12-13T22:56:04.895758+0000","last_clean":"2023-12-13T22:56:04.895758+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:56:04.895758+0000","last_undegraded":"2023-12-13T22:56:04.895758+0000","last_fullsized":"2023-12-13T22:56:04.895758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.895573+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:29.086931+0000","scrub_duration":0.0061804989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.434836+0000","last_change":"2023-12-13T22:56:09.434895+0000","last_active":"2023-12-13T22:56:09.434836+0000","last_peered":"2023-12-13T22:56:09.434836+0000","last_clean":"2023-12-13T22:56:09.434836+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:56:09.434836+0000","last_undegraded":"2023-12-13T22:56:09.434836+0000","last_fullsized":"2023-12-13T22:56:09.434836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.434626+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:11:58.367162+0000","scrub_duration":0.0066969239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:35.543919+0000","last_change":"2023-12-13T22:26:00.420565+0000","last_active":"2023-12-13T22:55:35.543919+0000","last_peered":"2023-12-13T22:55:35.543919+0000","last_clean":"2023-12-13T22:55:35.543919+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:55:35.543919+0000","last_undegraded":"2023-12-13T22:55:35.543919+0000","last_fullsized":"2023-12-13T22:55:35.543919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:25:57.303059+0000","last_clean_scrub_stamp":"2023-12-13T22:25:57.303059+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'5","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.901897+0000","last_change":"2023-12-13T22:55:51.901953+0000","last_active":"2023-12-13T22:55:51.901897+0000","last_peered":"2023-12-13T22:55:51.901897+0000","last_clean":"2023-12-13T22:55:51.901897+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:55:51.901897+0000","last_undegraded":"2023-12-13T22:55:51.901897+0000","last_fullsized":"2023-12-13T22:55:51.901897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.901720+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:54:32.031652+0000","scrub_duration":0.0054560959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.403393+0000","last_change":"2023-12-13T22:56:18.403393+0000","last_active":"2023-12-13T22:56:18.403393+0000","last_peered":"2023-12-13T22:56:18.403393+0000","last_clean":"2023-12-13T22:56:18.403393+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:56:18.403393+0000","last_undegraded":"2023-12-13T22:56:18.403393+0000","last_fullsized":"2023-12-13T22:56:18.403393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'110","last_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_deep_scrub":"31'110","last_deep_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.403123+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:23.426054+0000","scrub_duration":0.0094199109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:42.473778+0000","last_change":"2023-12-13T22:56:42.473831+0000","last_active":"2023-12-13T22:56:42.473778+0000","last_peered":"2023-12-13T22:56:42.473778+0000","last_clean":"2023-12-13T22:56:42.473778+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:56:42.473778+0000","last_undegraded":"2023-12-13T22:56:42.473778+0000","last_fullsized":"2023-12-13T22:56:42.473778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:56:42.473572+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:56:42.473572+0000","last_clean_scrub_stamp":"2023-12-13T22:56:42.473572+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:13:43.795327+0000","scrub_duration":0.0032401830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'265","reported_seq":308,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.957704+0000","last_change":"2023-12-13T22:55:50.957847+0000","last_active":"2023-12-13T22:55:50.957704+0000","last_peered":"2023-12-13T22:55:50.957704+0000","last_clean":"2023-12-13T22:55:50.957704+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:50.957704+0000","last_undegraded":"2023-12-13T22:55:50.957704+0000","last_fullsized":"2023-12-13T22:55:50.957704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'265","last_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_deep_scrub":"31'265","last_deep_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.957478+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:05:25.538846+0000","scrub_duration":0.01053072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.731840+0000","last_change":"2023-12-13T22:56:12.731840+0000","last_active":"2023-12-13T22:56:12.731840+0000","last_peered":"2023-12-13T22:56:12.731840+0000","last_clean":"2023-12-13T22:56:12.731840+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:56:12.731840+0000","last_undegraded":"2023-12-13T22:56:12.731840+0000","last_fullsized":"2023-12-13T22:56:12.731840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.731398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:54.102853+0000","scrub_duration":0.0074439079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.912661+0000","last_change":"2023-12-13T22:55:53.912661+0000","last_active":"2023-12-13T22:55:53.912661+0000","last_peered":"2023-12-13T22:55:53.912661+0000","last_clean":"2023-12-13T22:55:53.912661+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:53.912661+0000","last_undegraded":"2023-12-13T22:55:53.912661+0000","last_fullsized":"2023-12-13T22:55:53.912661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.912416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:01.014828+0000","scrub_duration":0.002904542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'268","reported_seq":311,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.722659+0000","last_change":"2023-12-13T22:56:02.722659+0000","last_active":"2023-12-13T22:56:02.722659+0000","last_peered":"2023-12-13T22:56:02.722659+0000","last_clean":"2023-12-13T22:56:02.722659+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:56:02.722659+0000","last_undegraded":"2023-12-13T22:56:02.722659+0000","last_fullsized":"2023-12-13T22:56:02.722659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'268","last_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_deep_scrub":"31'268","last_deep_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.722401+0000","objects_scrubbed":8,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:57:04.531070+0000","scrub_duration":0.015955368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.424794+0000","last_change":"2023-12-13T22:56:11.424852+0000","last_active":"2023-12-13T22:56:11.424794+0000","last_peered":"2023-12-13T22:56:11.424794+0000","last_clean":"2023-12-13T22:56:11.424794+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:56:11.424794+0000","last_undegraded":"2023-12-13T22:56:11.424794+0000","last_fullsized":"2023-12-13T22:56:11.424794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.424585+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:00.237813+0000","scrub_duration":0.0064149180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.193654+0000","last_change":"2023-12-13T22:56:27.193813+0000","last_active":"2023-12-13T22:56:27.193654+0000","last_peered":"2023-12-13T22:56:27.193654+0000","last_clean":"2023-12-13T22:56:27.193654+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:56:27.193654+0000","last_undegraded":"2023-12-13T22:56:27.193654+0000","last_fullsized":"2023-12-13T22:56:27.193654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.193306+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:44.761451+0000","scrub_duration":0.0042190769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1021","reported_seq":1064,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.174135+0000","last_change":"2023-12-13T22:56:06.174135+0000","last_active":"2023-12-13T22:56:06.174135+0000","last_peered":"2023-12-13T22:56:06.174135+0000","last_clean":"2023-12-13T22:56:06.174135+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:56:06.174135+0000","last_undegraded":"2023-12-13T22:56:06.174135+0000","last_fullsized":"2023-12-13T22:56:06.174135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1021","last_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_deep_scrub":"31'1021","last_deep_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.173900+0000","objects_scrubbed":2,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:30.653912+0000","scrub_duration":0.027900313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:52.242282+0000","last_change":"2023-12-13T22:56:52.242339+0000","last_active":"2023-12-13T22:56:52.242282+0000","last_peered":"2023-12-13T22:56:52.242282+0000","last_clean":"2023-12-13T22:56:52.242282+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:56:52.242282+0000","last_undegraded":"2023-12-13T22:56:52.242282+0000","last_fullsized":"2023-12-13T22:56:52.242282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-12-13T22:56:52.242066+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-12-13T22:56:52.242066+0000","last_clean_scrub_stamp":"2023-12-13T22:56:52.242066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:42.255631+0000","scrub_duration":0.0070539900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.000650+0000","last_change":"2023-12-13T22:56:24.000702+0000","last_active":"2023-12-13T22:56:24.000650+0000","last_peered":"2023-12-13T22:56:24.000650+0000","last_clean":"2023-12-13T22:56:24.000650+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:56:24.000650+0000","last_undegraded":"2023-12-13T22:56:24.000650+0000","last_fullsized":"2023-12-13T22:56:24.000650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.000443+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:37.900045+0000","scrub_duration":0.0024080159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.398798+0000","last_change":"2023-12-13T22:55:55.398798+0000","last_active":"2023-12-13T22:55:55.398798+0000","last_peered":"2023-12-13T22:55:55.398798+0000","last_clean":"2023-12-13T22:55:55.398798+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:55.398798+0000","last_undegraded":"2023-12-13T22:55:55.398798+0000","last_fullsized":"2023-12-13T22:55:55.398798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.398473+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:02.104213+0000","scrub_duration":0.0061603880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:47.177361+0000","last_change":"2023-12-13T22:56:47.177420+0000","last_active":"2023-12-13T22:56:47.177361+0000","last_peered":"2023-12-13T22:56:47.177361+0000","last_clean":"2023-12-13T22:56:47.177361+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:56:47.177361+0000","last_undegraded":"2023-12-13T22:56:47.177361+0000","last_fullsized":"2023-12-13T22:56:47.177361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-12-13T22:56:47.177160+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-12-13T22:56:47.177160+0000","last_clean_scrub_stamp":"2023-12-13T22:56:47.177160+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:06:07.871194+0000","scrub_duration":0.0074369700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.361680+0000","last_change":"2023-12-13T22:55:58.361680+0000","last_active":"2023-12-13T22:55:58.361680+0000","last_peered":"2023-12-13T22:55:58.361680+0000","last_clean":"2023-12-13T22:55:58.361680+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:58.361680+0000","last_undegraded":"2023-12-13T22:55:58.361680+0000","last_fullsized":"2023-12-13T22:55:58.361680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.361421+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:57:39.970158+0000","scrub_duration":0.003149827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'12","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.403251+0000","last_change":"2023-12-13T22:55:49.403251+0000","last_active":"2023-12-13T22:55:49.403251+0000","last_peered":"2023-12-13T22:55:49.403251+0000","last_clean":"2023-12-13T22:55:49.403251+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:55:49.403251+0000","last_undegraded":"2023-12-13T22:55:49.403251+0000","last_fullsized":"2023-12-13T22:55:49.403251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_clean_scrub_stamp":"2023-12-13T22:55:49.403136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:06:21.586077+0000","scrub_duration":0.0076955030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.349625+0000","last_change":"2023-12-13T22:56:22.349726+0000","last_active":"2023-12-13T22:56:22.349625+0000","last_peered":"2023-12-13T22:56:22.349625+0000","last_clean":"2023-12-13T22:56:22.349625+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:56:22.349625+0000","last_undegraded":"2023-12-13T22:56:22.349625+0000","last_fullsized":"2023-12-13T22:56:22.349625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.349410+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:35:11.433767+0000","scrub_duration":0.008386325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.006958+0000","last_change":"2023-12-13T22:56:25.007013+0000","last_active":"2023-12-13T22:56:25.006958+0000","last_peered":"2023-12-13T22:56:25.006958+0000","last_clean":"2023-12-13T22:56:25.006958+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:56:25.006958+0000","last_undegraded":"2023-12-13T22:56:25.006958+0000","last_fullsized":"2023-12-13T22:56:25.006958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.006764+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:46.182889+0000","scrub_duration":0.004328892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1187","reported_seq":1230,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.224878+0000","last_change":"2023-12-13T22:55:53.224878+0000","last_active":"2023-12-13T22:55:53.224878+0000","last_peered":"2023-12-13T22:55:53.224878+0000","last_clean":"2023-12-13T22:55:53.224878+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:53.224878+0000","last_undegraded":"2023-12-13T22:55:53.224878+0000","last_fullsized":"2023-12-13T22:55:53.224878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1187","last_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_deep_scrub":"31'1187","last_deep_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.224528+0000","objects_scrubbed":5,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:15:59.076548+0000","scrub_duration":0.029787111000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.822613+0000","last_change":"2023-12-13T22:56:24.822613+0000","last_active":"2023-12-13T22:56:24.822613+0000","last_peered":"2023-12-13T22:56:24.822613+0000","last_clean":"2023-12-13T22:56:24.822613+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:56:24.822613+0000","last_undegraded":"2023-12-13T22:56:24.822613+0000","last_fullsized":"2023-12-13T22:56:24.822613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.822281+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:20.279273+0000","scrub_duration":0.0075375160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:56.934053+0000","last_change":"2023-12-13T22:55:56.934053+0000","last_active":"2023-12-13T22:55:56.934053+0000","last_peered":"2023-12-13T22:55:56.934053+0000","last_clean":"2023-12-13T22:55:56.934053+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:56.934053+0000","last_undegraded":"2023-12-13T22:55:56.934053+0000","last_fullsized":"2023-12-13T22:55:56.934053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_clean_scrub_stamp":"2023-12-13T22:55:56.933891+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:27:43.656236+0000","scrub_duration":0.002368658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'130","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.782407+0000","last_change":"2023-12-13T22:55:59.782469+0000","last_active":"2023-12-13T22:55:59.782407+0000","last_peered":"2023-12-13T22:55:59.782407+0000","last_clean":"2023-12-13T22:55:59.782407+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:59.782407+0000","last_undegraded":"2023-12-13T22:55:59.782407+0000","last_fullsized":"2023-12-13T22:55:59.782407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'130","last_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_deep_scrub":"31'130","last_deep_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.782224+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:14.537967+0000","scrub_duration":0.0092044889999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.752082+0000","last_change":"2023-12-13T22:56:06.752082+0000","last_active":"2023-12-13T22:56:06.752082+0000","last_peered":"2023-12-13T22:56:06.752082+0000","last_clean":"2023-12-13T22:56:06.752082+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:56:06.752082+0000","last_undegraded":"2023-12-13T22:56:06.752082+0000","last_fullsized":"2023-12-13T22:56:06.752082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.751811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:52.144373+0000","scrub_duration":0.0073970829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.446914+0000","last_change":"2023-12-13T22:56:07.446965+0000","last_active":"2023-12-13T22:56:07.446914+0000","last_peered":"2023-12-13T22:56:07.446914+0000","last_clean":"2023-12-13T22:56:07.446914+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:56:07.446914+0000","last_undegraded":"2023-12-13T22:56:07.446914+0000","last_fullsized":"2023-12-13T22:56:07.446914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.446725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:18:14.638863+0000","scrub_duration":0.0036426369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.377308+0000","last_change":"2023-12-13T22:55:53.377429+0000","last_active":"2023-12-13T22:55:53.377308+0000","last_peered":"2023-12-13T22:55:53.377308+0000","last_clean":"2023-12-13T22:55:53.377308+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:53.377308+0000","last_undegraded":"2023-12-13T22:55:53.377308+0000","last_fullsized":"2023-12-13T22:55:53.377308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.377020+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:08.132763+0000","scrub_duration":0.0054373049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:45.186045+0000","last_change":"2023-12-13T22:56:45.186165+0000","last_active":"2023-12-13T22:56:45.186045+0000","last_peered":"2023-12-13T22:56:45.186045+0000","last_clean":"2023-12-13T22:56:45.186045+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:56:45.186045+0000","last_undegraded":"2023-12-13T22:56:45.186045+0000","last_fullsized":"2023-12-13T22:56:45.186045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-12-13T22:56:45.185811+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-12-13T22:56:45.185811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:45.185811+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:48:34.091715+0000","scrub_duration":0.010774687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.471767+0000","last_change":"2023-12-13T22:56:06.471822+0000","last_active":"2023-12-13T22:56:06.471767+0000","last_peered":"2023-12-13T22:56:06.471767+0000","last_clean":"2023-12-13T22:56:06.471767+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:56:06.471767+0000","last_undegraded":"2023-12-13T22:56:06.471767+0000","last_fullsized":"2023-12-13T22:56:06.471767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.471493+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:53.672723+0000","scrub_duration":0.0040682790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'92","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.175160+0000","last_change":"2023-12-13T22:56:11.175209+0000","last_active":"2023-12-13T22:56:11.175160+0000","last_peered":"2023-12-13T22:56:11.175160+0000","last_clean":"2023-12-13T22:56:11.175160+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:56:11.175160+0000","last_undegraded":"2023-12-13T22:56:11.175160+0000","last_fullsized":"2023-12-13T22:56:11.175160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'92","last_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_deep_scrub":"31'92","last_deep_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.175043+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:40.382392+0000","scrub_duration":0.0069995819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.116512+0000","last_change":"2023-12-13T22:56:27.116512+0000","last_active":"2023-12-13T22:56:27.116512+0000","last_peered":"2023-12-13T22:56:27.116512+0000","last_clean":"2023-12-13T22:56:27.116512+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:56:27.116512+0000","last_undegraded":"2023-12-13T22:56:27.116512+0000","last_fullsized":"2023-12-13T22:56:27.116512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.116244+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:39:45.231694+0000","scrub_duration":0.0073969650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.461548+0000","last_change":"2023-12-13T22:56:10.461606+0000","last_active":"2023-12-13T22:56:10.461548+0000","last_peered":"2023-12-13T22:56:10.461548+0000","last_clean":"2023-12-13T22:56:10.461548+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:56:10.461548+0000","last_undegraded":"2023-12-13T22:56:10.461548+0000","last_fullsized":"2023-12-13T22:56:10.461548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.461318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:05:24.742614+0000","scrub_duration":0.007727856,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.617154+0000","last_change":"2023-12-13T22:55:47.617203+0000","last_active":"2023-12-13T22:55:47.617154+0000","last_peered":"2023-12-13T22:55:47.617154+0000","last_clean":"2023-12-13T22:55:47.617154+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:47.617154+0000","last_undegraded":"2023-12-13T22:55:47.617154+0000","last_fullsized":"2023-12-13T22:55:47.617154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_clean_scrub_stamp":"2023-12-13T22:55:47.617039+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:57.072541+0000","scrub_duration":0.0027396679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.453354+0000","last_change":"2023-12-13T22:56:01.453406+0000","last_active":"2023-12-13T22:56:01.453354+0000","last_peered":"2023-12-13T22:56:01.453354+0000","last_clean":"2023-12-13T22:56:01.453354+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:56:01.453354+0000","last_undegraded":"2023-12-13T22:56:01.453354+0000","last_fullsized":"2023-12-13T22:56:01.453354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.453158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:13.446611+0000","scrub_duration":0.0027122370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:17.598315+0000","last_change":"2023-12-13T22:26:05.936561+0000","last_active":"2023-12-13T22:55:17.598315+0000","last_peered":"2023-12-13T22:55:17.598315+0000","last_clean":"2023-12-13T22:55:17.598315+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:55:17.598315+0000","last_undegraded":"2023-12-13T22:55:17.598315+0000","last_fullsized":"2023-12-13T22:55:17.598315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-13T22:26:04.150627+0000","last_clean_scrub_stamp":"2023-12-13T22:26:04.150627+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.131057+0000","last_change":"2023-12-13T22:56:25.131109+0000","last_active":"2023-12-13T22:56:25.131057+0000","last_peered":"2023-12-13T22:56:25.131057+0000","last_clean":"2023-12-13T22:56:25.131057+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:56:25.131057+0000","last_undegraded":"2023-12-13T22:56:25.131057+0000","last_fullsized":"2023-12-13T22:56:25.131057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.130834+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:47:07.106327+0000","scrub_duration":0.0032470709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'211","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.108706+0000","last_change":"2023-12-13T22:56:02.108772+0000","last_active":"2023-12-13T22:56:02.108706+0000","last_peered":"2023-12-13T22:56:02.108706+0000","last_clean":"2023-12-13T22:56:02.108706+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:56:02.108706+0000","last_undegraded":"2023-12-13T22:56:02.108706+0000","last_fullsized":"2023-12-13T22:56:02.108706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.108492+0000","objects_scrubbed":2,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:43.479948+0000","scrub_duration":0.0095572120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'307","reported_seq":645,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.204092+0000","last_change":"2023-12-13T22:56:15.204157+0000","last_active":"2023-12-13T22:56:15.204092+0000","last_peered":"2023-12-13T22:56:15.204092+0000","last_clean":"2023-12-13T22:56:15.204092+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:56:15.204092+0000","last_undegraded":"2023-12-13T22:56:15.204092+0000","last_fullsized":"2023-12-13T22:56:15.204092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'307","last_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_deep_scrub":"31'307","last_deep_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.203889+0000","objects_scrubbed":2,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:27.197342+0000","scrub_duration":0.0078670609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.377972+0000","last_change":"2023-12-13T22:55:51.377972+0000","last_active":"2023-12-13T22:55:51.377972+0000","last_peered":"2023-12-13T22:55:51.377972+0000","last_clean":"2023-12-13T22:55:51.377972+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:51.377972+0000","last_undegraded":"2023-12-13T22:55:51.377972+0000","last_fullsized":"2023-12-13T22:55:51.377972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.377829+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:25:56.812795+0000","scrub_duration":0.002123673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.728227+0000","last_change":"2023-12-13T22:56:12.728337+0000","last_active":"2023-12-13T22:56:12.728227+0000","last_peered":"2023-12-13T22:56:12.728227+0000","last_clean":"2023-12-13T22:56:12.728227+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:56:12.728227+0000","last_undegraded":"2023-12-13T22:56:12.728227+0000","last_fullsized":"2023-12-13T22:56:12.728227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.727919+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:31:35.351976+0000","scrub_duration":0.0075005030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2405","reported_seq":2447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.130328+0000","last_change":"2023-12-13T22:56:01.130400+0000","last_active":"2023-12-13T22:56:01.130328+0000","last_peered":"2023-12-13T22:56:01.130328+0000","last_clean":"2023-12-13T22:56:01.130328+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:56:01.130328+0000","last_undegraded":"2023-12-13T22:56:01.130328+0000","last_fullsized":"2023-12-13T22:56:01.130328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2405","last_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_deep_scrub":"31'2405","last_deep_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.130136+0000","objects_scrubbed":4,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:22:59.381743+0000","scrub_duration":0.058223199000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.925504+0000","last_change":"2023-12-13T22:55:55.925504+0000","last_active":"2023-12-13T22:55:55.925504+0000","last_peered":"2023-12-13T22:55:55.925504+0000","last_clean":"2023-12-13T22:55:55.925504+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:55.925504+0000","last_undegraded":"2023-12-13T22:55:55.925504+0000","last_fullsized":"2023-12-13T22:55:55.925504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.925325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:05.665814+0000","scrub_duration":0.003351882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:51.235379+0000","last_change":"2023-12-13T22:56:51.235505+0000","last_active":"2023-12-13T22:56:51.235379+0000","last_peered":"2023-12-13T22:56:51.235379+0000","last_clean":"2023-12-13T22:56:51.235379+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:56:51.235379+0000","last_undegraded":"2023-12-13T22:56:51.235379+0000","last_fullsized":"2023-12-13T22:56:51.235379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-12-13T22:56:51.235046+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-12-13T22:56:51.235046+0000","last_clean_scrub_stamp":"2023-12-13T22:56:51.235046+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:24:54.402322+0000","scrub_duration":0.010183459000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.141163+0000","last_change":"2023-12-13T22:56:17.141276+0000","last_active":"2023-12-13T22:56:17.141163+0000","last_peered":"2023-12-13T22:56:17.141163+0000","last_clean":"2023-12-13T22:56:17.141163+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:56:17.141163+0000","last_undegraded":"2023-12-13T22:56:17.141163+0000","last_fullsized":"2023-12-13T22:56:17.141163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.140931+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:41.360729+0000","scrub_duration":0.0032991119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.686736+0000","last_change":"2023-12-13T22:56:06.686792+0000","last_active":"2023-12-13T22:56:06.686736+0000","last_peered":"2023-12-13T22:56:06.686736+0000","last_clean":"2023-12-13T22:56:06.686736+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:56:06.686736+0000","last_undegraded":"2023-12-13T22:56:06.686736+0000","last_fullsized":"2023-12-13T22:56:06.686736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.686540+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:12.538560+0000","scrub_duration":0.0033057130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.437283+0000","last_change":"2023-12-13T22:56:15.437335+0000","last_active":"2023-12-13T22:56:15.437283+0000","last_peered":"2023-12-13T22:56:15.437283+0000","last_clean":"2023-12-13T22:56:15.437283+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:56:15.437283+0000","last_undegraded":"2023-12-13T22:56:15.437283+0000","last_fullsized":"2023-12-13T22:56:15.437283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.437095+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:36.613220+0000","scrub_duration":0.0030693510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.371452+0000","last_change":"2023-12-13T22:56:05.371573+0000","last_active":"2023-12-13T22:56:05.371452+0000","last_peered":"2023-12-13T22:56:05.371452+0000","last_clean":"2023-12-13T22:56:05.371452+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:56:05.371452+0000","last_undegraded":"2023-12-13T22:56:05.371452+0000","last_fullsized":"2023-12-13T22:56:05.371452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.371135+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:26:38.933074+0000","scrub_duration":0.003783182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.973818+0000","last_change":"2023-12-13T22:55:51.973818+0000","last_active":"2023-12-13T22:55:51.973818+0000","last_peered":"2023-12-13T22:55:51.973818+0000","last_clean":"2023-12-13T22:55:51.973818+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:51.973818+0000","last_undegraded":"2023-12-13T22:55:51.973818+0000","last_fullsized":"2023-12-13T22:55:51.973818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.973584+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:03.967036+0000","scrub_duration":0.0031747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:38.539396+0000","last_change":"2023-12-13T22:56:38.539449+0000","last_active":"2023-12-13T22:56:38.539396+0000","last_peered":"2023-12-13T22:56:38.539396+0000","last_clean":"2023-12-13T22:56:38.539396+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:56:38.539396+0000","last_undegraded":"2023-12-13T22:56:38.539396+0000","last_fullsized":"2023-12-13T22:56:38.539396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-12-13T22:56:38.539201+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-12-13T22:56:38.539201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:38.539201+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:51.814917+0000","scrub_duration":0.0029796639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:51.132282+0000","last_change":"2023-12-13T22:56:51.132336+0000","last_active":"2023-12-13T22:56:51.132282+0000","last_peered":"2023-12-13T22:56:51.132282+0000","last_clean":"2023-12-13T22:56:51.132282+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:56:51.132282+0000","last_undegraded":"2023-12-13T22:56:51.132282+0000","last_fullsized":"2023-12-13T22:56:51.132282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:56:51.132088+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:56:51.132088+0000","last_clean_scrub_stamp":"2023-12-13T22:56:51.132088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:56.155019+0000","scrub_duration":0.0028821760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.094675+0000","last_change":"2023-12-13T22:55:59.094675+0000","last_active":"2023-12-13T22:55:59.094675+0000","last_peered":"2023-12-13T22:55:59.094675+0000","last_clean":"2023-12-13T22:55:59.094675+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:59.094675+0000","last_undegraded":"2023-12-13T22:55:59.094675+0000","last_fullsized":"2023-12-13T22:55:59.094675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.094434+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:46.295665+0000","scrub_duration":0.004669416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.444743+0000","last_change":"2023-12-13T22:56:03.444743+0000","last_active":"2023-12-13T22:56:03.444743+0000","last_peered":"2023-12-13T22:56:03.444743+0000","last_clean":"2023-12-13T22:56:03.444743+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:56:03.444743+0000","last_undegraded":"2023-12-13T22:56:03.444743+0000","last_fullsized":"2023-12-13T22:56:03.444743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.444479+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:27.664278+0000","scrub_duration":0.0038001070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.060063+0000","last_change":"2023-12-13T22:56:12.060115+0000","last_active":"2023-12-13T22:56:12.060063+0000","last_peered":"2023-12-13T22:56:12.060063+0000","last_clean":"2023-12-13T22:56:12.060063+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:12.060063+0000","last_undegraded":"2023-12-13T22:56:12.060063+0000","last_fullsized":"2023-12-13T22:56:12.060063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.059861+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:58.603714+0000","scrub_duration":0.0032058569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.404719+0000","last_change":"2023-12-13T22:56:17.404772+0000","last_active":"2023-12-13T22:56:17.404719+0000","last_peered":"2023-12-13T22:56:17.404719+0000","last_clean":"2023-12-13T22:56:17.404719+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:56:17.404719+0000","last_undegraded":"2023-12-13T22:56:17.404719+0000","last_fullsized":"2023-12-13T22:56:17.404719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.404502+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:57.947441+0000","scrub_duration":0.0028916459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.419542+0000","last_change":"2023-12-13T22:56:08.419598+0000","last_active":"2023-12-13T22:56:08.419542+0000","last_peered":"2023-12-13T22:56:08.419542+0000","last_clean":"2023-12-13T22:56:08.419542+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:56:08.419542+0000","last_undegraded":"2023-12-13T22:56:08.419542+0000","last_fullsized":"2023-12-13T22:56:08.419542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.419342+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:30:31.998132+0000","scrub_duration":0.0036186209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:29.143708+0000","last_change":"2023-12-13T22:56:29.143762+0000","last_active":"2023-12-13T22:56:29.143708+0000","last_peered":"2023-12-13T22:56:29.143708+0000","last_clean":"2023-12-13T22:56:29.143708+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:56:29.143708+0000","last_undegraded":"2023-12-13T22:56:29.143708+0000","last_fullsized":"2023-12-13T22:56:29.143708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_clean_scrub_stamp":"2023-12-13T22:56:29.143490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:27.395097+0000","scrub_duration":0.002849107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:35.035831+0000","last_change":"2023-12-13T22:56:35.035939+0000","last_active":"2023-12-13T22:56:35.035831+0000","last_peered":"2023-12-13T22:56:35.035831+0000","last_clean":"2023-12-13T22:56:35.035831+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:56:35.035831+0000","last_undegraded":"2023-12-13T22:56:35.035831+0000","last_fullsized":"2023-12-13T22:56:35.035831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:56:35.035600+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:56:35.035600+0000","last_clean_scrub_stamp":"2023-12-13T22:56:35.035600+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:28.285193+0000","scrub_duration":0.00386243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.714541+0000","last_change":"2023-12-13T22:56:05.714541+0000","last_active":"2023-12-13T22:56:05.714541+0000","last_peered":"2023-12-13T22:56:05.714541+0000","last_clean":"2023-12-13T22:56:05.714541+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:56:05.714541+0000","last_undegraded":"2023-12-13T22:56:05.714541+0000","last_fullsized":"2023-12-13T22:56:05.714541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.714201+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:34:46.397683+0000","scrub_duration":0.0032594479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.791895+0000","last_change":"2023-12-13T22:56:23.792009+0000","last_active":"2023-12-13T22:56:23.791895+0000","last_peered":"2023-12-13T22:56:23.791895+0000","last_clean":"2023-12-13T22:56:23.791895+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:56:23.791895+0000","last_undegraded":"2023-12-13T22:56:23.791895+0000","last_fullsized":"2023-12-13T22:56:23.791895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.791658+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:30:19.976664+0000","scrub_duration":0.0052480870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.447837+0000","last_change":"2023-12-13T22:56:04.447837+0000","last_active":"2023-12-13T22:56:04.447837+0000","last_peered":"2023-12-13T22:56:04.447837+0000","last_clean":"2023-12-13T22:56:04.447837+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:56:04.447837+0000","last_undegraded":"2023-12-13T22:56:04.447837+0000","last_fullsized":"2023-12-13T22:56:04.447837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.447580+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:45.101318+0000","scrub_duration":0.0029573310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.932165+0000","last_change":"2023-12-13T22:56:15.932165+0000","last_active":"2023-12-13T22:56:15.932165+0000","last_peered":"2023-12-13T22:56:15.932165+0000","last_clean":"2023-12-13T22:56:15.932165+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:56:15.932165+0000","last_undegraded":"2023-12-13T22:56:15.932165+0000","last_fullsized":"2023-12-13T22:56:15.932165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.931903+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:33.500048+0000","scrub_duration":0.0045191739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.425498+0000","last_change":"2023-12-13T22:55:46.425498+0000","last_active":"2023-12-13T22:55:46.425498+0000","last_peered":"2023-12-13T22:55:46.425498+0000","last_clean":"2023-12-13T22:55:46.425498+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:46.425498+0000","last_undegraded":"2023-12-13T22:55:46.425498+0000","last_fullsized":"2023-12-13T22:55:46.425498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_clean_scrub_stamp":"2023-12-13T22:55:46.425334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:25:04.502584+0000","scrub_duration":0.0031700270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.045257+0000","last_change":"2023-12-13T22:55:55.045309+0000","last_active":"2023-12-13T22:55:55.045257+0000","last_peered":"2023-12-13T22:55:55.045257+0000","last_clean":"2023-12-13T22:55:55.045257+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:55.045257+0000","last_undegraded":"2023-12-13T22:55:55.045257+0000","last_fullsized":"2023-12-13T22:55:55.045257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.045057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:19.264855+0000","scrub_duration":0.0059794330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.814231+0000","last_change":"2023-12-13T22:56:00.814334+0000","last_active":"2023-12-13T22:56:00.814231+0000","last_peered":"2023-12-13T22:56:00.814231+0000","last_clean":"2023-12-13T22:56:00.814231+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:56:00.814231+0000","last_undegraded":"2023-12-13T22:56:00.814231+0000","last_fullsized":"2023-12-13T22:56:00.814231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.814016+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:25.005375+0000","scrub_duration":0.0031933970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:32.107940+0000","last_change":"2023-12-13T22:56:32.107990+0000","last_active":"2023-12-13T22:56:32.107940+0000","last_peered":"2023-12-13T22:56:32.107940+0000","last_clean":"2023-12-13T22:56:32.107940+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:56:32.107940+0000","last_undegraded":"2023-12-13T22:56:32.107940+0000","last_fullsized":"2023-12-13T22:56:32.107940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_clean_scrub_stamp":"2023-12-13T22:56:32.107754+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:13.479210+0000","scrub_duration":0.0060879649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:41.162939+0000","last_change":"2023-12-13T22:56:41.163043+0000","last_active":"2023-12-13T22:56:41.162939+0000","last_peered":"2023-12-13T22:56:41.162939+0000","last_clean":"2023-12-13T22:56:41.162939+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:56:41.162939+0000","last_undegraded":"2023-12-13T22:56:41.162939+0000","last_fullsized":"2023-12-13T22:56:41.162939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:41.162635+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:41.162635+0000","last_clean_scrub_stamp":"2023-12-13T22:56:41.162635+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:09:02.338760+0000","scrub_duration":0.0038309170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:49.090328+0000","last_change":"2023-12-13T22:56:49.090436+0000","last_active":"2023-12-13T22:56:49.090328+0000","last_peered":"2023-12-13T22:56:49.090328+0000","last_clean":"2023-12-13T22:56:49.090328+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:56:49.090328+0000","last_undegraded":"2023-12-13T22:56:49.090328+0000","last_fullsized":"2023-12-13T22:56:49.090328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:49.090081+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:49.090081+0000","last_clean_scrub_stamp":"2023-12-13T22:56:49.090081+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:13:50.411837+0000","scrub_duration":0.0036323039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.166004+0000","last_change":"2023-12-13T22:56:18.166056+0000","last_active":"2023-12-13T22:56:18.166004+0000","last_peered":"2023-12-13T22:56:18.166004+0000","last_clean":"2023-12-13T22:56:18.166004+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:18.166004+0000","last_undegraded":"2023-12-13T22:56:18.166004+0000","last_fullsized":"2023-12-13T22:56:18.166004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.165819+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:52:05.012128+0000","scrub_duration":0.0031531789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.953679+0000","last_change":"2023-12-13T22:56:14.953804+0000","last_active":"2023-12-13T22:56:14.953679+0000","last_peered":"2023-12-13T22:56:14.953679+0000","last_clean":"2023-12-13T22:56:14.953679+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:56:14.953679+0000","last_undegraded":"2023-12-13T22:56:14.953679+0000","last_fullsized":"2023-12-13T22:56:14.953679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.953450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:18:06.958901+0000","scrub_duration":0.0034872829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.746354+0000","last_change":"2023-12-13T22:56:15.746406+0000","last_active":"2023-12-13T22:56:15.746354+0000","last_peered":"2023-12-13T22:56:15.746354+0000","last_clean":"2023-12-13T22:56:15.746354+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:56:15.746354+0000","last_undegraded":"2023-12-13T22:56:15.746354+0000","last_fullsized":"2023-12-13T22:56:15.746354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.746151+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:30.501894+0000","scrub_duration":0.0031168839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.011702+0000","last_change":"2023-12-13T22:56:22.011755+0000","last_active":"2023-12-13T22:56:22.011702+0000","last_peered":"2023-12-13T22:56:22.011702+0000","last_clean":"2023-12-13T22:56:22.011702+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:56:22.011702+0000","last_undegraded":"2023-12-13T22:56:22.011702+0000","last_fullsized":"2023-12-13T22:56:22.011702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.011507+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:03.382963+0000","scrub_duration":0.0049321959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.390246+0000","last_change":"2023-12-13T22:56:08.390301+0000","last_active":"2023-12-13T22:56:08.390246+0000","last_peered":"2023-12-13T22:56:08.390246+0000","last_clean":"2023-12-13T22:56:08.390246+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:56:08.390246+0000","last_undegraded":"2023-12-13T22:56:08.390246+0000","last_fullsized":"2023-12-13T22:56:08.390246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.390048+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:06.641655+0000","scrub_duration":0.0035378689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.329893+0000","last_change":"2023-12-13T22:56:00.329949+0000","last_active":"2023-12-13T22:56:00.329893+0000","last_peered":"2023-12-13T22:56:00.329893+0000","last_clean":"2023-12-13T22:56:00.329893+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:56:00.329893+0000","last_undegraded":"2023-12-13T22:56:00.329893+0000","last_fullsized":"2023-12-13T22:56:00.329893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.329685+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:23:06.433638+0000","scrub_duration":0.003895417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.885365+0000","last_change":"2023-12-13T22:56:20.885454+0000","last_active":"2023-12-13T22:56:20.885365+0000","last_peered":"2023-12-13T22:56:20.885365+0000","last_clean":"2023-12-13T22:56:20.885365+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:56:20.885365+0000","last_undegraded":"2023-12-13T22:56:20.885365+0000","last_fullsized":"2023-12-13T22:56:20.885365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.885143+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:19.136750+0000","scrub_duration":0.0032445460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:44.092087+0000","last_change":"2023-12-13T22:56:44.092132+0000","last_active":"2023-12-13T22:56:44.092087+0000","last_peered":"2023-12-13T22:56:44.092087+0000","last_clean":"2023-12-13T22:56:44.092087+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:56:44.092087+0000","last_undegraded":"2023-12-13T22:56:44.092087+0000","last_fullsized":"2023-12-13T22:56:44.092087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:56:44.091933+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:56:44.091933+0000","last_clean_scrub_stamp":"2023-12-13T22:56:44.091933+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:57.367649+0000","scrub_duration":0.0052186139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8094,"ondisk_log_size":8094,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477121,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.873},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":1.3200000000000001,"5min":1.73,"15min":1.73},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.94099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":1.3859999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":0.90800000000000003}]},{"osd":1,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.91600000000000004},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.409,"5min":2.165,"15min":2.165},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.002,"15min":0.98699999999999999},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1910000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97099999999999997,"15min":0.97799999999999998},"min":{"1min":0.64800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2789999999999999,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0449999999999999,"15min":1.032},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.472,"5min":1.55,"15min":2.1269999999999998},"last":1.2330000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.73299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.3700000000000001,"15min":1.792},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.999,"15min":1.0209999999999999},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.478,"5min":1.496,"15min":1.821},"last":1.3839999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.76300000000000001,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.2170000000000001,"5min":1.847,"15min":1.8480000000000001},"last":1.153},{"interface":"front","average":{"1min":1.087,"5min":1.085,"15min":1.085},"min":{"1min":0.66900000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3779999999999999,"5min":1.464,"15min":1.8120000000000001},"last":1.1830000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0409999999999999,"15min":1.044},"min":{"1min":0.57999999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.575,"5min":1.575,"15min":2.21},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.127,"15min":1.111},"min":{"1min":0.79600000000000004,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.5089999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.617,"5min":2.056,"15min":2.0590000000000002},"last":1.3},{"interface":"front","average":{"1min":1.159,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.569,"5min":1.798,"15min":1.798},"last":1.2689999999999999}]}]},{"osd":6,"up_from":16,"seq":68719477121,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.345,"5min":1.454,"15min":2.1970000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.6419999999999999},"last":0.72799999999999998}]},{"osd":1,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.109,"5min":1.319,"15min":1.5109999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.002,"15min":1.006},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.218,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":0.79000000000000004}]},{"osd":2,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.01,"15min":1.026},"min":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.325,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.024,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.2909999999999999,"5min":1.506,"15min":1.8540000000000001},"last":1.137}]},{"osd":3,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.034,"15min":1.056},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.44800000000000001},"max":{"1min":1.2150000000000001,"5min":1.587,"15min":1.841},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.002,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.321,"5min":1.405,"15min":1.784},"last":1.018}]},{"osd":4,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0489999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.375},"max":{"1min":1.4159999999999999,"5min":1.6279999999999999,"15min":2.504},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6319999999999999,"15min":2.044},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.421,"5min":1.52,"15min":1.9239999999999999},"last":1.109},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44500000000000001},"max":{"1min":1.5,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.1639999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.1519999999999999,"15min":1.181},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3620000000000001,"5min":1.7569999999999999,"15min":2.956},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1200000000000001,"15min":1.165},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.2410000000000001,"5min":1.788,"15min":1.9350000000000001},"last":1.208}]}]},{"osd":5,"up_from":16,"seq":68719477121,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.57199999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2709999999999999,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.2030000000000001,"5min":1.4239999999999999,"15min":1.4750000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.56299999999999994,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.96899999999999997},"min":{"1min":0.65500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.369,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.002}]},{"osd":2,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.016,"15min":1.012},"min":{"1min":0.78600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3049999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.67300000000000004,"5min":0.48999999999999999,"15min":0.41499999999999998},"max":{"1min":1.25,"5min":1.3089999999999999,"15min":1.5009999999999999},"last":1.175}]},{"osd":3,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.98199999999999998,"15min":1.016},"min":{"1min":0.754,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.341,"5min":1.4770000000000001,"15min":1.5820000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0760000000000001,"15min":1.089},"min":{"1min":0.90100000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.1259999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3180000000000001,"5min":1.482,"15min":1.53},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.075,"15min":1.0680000000000001},"min":{"1min":0.86899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2959999999999998,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.036,"15min":1.0609999999999999},"min":{"1min":0.81100000000000005,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.387,"5min":1.873,"15min":1.873},"last":1.256},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0309999999999999,"15min":1.073},"min":{"1min":0.84699999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.349,"5min":1.55,"15min":1.8480000000000001},"last":1.0429999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":1.02,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.173,"15min":1.208},"min":{"1min":0.78800000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.49,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3169999999999999}]}]},{"osd":4,"up_from":16,"seq":68719477122,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.88900000000000001,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4630000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.88700000000000001,"15min":0.90800000000000003},"min":{"1min":0.61499999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.282,"5min":1.373,"15min":1.488},"last":1.089}]},{"osd":1,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.94999999999999996},"min":{"1min":0.59699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1200000000000001,"5min":1.75,"15min":1.75},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.97999999999999998,"15min":0.99199999999999999},"min":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.503},"max":{"1min":1.359,"5min":1.3959999999999999,"15min":1.831},"last":0.76200000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.95699999999999996,"15min":0.97399999999999998},"min":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.47199999999999998},"max":{"1min":1.347,"5min":1.3480000000000001,"15min":1.645},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0329999999999999,"15min":1.034},"min":{"1min":0.72399999999999998,"5min":0.64500000000000002,"15min":0.55500000000000005},"max":{"1min":1.23,"5min":1.5149999999999999,"15min":1.75},"last":1.0580000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.69899999999999995,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.629,"15min":1.639},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.099,"15min":1.1220000000000001},"min":{"1min":0.86599999999999999,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.371,"5min":1.5389999999999999,"15min":2.1070000000000002},"last":1.1559999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0229999999999999,"15min":1.014},"min":{"1min":0.48799999999999999,"5min":0.433,"15min":0.30599999999999999},"max":{"1min":1.5189999999999999,"5min":2.218,"15min":2.218},"last":1.125},{"interface":"front","average":{"1min":1.056,"5min":1.014,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.4099999999999999,"5min":1.5,"15min":1.643},"last":0.94599999999999995}]},{"osd":6,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0269999999999999,"15min":1.071},"min":{"1min":0.66700000000000004,"5min":0.55300000000000005,"15min":0.39100000000000001},"max":{"1min":1.345,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.143,"5min":1.165,"15min":1.1599999999999999},"min":{"1min":0.70699999999999996,"5min":0.55500000000000005,"15min":0.33800000000000002},"max":{"1min":1.575,"5min":2.137,"15min":2.137},"last":0.97599999999999998}]},{"osd":7,"last update":"Wed Dec 13 22:56:10 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1060000000000001,"15min":1.1200000000000001},"min":{"1min":0.73199999999999998,"5min":0.628,"15min":0.504},"max":{"1min":1.52,"5min":1.8049999999999999,"15min":1.857},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.1859999999999999,"15min":1.2090000000000001},"min":{"1min":0.749,"5min":0.58199999999999996,"15min":0.35599999999999998},"max":{"1min":1.7270000000000001,"5min":1.927,"15min":2.3079999999999998},"last":0.89500000000000002}]}]},{"osd":3,"up_from":16,"seq":68719477121,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.878,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":1.171,"5min":1.3149999999999999,"15min":1.524},"last":0.629}]},{"osd":1,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.23,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.264,"5min":1.3120000000000001,"15min":1.4379999999999999},"last":0.747}]},{"osd":2,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.3029999999999999,"15min":5.085},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.92800000000000005},"min":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.647,"15min":1.647},"last":0.89300000000000002}]},{"osd":4,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.53600000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.228,"5min":1.633,"15min":1.77},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.995,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.68200000000000005,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3700000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":1.2030000000000001}]},{"osd":5,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.72299999999999998,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.466,"5min":1.532,"15min":1.8400000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1539999999999999,"15min":1.173},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.38200000000000001},"max":{"1min":1.2689999999999999,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.016}]},{"osd":6,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2,"15min":1.202},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.47199999999999998},"max":{"1min":1.325,"5min":1.8149999999999999,"15min":2.181},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.121,"15min":1.1879999999999999},"min":{"1min":0.61099999999999999,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.337,"5min":1.7270000000000001,"15min":2.1230000000000002},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1539999999999999,"15min":1.2190000000000001},"min":{"1min":0.76400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3680000000000001,"5min":1.841,"15min":2.1779999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1519999999999999,"15min":1.1870000000000001},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.55600000000000005},"max":{"1min":1.5640000000000001,"5min":1.7909999999999999,"15min":1.948},"last":1.389}]}]},{"osd":1,"up_from":16,"seq":68719477122,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0940000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":0.98599999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.80900000000000005}]},{"osd":2,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.401,"15min":1.5580000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":0.85399999999999998},"min":{"1min":0.39100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.876,"15min":0.89700000000000002},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0149999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.308},"max":{"1min":1.111,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.095}]},{"osd":4,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.68000000000000005,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.2430000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.268},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2509999999999999,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":1.1679999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.67800000000000005,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.2350000000000001,"5min":1.629,"15min":1.6599999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.64100000000000001},"max":{"1min":1.528,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.071,"15min":1.109},"min":{"1min":0.65100000000000002,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.706,"15min":1.7649999999999999},"last":1.401},{"interface":"front","average":{"1min":1.069,"5min":1.161,"15min":1.202},"min":{"1min":0.85899999999999999,"5min":0.57099999999999995,"15min":0.501},"max":{"1min":1.585,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.0649999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.169},"min":{"1min":0.77600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4059999999999999,"5min":1.8,"15min":1.8520000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.78800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1990000000000001,"5min":2.774,"15min":2.774},"last":1.2130000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509824,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0760000000000001,"5min":1.24,"15min":2.8730000000000002},"last":0.497},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.45900000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.206,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.77500000000000002},"min":{"1min":0.53800000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0209999999999999,"5min":1.47,"15min":1.47},"last":0.752},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.85499999999999998,"15min":0.88300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.33500000000000002},"max":{"1min":1.0800000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.39000000000000001,"15min":0.29399999999999998},"max":{"1min":1.306,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.76200000000000001,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":1.2729999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.127}]},{"osd":4,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.70299999999999996,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.2689999999999999,"5min":1.718,"15min":1.782},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.80300000000000005,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.327,"5min":1.635,"15min":1.8340000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.83399999999999996,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.5329999999999999,"5min":1.772,"15min":2.1030000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0489999999999999,"15min":1.0800000000000001},"min":{"1min":0.88700000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.635,"15min":2.0779999999999998},"last":1.05}]},{"osd":6,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1080000000000001,"15min":1.1519999999999999},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.393,"5min":1.5640000000000001,"15min":1.835},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.111,"15min":1.147},"min":{"1min":0.83599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.736,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.147,"15min":1.1930000000000001},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6899999999999999,"15min":2.5640000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.153,"15min":1.21},"min":{"1min":0.84799999999999998,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.6459999999999999,"5min":1.986,"15min":5.3310000000000004},"last":0.94199999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542528,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.25700000000000001},"max":{"1min":0.98799999999999999,"5min":1.897,"15min":1.897},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.089,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Wed Dec 13 22:55:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.747,"15min":0.748},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.204,"5min":1.8240000000000001,"15min":2.2839999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.84499999999999997,"15min":0.86799999999999999},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.1020000000000001,"5min":1.79,"15min":1.9099999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.88500000000000001,"15min":0.91000000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.151,"5min":1.8129999999999999,"15min":2.6320000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.90200000000000002,"15min":0.88300000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.284,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.93500000000000005}]},{"osd":4,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.99399999999999999},"min":{"1min":0.59299999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.399,"15min":2.0659999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.028,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.58599999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0760000000000001,"15min":1.075},"min":{"1min":0.755,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.4099999999999999,"5min":1.554,"15min":1.625},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.1040000000000001},"min":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.46800000000000003},"max":{"1min":1.306,"5min":1.5609999999999999,"15min":2.1539999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.103,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.28,"5min":1.599,"15min":2.2250000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1919999999999999,"15min":1.2090000000000001},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3540000000000001,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.171,"15min":1.163},"min":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.55400000000000005},"max":{"1min":1.577,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.995},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.22},"min":{"1min":0.89900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3839999999999999,"5min":1.841,"15min":2.339},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:56:56.050 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:56.050 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:56.050 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-13T22:25:57.303059+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=25, tm_sec=57, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:56.051 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-13T22:26:04.150627+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=26, tm_sec=4, tm_wday=2, tm_yday=347, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=13, tm_hour=22, tm_min=55, tm_sec=44, tm_wday=2, tm_yday=347, tm_isdst=0) 2023-12-13T22:56:56.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-13T22:57:03.344 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:27.502 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.349 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:27.508 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.521 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:32:27.629 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.535 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:32:27.643 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.555 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:32:27.664 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.561 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:32:27.670 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.745 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:32:27.904 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.811 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:32:27.920 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:03.877 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:32:27.986 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:57:06.051 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:57:06.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:57:16.053 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-13T22:57:16.185 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 Processor -- start 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 -- start start 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151340 0x7f53a006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53a00c40e0 0x7f53a00c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a006f4a0 con 0x7f53a0151720 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a0072570 con 0x7f53a00c40e0 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f53a56d7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0070be0 con 0x7f53a0151340 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.184+0000 7f539f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53a00c40e0 0x7f53a00c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.186 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f53a00c40e0 0x7f53a00c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38224/0 (socket says 172.21.15.91:38224) 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 -- 172.21.15.91:0/2247992186 learned_addr learned my addr 172.21.15.91:0/2247992186 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539effd640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151340 0x7f53a006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 -- 172.21.15.91:0/2247992186 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151340 msgr2=0x7f53a006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151340 0x7f53a006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 -- 172.21.15.91:0/2247992186 >> v1:172.21.15.152:6789/0 conn(0x7f53a0151720 legacy=0x7f53a0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.187 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.188+0000 7f539f7fe640 1 -- 172.21.15.91:0/2247992186 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0070e80 con 0x7f53a00c40e0 2023-12-13T22:57:16.190 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.192+0000 7f539f7fe640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a00c40e0 0x7f53a00c4590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5390009870 tx=0x7f539001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0f4b74ce0b1d85 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.196+0000 7f539dffb640 1 -- 172.21.15.91:0/2247992186 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900aa670 con 0x7f53a00c40e0 2023-12-13T22:57:16.195 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.196+0000 7f539dffb640 1 -- 172.21.15.91:0/2247992186 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900aa7d0 con 0x7f53a00c40e0 2023-12-13T22:57:16.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.196+0000 7f539dffb640 1 -- 172.21.15.91:0/2247992186 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900aab60 con 0x7f53a00c40e0 2023-12-13T22:57:16.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- 172.21.15.91:0/2247992186 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a00c40e0 msgr2=0x7f53a00c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.196 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a00c40e0 0x7f53a00c4590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5390009870 tx=0x7f539001c510 comp rx=0 tx=0).stop 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- 172.21.15.91:0/2247992186 shutdown_connections 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a00c40e0 0x7f53a00c4590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- 172.21.15.91:0/2247992186 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151340 0x7f53a006ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- 172.21.15.91:0/2247992186 >> 172.21.15.91:0/2247992186 conn(0x7f53a006c6a0 msgr2=0x7f53a006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- 172.21.15.91:0/2247992186 shutdown_connections 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- 172.21.15.91:0/2247992186 wait complete. 2023-12-13T22:57:16.197 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 Processor -- start 2023-12-13T22:57:16.198 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- start start 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00c40e0 0x7f53a01f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151720 0x7f53a0142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01447b0 con 0x7f53a0151340 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01f5af0 con 0x7f53a00c40e0 2023-12-13T22:57:16.199 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f53a56d7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0145c10 con 0x7f53a0151720 2023-12-13T22:57:16.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f539e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f539e7fc640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38236/0 (socket says 172.21.15.91:38236) 2023-12-13T22:57:16.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f539e7fc640 1 -- 172.21.15.91:0/1774526947 learned_addr learned my addr 172.21.15.91:0/1774526947 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:16.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.200+0000 7f539effd640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00c40e0 0x7f53a01f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.200 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539f7fe640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151720 0x7f53a0142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539e7fc640 1 -- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151720 msgr2=0x7f53a0142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539e7fc640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151720 0x7f53a0142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539e7fc640 1 -- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00c40e0 msgr2=0x7f53a01f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539e7fc640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00c40e0 0x7f53a01f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.203 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.204+0000 7f539e7fc640 1 -- 172.21.15.91:0/1774526947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900094d0 con 0x7f53a0151340 2023-12-13T22:57:16.205 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.208+0000 7f539e7fc640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f538800c420 tx=0x7f538800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53880052d0 con 0x7f53a0151340 2023-12-13T22:57:16.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388005430 con 0x7f53a0151340 2023-12-13T22:57:16.209 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388007260 con 0x7f53a0151340 2023-12-13T22:57:16.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a0145ef0 con 0x7f53a0151340 2023-12-13T22:57:16.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a01f5780 con 0x7f53a0151340 2023-12-13T22:57:16.210 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.212+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a01f5300 con 0x7f53a0151340 2023-12-13T22:57:16.498 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.500+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f53880073c0 con 0x7f53a0151340 2023-12-13T22:57:16.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.500+0000 7f53977fe640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 0x7f5380068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.499 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.500+0000 7f539effd640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 0x7f5380068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.500 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.504+0000 7f539effd640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 0x7f5380068d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53980113e0 tx=0x7f539800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.536 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.540+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5388007670 con 0x7f53a0151340 2023-12-13T22:57:16.537 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.540+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5388050e20 con 0x7f53a0151340 2023-12-13T22:57:16.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.696+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 --> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53a0163b60 con 0x7f5380066870 2023-12-13T22:57:16.709 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.712+0000 7f53977fe640 1 -- 172.21.15.91:0/1774526947 <== mgr.4107 v2:172.21.15.91:6800/3723397605 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371964 (secure 0 0 0) 0x7f539800f040 con 0x7f5380066870 2023-12-13T22:57:16.713 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:57:16.715 INFO:teuthology.orchestra.run.smithi091.stderr:dumped all 2023-12-13T22:57:16.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 msgr2=0x7f5380068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 0x7f5380068d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f53980113e0 tx=0x7f539800b040 comp rx=0 tx=0).stop 2023-12-13T22:57:16.716 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 msgr2=0x7f53a0156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f538800c420 tx=0x7f538800c8e0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 shutdown_connections 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5380066870 0x7f5380068d30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f53a0151720 0x7f53a0142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f53a0151340 0x7f53a0156260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 --2- 172.21.15.91:0/1774526947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53a00c40e0 0x7f53a01f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 >> 172.21.15.91:0/1774526947 conn(0x7f53a006c6a0 msgr2=0x7f53a00c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 shutdown_connections 2023-12-13T22:57:16.717 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.716+0000 7f53a56d7640 1 -- 172.21.15.91:0/1774526947 wait complete. 2023-12-13T22:57:16.731 INFO:teuthology.orchestra.run.smithi091.stdout:{"pg_ready":true,"pg_map":{"version":988,"stamp":"2023-12-13T22:57:15.387383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26097588,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":765,"num_read_kb":775,"num_write":11646,"num_write_kb":283137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13485,"ondisk_log_size":13485,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":418296,"kb_used_data":53688,"kb_used_omap":12,"kb_used_meta":364531,"kb_avail":754556424,"statfs":{"total":773094113280,"available":772665778176,"internally_reserved":0,"allocated":54976512,"data_stored":53278944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":373280304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005339"},"pg_stats":[{"pgid":"2.1f","version":"31'14","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.362882+0000","last_change":"2023-12-13T22:55:50.362882+0000","last_active":"2023-12-13T22:55:50.362882+0000","last_peered":"2023-12-13T22:55:50.362882+0000","last_clean":"2023-12-13T22:55:50.362882+0000","last_became_active":"2023-12-13T22:25:57.854440+0000","last_became_peered":"2023-12-13T22:25:57.854440+0000","last_unstale":"2023-12-13T22:55:50.362882+0000","last_undegraded":"2023-12-13T22:55:50.362882+0000","last_fullsized":"2023-12-13T22:55:50.362882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:55:50.362718+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.362718+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:36:46.007828+0000","scrub_duration":0.0095031890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.086684+0000","last_change":"2023-12-13T22:55:57.086684+0000","last_active":"2023-12-13T22:55:57.086684+0000","last_peered":"2023-12-13T22:55:57.086684+0000","last_clean":"2023-12-13T22:55:57.086684+0000","last_became_active":"2023-12-13T22:26:00.388926+0000","last_became_peered":"2023-12-13T22:26:00.388926+0000","last_unstale":"2023-12-13T22:55:57.086684+0000","last_undegraded":"2023-12-13T22:55:57.086684+0000","last_fullsized":"2023-12-13T22:55:57.086684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.086433+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.086433+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:37.740171+0000","scrub_duration":0.0047689719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'73","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:50.187395+0000","last_change":"2023-12-13T22:56:50.187453+0000","last_active":"2023-12-13T22:56:50.187395+0000","last_peered":"2023-12-13T22:56:50.187395+0000","last_clean":"2023-12-13T22:56:50.187395+0000","last_became_active":"2023-12-13T22:26:06.563613+0000","last_became_peered":"2023-12-13T22:26:06.563613+0000","last_unstale":"2023-12-13T22:56:50.187395+0000","last_undegraded":"2023-12-13T22:56:50.187395+0000","last_fullsized":"2023-12-13T22:56:50.187395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-12-13T22:56:50.187188+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-12-13T22:56:50.187188+0000","last_clean_scrub_stamp":"2023-12-13T22:56:50.187188+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:26:57.425095+0000","scrub_duration":0.0068803980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":9388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'557","reported_seq":602,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.130795+0000","last_change":"2023-12-13T22:56:04.130795+0000","last_active":"2023-12-13T22:56:04.130795+0000","last_peered":"2023-12-13T22:56:04.130795+0000","last_clean":"2023-12-13T22:56:04.130795+0000","last_became_active":"2023-12-13T22:25:57.843808+0000","last_became_peered":"2023-12-13T22:25:57.843808+0000","last_unstale":"2023-12-13T22:56:04.130795+0000","last_undegraded":"2023-12-13T22:56:04.130795+0000","last_fullsized":"2023-12-13T22:56:04.130795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'557","last_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_deep_scrub":"31'557","last_deep_scrub_stamp":"2023-12-13T22:56:04.130538+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.130538+0000","objects_scrubbed":1,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:18.030140+0000","scrub_duration":0.017810682000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3277946,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":3515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"31'39","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.384721+0000","last_change":"2023-12-13T22:55:53.384721+0000","last_active":"2023-12-13T22:55:53.384721+0000","last_peered":"2023-12-13T22:55:53.384721+0000","last_clean":"2023-12-13T22:55:53.384721+0000","last_became_active":"2023-12-13T22:25:59.500871+0000","last_became_peered":"2023-12-13T22:25:59.500871+0000","last_unstale":"2023-12-13T22:55:53.384721+0000","last_undegraded":"2023-12-13T22:55:53.384721+0000","last_fullsized":"2023-12-13T22:55:53.384721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:55:53.384483+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.384483+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:09.394000+0000","scrub_duration":0.0059998250000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'95","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.760349+0000","last_change":"2023-12-13T22:56:07.760404+0000","last_active":"2023-12-13T22:56:07.760349+0000","last_peered":"2023-12-13T22:56:07.760349+0000","last_clean":"2023-12-13T22:56:07.760349+0000","last_became_active":"2023-12-13T22:26:05.937874+0000","last_became_peered":"2023-12-13T22:26:05.937874+0000","last_unstale":"2023-12-13T22:56:07.760349+0000","last_undegraded":"2023-12-13T22:56:07.760349+0000","last_fullsized":"2023-12-13T22:56:07.760349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:07.760159+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.760159+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:54.961389+0000","scrub_duration":0.0082528020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":5518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"31'14","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.006531+0000","last_change":"2023-12-13T22:56:01.006646+0000","last_active":"2023-12-13T22:56:01.006531+0000","last_peered":"2023-12-13T22:56:01.006531+0000","last_clean":"2023-12-13T22:56:01.006531+0000","last_became_active":"2023-12-13T22:25:57.857655+0000","last_became_peered":"2023-12-13T22:25:57.857655+0000","last_unstale":"2023-12-13T22:56:01.006531+0000","last_undegraded":"2023-12-13T22:56:01.006531+0000","last_fullsized":"2023-12-13T22:56:01.006531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2023-12-13T22:56:01.006244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.006244+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:30.213593+0000","scrub_duration":0.0084082649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'38","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:13.460520+0000","last_change":"2023-12-13T22:56:13.460572+0000","last_active":"2023-12-13T22:56:13.460520+0000","last_peered":"2023-12-13T22:56:13.460520+0000","last_clean":"2023-12-13T22:56:13.460520+0000","last_became_active":"2023-12-13T22:26:00.400854+0000","last_became_peered":"2023-12-13T22:26:00.400854+0000","last_unstale":"2023-12-13T22:56:13.460520+0000","last_undegraded":"2023-12-13T22:56:13.460520+0000","last_fullsized":"2023-12-13T22:56:13.460520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:13.460331+0000","last_clean_scrub_stamp":"2023-12-13T22:56:13.460331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:27.359933+0000","scrub_duration":0.0028389130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'84","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.773631+0000","last_change":"2023-12-13T22:56:11.773767+0000","last_active":"2023-12-13T22:56:11.773631+0000","last_peered":"2023-12-13T22:56:11.773631+0000","last_clean":"2023-12-13T22:56:11.773631+0000","last_became_active":"2023-12-13T22:27:03.107330+0000","last_became_peered":"2023-12-13T22:27:03.107330+0000","last_unstale":"2023-12-13T22:56:11.773631+0000","last_undegraded":"2023-12-13T22:56:11.773631+0000","last_fullsized":"2023-12-13T22:56:11.773631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:11.773409+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.773409+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:10.025016+0000","scrub_duration":0.0070233229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.975345+0000","last_change":"2023-12-13T22:56:04.975403+0000","last_active":"2023-12-13T22:56:04.975345+0000","last_peered":"2023-12-13T22:56:04.975345+0000","last_clean":"2023-12-13T22:56:04.975345+0000","last_became_active":"2023-12-13T22:25:57.861635+0000","last_became_peered":"2023-12-13T22:25:57.861635+0000","last_unstale":"2023-12-13T22:56:04.975345+0000","last_undegraded":"2023-12-13T22:56:04.975345+0000","last_fullsized":"2023-12-13T22:56:04.975345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.975161+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.975161+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:29.194959+0000","scrub_duration":0.005625924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.419817+0000","last_change":"2023-12-13T22:56:09.419869+0000","last_active":"2023-12-13T22:56:09.419817+0000","last_peered":"2023-12-13T22:56:09.419817+0000","last_clean":"2023-12-13T22:56:09.419817+0000","last_became_active":"2023-12-13T22:26:00.402209+0000","last_became_peered":"2023-12-13T22:26:00.402209+0000","last_unstale":"2023-12-13T22:56:09.419817+0000","last_undegraded":"2023-12-13T22:56:09.419817+0000","last_fullsized":"2023-12-13T22:56:09.419817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:09.419615+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.419615+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:50.791071+0000","scrub_duration":0.0033404609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'104","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.746368+0000","last_change":"2023-12-13T22:56:05.746368+0000","last_active":"2023-12-13T22:56:05.746368+0000","last_peered":"2023-12-13T22:56:05.746368+0000","last_clean":"2023-12-13T22:56:05.746368+0000","last_became_active":"2023-12-13T22:26:05.934768+0000","last_became_peered":"2023-12-13T22:26:05.934768+0000","last_unstale":"2023-12-13T22:56:05.746368+0000","last_undegraded":"2023-12-13T22:56:05.746368+0000","last_fullsized":"2023-12-13T22:56:05.746368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'104","last_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_deep_scrub":"31'104","last_deep_scrub_stamp":"2023-12-13T22:56:05.746112+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.746112+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:53.792152+0000","scrub_duration":0.0090762269999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'38","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:26.187058+0000","last_change":"2023-12-13T22:56:26.187058+0000","last_active":"2023-12-13T22:56:26.187058+0000","last_peered":"2023-12-13T22:56:26.187058+0000","last_clean":"2023-12-13T22:56:26.187058+0000","last_became_active":"2023-12-13T22:26:00.395363+0000","last_became_peered":"2023-12-13T22:26:00.395363+0000","last_unstale":"2023-12-13T22:56:26.187058+0000","last_undegraded":"2023-12-13T22:56:26.187058+0000","last_fullsized":"2023-12-13T22:56:26.187058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-12-13T22:56:26.186709+0000","last_clean_scrub_stamp":"2023-12-13T22:56:26.186709+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:13.387939+0000","scrub_duration":0.0036531189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"31'674","reported_seq":717,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.032320+0000","last_change":"2023-12-13T22:56:10.032381+0000","last_active":"2023-12-13T22:56:10.032320+0000","last_peered":"2023-12-13T22:56:10.032320+0000","last_clean":"2023-12-13T22:56:10.032320+0000","last_became_active":"2023-12-13T22:25:57.854447+0000","last_became_peered":"2023-12-13T22:25:57.854447+0000","last_unstale":"2023-12-13T22:56:10.032320+0000","last_undegraded":"2023-12-13T22:56:10.032320+0000","last_fullsized":"2023-12-13T22:56:10.032320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'674","last_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_deep_scrub":"31'674","last_deep_scrub_stamp":"2023-12-13T22:56:10.032136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.032136+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:02:10.233919+0000","scrub_duration":0.019140582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018563,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":3263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"31'87","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:21.714127+0000","last_change":"2023-12-13T22:56:21.714183+0000","last_active":"2023-12-13T22:56:21.714127+0000","last_peered":"2023-12-13T22:56:21.714127+0000","last_clean":"2023-12-13T22:56:21.714127+0000","last_became_active":"2023-12-13T22:26:05.946082+0000","last_became_peered":"2023-12-13T22:26:05.946082+0000","last_unstale":"2023-12-13T22:56:21.714127+0000","last_undegraded":"2023-12-13T22:56:21.714127+0000","last_fullsized":"2023-12-13T22:56:21.714127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:21.713927+0000","last_clean_scrub_stamp":"2023-12-13T22:56:21.713927+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:42:02.256865+0000","scrub_duration":0.0076867139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.118429+0000","last_change":"2023-12-13T22:56:00.118478+0000","last_active":"2023-12-13T22:56:00.118429+0000","last_peered":"2023-12-13T22:56:00.118429+0000","last_clean":"2023-12-13T22:56:00.118429+0000","last_became_active":"2023-12-13T22:26:00.391162+0000","last_became_peered":"2023-12-13T22:26:00.391162+0000","last_unstale":"2023-12-13T22:56:00.118429+0000","last_undegraded":"2023-12-13T22:56:00.118429+0000","last_fullsized":"2023-12-13T22:56:00.118429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:00.118246+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.118246+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:17:52.123696+0000","scrub_duration":0.003500979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"31'231","reported_seq":275,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.701006+0000","last_change":"2023-12-13T22:55:53.701006+0000","last_active":"2023-12-13T22:55:53.701006+0000","last_peered":"2023-12-13T22:55:53.701006+0000","last_clean":"2023-12-13T22:55:53.701006+0000","last_became_active":"2023-12-13T22:25:57.845587+0000","last_became_peered":"2023-12-13T22:25:57.845587+0000","last_unstale":"2023-12-13T22:55:53.701006+0000","last_undegraded":"2023-12-13T22:55:53.701006+0000","last_fullsized":"2023-12-13T22:55:53.701006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'231","last_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_deep_scrub":"31'231","last_deep_scrub_stamp":"2023-12-13T22:55:53.700899+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.700899+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:00.803310+0000","scrub_duration":0.0056378890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":586,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'127","reported_seq":166,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.677218+0000","last_change":"2023-12-13T22:56:18.677275+0000","last_active":"2023-12-13T22:56:18.677218+0000","last_peered":"2023-12-13T22:56:18.677218+0000","last_clean":"2023-12-13T22:56:18.677218+0000","last_became_active":"2023-12-13T22:26:05.936909+0000","last_became_peered":"2023-12-13T22:26:05.936909+0000","last_unstale":"2023-12-13T22:56:18.677218+0000","last_undegraded":"2023-12-13T22:56:18.677218+0000","last_fullsized":"2023-12-13T22:56:18.677218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'127","last_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_deep_scrub":"31'127","last_deep_scrub_stamp":"2023-12-13T22:56:18.677054+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.677054+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:32.576656+0000","scrub_duration":0.010044599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":11701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'40","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.067985+0000","last_change":"2023-12-13T22:56:05.067985+0000","last_active":"2023-12-13T22:56:05.067985+0000","last_peered":"2023-12-13T22:56:05.067985+0000","last_clean":"2023-12-13T22:56:05.067985+0000","last_became_active":"2023-12-13T22:26:00.412551+0000","last_became_peered":"2023-12-13T22:26:00.412551+0000","last_unstale":"2023-12-13T22:56:05.067985+0000","last_undegraded":"2023-12-13T22:56:05.067985+0000","last_fullsized":"2023-12-13T22:56:05.067985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:05.067730+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.067730+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:26.243855+0000","scrub_duration":0.0036404760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"31'167","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.826963+0000","last_change":"2023-12-13T22:56:02.826963+0000","last_active":"2023-12-13T22:56:02.826963+0000","last_peered":"2023-12-13T22:56:02.826963+0000","last_clean":"2023-12-13T22:56:02.826963+0000","last_became_active":"2023-12-13T22:25:57.854677+0000","last_became_peered":"2023-12-13T22:25:57.854677+0000","last_unstale":"2023-12-13T22:56:02.826963+0000","last_undegraded":"2023-12-13T22:56:02.826963+0000","last_fullsized":"2023-12-13T22:56:02.826963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'167","last_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_deep_scrub":"31'167","last_deep_scrub_stamp":"2023-12-13T22:56:02.826714+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.826714+0000","objects_scrubbed":2,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:46.888140+0000","scrub_duration":0.0074117790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":163,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"31'97","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:34.606743+0000","last_change":"2023-12-13T22:56:34.606782+0000","last_active":"2023-12-13T22:56:34.606743+0000","last_peered":"2023-12-13T22:56:34.606743+0000","last_clean":"2023-12-13T22:56:34.606743+0000","last_became_active":"2023-12-13T22:26:06.552483+0000","last_became_peered":"2023-12-13T22:26:06.552483+0000","last_unstale":"2023-12-13T22:56:34.606743+0000","last_undegraded":"2023-12-13T22:56:34.606743+0000","last_fullsized":"2023-12-13T22:56:34.606743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-12-13T22:56:34.606644+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-12-13T22:56:34.606644+0000","last_clean_scrub_stamp":"2023-12-13T22:56:34.606644+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:40:52.245623+0000","scrub_duration":0.0044389599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":8947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"31'33","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.896395+0000","last_change":"2023-12-13T22:55:57.896395+0000","last_active":"2023-12-13T22:55:57.896395+0000","last_peered":"2023-12-13T22:55:57.896395+0000","last_clean":"2023-12-13T22:55:57.896395+0000","last_became_active":"2023-12-13T22:26:00.405413+0000","last_became_peered":"2023-12-13T22:26:00.405413+0000","last_unstale":"2023-12-13T22:55:57.896395+0000","last_undegraded":"2023-12-13T22:55:57.896395+0000","last_fullsized":"2023-12-13T22:55:57.896395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:55:57.896154+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.896154+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:01:41.957580+0000","scrub_duration":0.0027243580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"31'5","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.011503+0000","last_change":"2023-12-13T22:55:58.011503+0000","last_active":"2023-12-13T22:55:58.011503+0000","last_peered":"2023-12-13T22:55:58.011503+0000","last_clean":"2023-12-13T22:55:58.011503+0000","last_became_active":"2023-12-13T22:25:57.852466+0000","last_became_peered":"2023-12-13T22:25:57.852466+0000","last_unstale":"2023-12-13T22:55:58.011503+0000","last_undegraded":"2023-12-13T22:55:58.011503+0000","last_fullsized":"2023-12-13T22:55:58.011503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:58.011259+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.011259+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:22.491272+0000","scrub_duration":0.0058936780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"31'121","reported_seq":160,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.776408+0000","last_change":"2023-12-13T22:56:09.776464+0000","last_active":"2023-12-13T22:56:09.776408+0000","last_peered":"2023-12-13T22:56:09.776408+0000","last_clean":"2023-12-13T22:56:09.776408+0000","last_became_active":"2023-12-13T22:26:05.937696+0000","last_became_peered":"2023-12-13T22:26:05.937696+0000","last_unstale":"2023-12-13T22:56:09.776408+0000","last_undegraded":"2023-12-13T22:56:09.776408+0000","last_fullsized":"2023-12-13T22:56:09.776408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'121","last_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_deep_scrub":"31'121","last_deep_scrub_stamp":"2023-12-13T22:56:09.776205+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.776205+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:27.344349+0000","scrub_duration":0.0082280419999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":10194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.394605+0000","last_change":"2023-12-13T22:55:54.394605+0000","last_active":"2023-12-13T22:55:54.394605+0000","last_peered":"2023-12-13T22:55:54.394605+0000","last_clean":"2023-12-13T22:55:54.394605+0000","last_became_active":"2023-12-13T22:26:00.283394+0000","last_became_peered":"2023-12-13T22:26:00.283394+0000","last_unstale":"2023-12-13T22:55:54.394605+0000","last_undegraded":"2023-12-13T22:55:54.394605+0000","last_fullsized":"2023-12-13T22:55:54.394605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:54.394350+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.394350+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:38:08.105528+0000","scrub_duration":0.0036387030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"31'11","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.233515+0000","last_change":"2023-12-13T22:55:54.233515+0000","last_active":"2023-12-13T22:55:54.233515+0000","last_peered":"2023-12-13T22:55:54.233515+0000","last_clean":"2023-12-13T22:55:54.233515+0000","last_became_active":"2023-12-13T22:25:57.847753+0000","last_became_peered":"2023-12-13T22:25:57.847753+0000","last_unstale":"2023-12-13T22:55:54.233515+0000","last_undegraded":"2023-12-13T22:55:54.233515+0000","last_fullsized":"2023-12-13T22:55:54.233515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:54.233177+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.233177+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:03.688679+0000","scrub_duration":0.0080965169999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"31'88","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.700892+0000","last_change":"2023-12-13T22:56:22.700948+0000","last_active":"2023-12-13T22:56:22.700892+0000","last_peered":"2023-12-13T22:56:22.700892+0000","last_clean":"2023-12-13T22:56:22.700892+0000","last_became_active":"2023-12-13T22:26:06.553160+0000","last_became_peered":"2023-12-13T22:26:06.553160+0000","last_unstale":"2023-12-13T22:56:22.700892+0000","last_undegraded":"2023-12-13T22:56:22.700892+0000","last_fullsized":"2023-12-13T22:56:22.700892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-12-13T22:56:22.700701+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.700701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:17:09.244554+0000","scrub_duration":0.0083719640000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":5459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'39","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.172376+0000","last_change":"2023-12-13T22:56:20.172376+0000","last_active":"2023-12-13T22:56:20.172376+0000","last_peered":"2023-12-13T22:56:20.172376+0000","last_clean":"2023-12-13T22:56:20.172376+0000","last_became_active":"2023-12-13T22:26:00.409748+0000","last_became_peered":"2023-12-13T22:26:00.409748+0000","last_unstale":"2023-12-13T22:56:20.172376+0000","last_undegraded":"2023-12-13T22:56:20.172376+0000","last_fullsized":"2023-12-13T22:56:20.172376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:20.172119+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.172119+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:34:19.011880+0000","scrub_duration":0.0048316519999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"31'190","reported_seq":234,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.940925+0000","last_change":"2023-12-13T22:56:12.940925+0000","last_active":"2023-12-13T22:56:12.940925+0000","last_peered":"2023-12-13T22:56:12.940925+0000","last_clean":"2023-12-13T22:56:12.940925+0000","last_became_active":"2023-12-13T22:25:57.862061+0000","last_became_peered":"2023-12-13T22:25:57.862061+0000","last_unstale":"2023-12-13T22:56:12.940925+0000","last_undegraded":"2023-12-13T22:56:12.940925+0000","last_fullsized":"2023-12-13T22:56:12.940925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'190","last_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_deep_scrub":"31'190","last_deep_scrub_stamp":"2023-12-13T22:56:12.940512+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.940512+0000","objects_scrubbed":2,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:58.333074+0000","scrub_duration":0.011165543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'95","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:28.160975+0000","last_change":"2023-12-13T22:56:28.161032+0000","last_active":"2023-12-13T22:56:28.160975+0000","last_peered":"2023-12-13T22:56:28.160975+0000","last_clean":"2023-12-13T22:56:28.160975+0000","last_became_active":"2023-12-13T22:26:06.563616+0000","last_became_peered":"2023-12-13T22:26:06.563616+0000","last_unstale":"2023-12-13T22:56:28.160975+0000","last_undegraded":"2023-12-13T22:56:28.160975+0000","last_fullsized":"2023-12-13T22:56:28.160975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'95","last_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_deep_scrub":"31'95","last_deep_scrub_stamp":"2023-12-13T22:56:28.160767+0000","last_clean_scrub_stamp":"2023-12-13T22:56:28.160767+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:40:21.795633+0000","scrub_duration":0.0089128829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"31'42","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.858359+0000","last_change":"2023-12-13T22:56:23.858400+0000","last_active":"2023-12-13T22:56:23.858359+0000","last_peered":"2023-12-13T22:56:23.858359+0000","last_clean":"2023-12-13T22:56:23.858359+0000","last_became_active":"2023-12-13T22:26:00.411515+0000","last_became_peered":"2023-12-13T22:26:00.411515+0000","last_unstale":"2023-12-13T22:56:23.858359+0000","last_undegraded":"2023-12-13T22:56:23.858359+0000","last_fullsized":"2023-12-13T22:56:23.858359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:23.858227+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.858227+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:32:56.691182+0000","scrub_duration":0.0033943609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"31'3","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.953673+0000","last_change":"2023-12-13T22:56:03.953801+0000","last_active":"2023-12-13T22:56:03.953673+0000","last_peered":"2023-12-13T22:56:03.953673+0000","last_clean":"2023-12-13T22:56:03.953673+0000","last_became_active":"2023-12-13T22:25:57.852474+0000","last_became_peered":"2023-12-13T22:25:57.852474+0000","last_unstale":"2023-12-13T22:56:03.953673+0000","last_undegraded":"2023-12-13T22:56:03.953673+0000","last_fullsized":"2023-12-13T22:56:03.953673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:03.953362+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.953362+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:55:24.663154+0000","scrub_duration":0.0065831049999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"31'81","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.436614+0000","last_change":"2023-12-13T22:56:12.436678+0000","last_active":"2023-12-13T22:56:12.436614+0000","last_peered":"2023-12-13T22:56:12.436614+0000","last_clean":"2023-12-13T22:56:12.436614+0000","last_became_active":"2023-12-13T22:26:06.552437+0000","last_became_peered":"2023-12-13T22:26:06.552437+0000","last_unstale":"2023-12-13T22:56:12.436614+0000","last_undegraded":"2023-12-13T22:56:12.436614+0000","last_fullsized":"2023-12-13T22:56:12.436614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'81","last_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_deep_scrub":"31'81","last_deep_scrub_stamp":"2023-12-13T22:56:12.436388+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.436388+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:31:36.054849+0000","scrub_duration":0.0067611340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":9379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'32","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.427281+0000","last_change":"2023-12-13T22:56:07.427334+0000","last_active":"2023-12-13T22:56:07.427281+0000","last_peered":"2023-12-13T22:56:07.427281+0000","last_clean":"2023-12-13T22:56:07.427281+0000","last_became_active":"2023-12-13T22:26:00.417894+0000","last_became_peered":"2023-12-13T22:26:00.417894+0000","last_unstale":"2023-12-13T22:56:07.427281+0000","last_undegraded":"2023-12-13T22:56:07.427281+0000","last_fullsized":"2023-12-13T22:56:07.427281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-12-13T22:56:07.427084+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.427084+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:24.995228+0000","scrub_duration":0.0038031240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"31'3","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.882820+0000","last_change":"2023-12-13T22:56:11.882820+0000","last_active":"2023-12-13T22:56:11.882820+0000","last_peered":"2023-12-13T22:56:11.882820+0000","last_clean":"2023-12-13T22:56:11.882820+0000","last_became_active":"2023-12-13T22:25:57.853810+0000","last_became_peered":"2023-12-13T22:25:57.853810+0000","last_unstale":"2023-12-13T22:56:11.882820+0000","last_undegraded":"2023-12-13T22:56:11.882820+0000","last_fullsized":"2023-12-13T22:56:11.882820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-13T22:56:11.882492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.882492+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:29:59.928532+0000","scrub_duration":0.0034021170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'83","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:19.682337+0000","last_change":"2023-12-13T22:56:19.682393+0000","last_active":"2023-12-13T22:56:19.682337+0000","last_peered":"2023-12-13T22:56:19.682337+0000","last_clean":"2023-12-13T22:56:19.682337+0000","last_became_active":"2023-12-13T22:27:03.565778+0000","last_became_peered":"2023-12-13T22:27:03.565778+0000","last_unstale":"2023-12-13T22:56:19.682337+0000","last_undegraded":"2023-12-13T22:56:19.682337+0000","last_fullsized":"2023-12-13T22:56:19.682337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'83","last_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_deep_scrub":"31'83","last_deep_scrub_stamp":"2023-12-13T22:56:19.682136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:19.682136+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:26.387877+0000","scrub_duration":0.0093473989999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"31'47","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.985034+0000","last_change":"2023-12-13T22:55:52.985096+0000","last_active":"2023-12-13T22:55:52.985034+0000","last_peered":"2023-12-13T22:55:52.985034+0000","last_clean":"2023-12-13T22:55:52.985034+0000","last_became_active":"2023-12-13T22:26:00.393002+0000","last_became_peered":"2023-12-13T22:26:00.393002+0000","last_unstale":"2023-12-13T22:55:52.985034+0000","last_undegraded":"2023-12-13T22:55:52.985034+0000","last_fullsized":"2023-12-13T22:55:52.985034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:52.984842+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.984842+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:22:25.512989+0000","scrub_duration":0.0033867749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:57.371756+0000","last_change":"2023-12-13T22:55:57.371756+0000","last_active":"2023-12-13T22:55:57.371756+0000","last_peered":"2023-12-13T22:55:57.371756+0000","last_clean":"2023-12-13T22:55:57.371756+0000","last_became_active":"2023-12-13T22:25:57.862551+0000","last_became_peered":"2023-12-13T22:25:57.862551+0000","last_unstale":"2023-12-13T22:55:57.371756+0000","last_undegraded":"2023-12-13T22:55:57.371756+0000","last_fullsized":"2023-12-13T22:55:57.371756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:55:57.371503+0000","last_clean_scrub_stamp":"2023-12-13T22:55:57.371503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:29:53.556509+0000","scrub_duration":0.0029694280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"31'69","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:37.558656+0000","last_change":"2023-12-13T22:56:37.558775+0000","last_active":"2023-12-13T22:56:37.558656+0000","last_peered":"2023-12-13T22:56:37.558656+0000","last_clean":"2023-12-13T22:56:37.558656+0000","last_became_active":"2023-12-13T22:26:05.950323+0000","last_became_peered":"2023-12-13T22:26:05.950323+0000","last_unstale":"2023-12-13T22:56:37.558656+0000","last_undegraded":"2023-12-13T22:56:37.558656+0000","last_fullsized":"2023-12-13T22:56:37.558656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'69","last_scrub_stamp":"2023-12-13T22:56:37.558336+0000","last_deep_scrub":"31'69","last_deep_scrub_stamp":"2023-12-13T22:56:37.558336+0000","last_clean_scrub_stamp":"2023-12-13T22:56:37.558336+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:52:24.404645+0000","scrub_duration":0.0077587120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"31'36","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.934789+0000","last_change":"2023-12-13T22:56:14.934892+0000","last_active":"2023-12-13T22:56:14.934789+0000","last_peered":"2023-12-13T22:56:14.934789+0000","last_clean":"2023-12-13T22:56:14.934789+0000","last_became_active":"2023-12-13T22:26:00.411478+0000","last_became_peered":"2023-12-13T22:26:00.411478+0000","last_unstale":"2023-12-13T22:56:14.934789+0000","last_undegraded":"2023-12-13T22:56:14.934789+0000","last_fullsized":"2023-12-13T22:56:14.934789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:14.934537+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.934537+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:43:02.135767+0000","scrub_duration":0.0038170019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"31'253","reported_seq":451,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.928461+0000","last_change":"2023-12-13T22:55:54.928461+0000","last_active":"2023-12-13T22:55:54.928461+0000","last_peered":"2023-12-13T22:55:54.928461+0000","last_clean":"2023-12-13T22:55:54.928461+0000","last_became_active":"2023-12-13T22:25:57.851823+0000","last_became_peered":"2023-12-13T22:25:57.851823+0000","last_unstale":"2023-12-13T22:55:54.928461+0000","last_undegraded":"2023-12-13T22:55:54.928461+0000","last_fullsized":"2023-12-13T22:55:54.928461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'253","last_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_deep_scrub":"31'253","last_deep_scrub_stamp":"2023-12-13T22:55:54.928226+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.928226+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:21:19.453012+0000","scrub_duration":0.0082018130000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":153,"num_read_kb":158,"num_write":250,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'84","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:33.615892+0000","last_change":"2023-12-13T22:56:33.615946+0000","last_active":"2023-12-13T22:56:33.615892+0000","last_peered":"2023-12-13T22:56:33.615892+0000","last_clean":"2023-12-13T22:56:33.615892+0000","last_became_active":"2023-12-13T22:26:05.939459+0000","last_became_peered":"2023-12-13T22:26:05.939459+0000","last_unstale":"2023-12-13T22:56:33.615892+0000","last_undegraded":"2023-12-13T22:56:33.615892+0000","last_fullsized":"2023-12-13T22:56:33.615892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'84","last_scrub_stamp":"2023-12-13T22:56:33.615691+0000","last_deep_scrub":"31'84","last_deep_scrub_stamp":"2023-12-13T22:56:33.615691+0000","last_clean_scrub_stamp":"2023-12-13T22:56:33.615691+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:17:20.159544+0000","scrub_duration":0.006863264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":5985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"31'44","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.423106+0000","last_change":"2023-12-13T22:55:52.423106+0000","last_active":"2023-12-13T22:55:52.423106+0000","last_peered":"2023-12-13T22:55:52.423106+0000","last_clean":"2023-12-13T22:55:52.423106+0000","last_became_active":"2023-12-13T22:25:59.493328+0000","last_became_peered":"2023-12-13T22:25:59.493328+0000","last_unstale":"2023-12-13T22:55:52.423106+0000","last_undegraded":"2023-12-13T22:55:52.423106+0000","last_fullsized":"2023-12-13T22:55:52.423106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:55:52.422920+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.422920+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:03:02.820205+0000","scrub_duration":0.0018780209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"31'7","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.989925+0000","last_change":"2023-12-13T22:55:58.989925+0000","last_active":"2023-12-13T22:55:58.989925+0000","last_peered":"2023-12-13T22:55:58.989925+0000","last_clean":"2023-12-13T22:55:58.989925+0000","last_became_active":"2023-12-13T22:25:57.852604+0000","last_became_peered":"2023-12-13T22:25:57.852604+0000","last_unstale":"2023-12-13T22:55:58.989925+0000","last_undegraded":"2023-12-13T22:55:58.989925+0000","last_fullsized":"2023-12-13T22:55:58.989925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:58.989650+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.989650+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:05.695391+0000","scrub_duration":0.0073674609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.410712+0000","last_change":"2023-12-13T22:56:14.410712+0000","last_active":"2023-12-13T22:56:14.410712+0000","last_peered":"2023-12-13T22:56:14.410712+0000","last_clean":"2023-12-13T22:56:14.410712+0000","last_became_active":"2023-12-13T22:26:06.552745+0000","last_became_peered":"2023-12-13T22:26:06.552745+0000","last_unstale":"2023-12-13T22:56:14.410712+0000","last_undegraded":"2023-12-13T22:56:14.410712+0000","last_fullsized":"2023-12-13T22:56:14.410712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:14.410460+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.410460+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:15:01.401860+0000","scrub_duration":0.004314399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":9136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"31'34","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.155911+0000","last_change":"2023-12-13T22:56:17.155963+0000","last_active":"2023-12-13T22:56:17.155911+0000","last_peered":"2023-12-13T22:56:17.155911+0000","last_clean":"2023-12-13T22:56:17.155911+0000","last_became_active":"2023-12-13T22:26:00.402881+0000","last_became_peered":"2023-12-13T22:26:00.402881+0000","last_unstale":"2023-12-13T22:56:17.155911+0000","last_undegraded":"2023-12-13T22:56:17.155911+0000","last_fullsized":"2023-12-13T22:56:17.155911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:17.155741+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.155741+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:10.405334+0000","scrub_duration":0.0030467839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"31'11","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:52.359631+0000","last_change":"2023-12-13T22:55:52.359631+0000","last_active":"2023-12-13T22:55:52.359631+0000","last_peered":"2023-12-13T22:55:52.359631+0000","last_clean":"2023-12-13T22:55:52.359631+0000","last_became_active":"2023-12-13T22:25:57.857063+0000","last_became_peered":"2023-12-13T22:25:57.857063+0000","last_unstale":"2023-12-13T22:55:52.359631+0000","last_undegraded":"2023-12-13T22:55:52.359631+0000","last_fullsized":"2023-12-13T22:55:52.359631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-13T22:55:52.359516+0000","last_clean_scrub_stamp":"2023-12-13T22:55:52.359516+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:37.445461+0000","scrub_duration":0.0062306879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:54.936095+0000","last_change":"2023-12-13T22:55:54.936170+0000","last_active":"2023-12-13T22:55:54.936095+0000","last_peered":"2023-12-13T22:55:54.936095+0000","last_clean":"2023-12-13T22:55:54.936095+0000","last_became_active":"2023-12-13T22:25:19.713593+0000","last_became_peered":"2023-12-13T22:25:19.713593+0000","last_unstale":"2023-12-13T22:55:54.936095+0000","last_undegraded":"2023-12-13T22:55:54.936095+0000","last_fullsized":"2023-12-13T22:55:54.936095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-13T22:55:54.935901+0000","last_clean_scrub_stamp":"2023-12-13T22:55:54.935901+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:29:40.021847+0000","scrub_duration":0.011317162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"31'68","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:55.190055+0000","last_change":"2023-12-13T22:56:55.190164+0000","last_active":"2023-12-13T22:56:55.190055+0000","last_peered":"2023-12-13T22:56:55.190055+0000","last_clean":"2023-12-13T22:56:55.190055+0000","last_became_active":"2023-12-13T22:26:06.556086+0000","last_became_peered":"2023-12-13T22:26:06.556086+0000","last_unstale":"2023-12-13T22:56:55.190055+0000","last_undegraded":"2023-12-13T22:56:55.190055+0000","last_fullsized":"2023-12-13T22:56:55.190055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'68","last_scrub_stamp":"2023-12-13T22:56:55.189817+0000","last_deep_scrub":"31'68","last_deep_scrub_stamp":"2023-12-13T22:56:55.189817+0000","last_clean_scrub_stamp":"2023-12-13T22:56:55.189817+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:50:44.624415+0000","scrub_duration":0.0071682150000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":7192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:30.007729+0000","last_change":"2023-12-13T22:56:30.007834+0000","last_active":"2023-12-13T22:56:30.007729+0000","last_peered":"2023-12-13T22:56:30.007729+0000","last_clean":"2023-12-13T22:56:30.007729+0000","last_became_active":"2023-12-13T22:26:00.419373+0000","last_became_peered":"2023-12-13T22:26:00.419373+0000","last_unstale":"2023-12-13T22:56:30.007729+0000","last_undegraded":"2023-12-13T22:56:30.007729+0000","last_fullsized":"2023-12-13T22:56:30.007729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:30.007437+0000","last_clean_scrub_stamp":"2023-12-13T22:56:30.007437+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:09:00.924051+0000","scrub_duration":0.0034788699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.779403+0000","last_change":"2023-12-13T22:56:00.779462+0000","last_active":"2023-12-13T22:56:00.779403+0000","last_peered":"2023-12-13T22:56:00.779403+0000","last_clean":"2023-12-13T22:56:00.779403+0000","last_became_active":"2023-12-13T22:25:57.864174+0000","last_became_peered":"2023-12-13T22:25:57.864174+0000","last_unstale":"2023-12-13T22:56:00.779403+0000","last_undegraded":"2023-12-13T22:56:00.779403+0000","last_fullsized":"2023-12-13T22:56:00.779403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-12-13T22:56:00.779224+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.779224+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:55:53.386922+0000","scrub_duration":0.0076204089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"31'89","reported_seq":129,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:53.181123+0000","last_change":"2023-12-13T22:56:53.181235+0000","last_active":"2023-12-13T22:56:53.181123+0000","last_peered":"2023-12-13T22:56:53.181123+0000","last_clean":"2023-12-13T22:56:53.181123+0000","last_became_active":"2023-12-13T22:26:06.551504+0000","last_became_peered":"2023-12-13T22:26:06.551504+0000","last_unstale":"2023-12-13T22:56:53.181123+0000","last_undegraded":"2023-12-13T22:56:53.181123+0000","last_fullsized":"2023-12-13T22:56:53.181123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-12-13T22:56:53.180885+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-12-13T22:56:53.180885+0000","last_clean_scrub_stamp":"2023-12-13T22:56:53.180885+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:35:42.265242+0000","scrub_duration":0.0065400390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":12221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"31'42","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.366939+0000","last_change":"2023-12-13T22:55:51.367028+0000","last_active":"2023-12-13T22:55:51.366939+0000","last_peered":"2023-12-13T22:55:51.366939+0000","last_clean":"2023-12-13T22:55:51.366939+0000","last_became_active":"2023-12-13T22:26:00.408412+0000","last_became_peered":"2023-12-13T22:26:00.408412+0000","last_unstale":"2023-12-13T22:55:51.366939+0000","last_undegraded":"2023-12-13T22:55:51.366939+0000","last_fullsized":"2023-12-13T22:55:51.366939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:55:51.366729+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.366729+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:41:58.469140+0000","scrub_duration":0.0033407179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.895758+0000","last_change":"2023-12-13T22:56:04.895812+0000","last_active":"2023-12-13T22:56:04.895758+0000","last_peered":"2023-12-13T22:56:04.895758+0000","last_clean":"2023-12-13T22:56:04.895758+0000","last_became_active":"2023-12-13T22:25:57.852401+0000","last_became_peered":"2023-12-13T22:25:57.852401+0000","last_unstale":"2023-12-13T22:56:04.895758+0000","last_undegraded":"2023-12-13T22:56:04.895758+0000","last_fullsized":"2023-12-13T22:56:04.895758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:56:04.895573+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.895573+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:29.086931+0000","scrub_duration":0.0061804989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"31'98","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:09.434836+0000","last_change":"2023-12-13T22:56:09.434895+0000","last_active":"2023-12-13T22:56:09.434836+0000","last_peered":"2023-12-13T22:56:09.434836+0000","last_clean":"2023-12-13T22:56:09.434836+0000","last_became_active":"2023-12-13T22:26:05.941411+0000","last_became_peered":"2023-12-13T22:26:05.941411+0000","last_unstale":"2023-12-13T22:56:09.434836+0000","last_undegraded":"2023-12-13T22:56:09.434836+0000","last_fullsized":"2023-12-13T22:56:09.434836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2023-12-13T22:56:09.434626+0000","last_clean_scrub_stamp":"2023-12-13T22:56:09.434626+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:11:58.367162+0000","scrub_duration":0.0066969239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":7837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'44","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:53.013922+0000","last_change":"2023-12-13T22:56:53.013977+0000","last_active":"2023-12-13T22:56:53.013922+0000","last_peered":"2023-12-13T22:56:53.013922+0000","last_clean":"2023-12-13T22:56:53.013922+0000","last_became_active":"2023-12-13T22:26:00.420303+0000","last_became_peered":"2023-12-13T22:26:00.420303+0000","last_unstale":"2023-12-13T22:56:53.013922+0000","last_undegraded":"2023-12-13T22:56:53.013922+0000","last_fullsized":"2023-12-13T22:56:53.013922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:56:53.013677+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:56:53.013677+0000","last_clean_scrub_stamp":"2023-12-13T22:56:53.013677+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:47:34.989170+0000","scrub_duration":0.0037601470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"31'5","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.901897+0000","last_change":"2023-12-13T22:55:51.901953+0000","last_active":"2023-12-13T22:55:51.901897+0000","last_peered":"2023-12-13T22:55:51.901897+0000","last_clean":"2023-12-13T22:55:51.901897+0000","last_became_active":"2023-12-13T22:25:57.851840+0000","last_became_peered":"2023-12-13T22:25:57.851840+0000","last_unstale":"2023-12-13T22:55:51.901897+0000","last_undegraded":"2023-12-13T22:55:51.901897+0000","last_fullsized":"2023-12-13T22:55:51.901897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-12-13T22:55:51.901720+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.901720+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:54:32.031652+0000","scrub_duration":0.0054560959999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"31'110","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.403393+0000","last_change":"2023-12-13T22:56:18.403393+0000","last_active":"2023-12-13T22:56:18.403393+0000","last_peered":"2023-12-13T22:56:18.403393+0000","last_clean":"2023-12-13T22:56:18.403393+0000","last_became_active":"2023-12-13T22:26:06.544566+0000","last_became_peered":"2023-12-13T22:26:06.544566+0000","last_unstale":"2023-12-13T22:56:18.403393+0000","last_undegraded":"2023-12-13T22:56:18.403393+0000","last_fullsized":"2023-12-13T22:56:18.403393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'110","last_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_deep_scrub":"31'110","last_deep_scrub_stamp":"2023-12-13T22:56:18.403123+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.403123+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:23.426054+0000","scrub_duration":0.0094199109999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'44","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:42.473778+0000","last_change":"2023-12-13T22:56:42.473831+0000","last_active":"2023-12-13T22:56:42.473778+0000","last_peered":"2023-12-13T22:56:42.473778+0000","last_clean":"2023-12-13T22:56:42.473778+0000","last_became_active":"2023-12-13T22:27:03.083203+0000","last_became_peered":"2023-12-13T22:27:03.083203+0000","last_unstale":"2023-12-13T22:56:42.473778+0000","last_undegraded":"2023-12-13T22:56:42.473778+0000","last_fullsized":"2023-12-13T22:56:42.473778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:56:42.473572+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:56:42.473572+0000","last_clean_scrub_stamp":"2023-12-13T22:56:42.473572+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:13:43.795327+0000","scrub_duration":0.0032401830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.f","version":"31'265","reported_seq":308,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:50.957704+0000","last_change":"2023-12-13T22:55:50.957847+0000","last_active":"2023-12-13T22:55:50.957704+0000","last_peered":"2023-12-13T22:55:50.957704+0000","last_clean":"2023-12-13T22:55:50.957704+0000","last_became_active":"2023-12-13T22:25:57.854357+0000","last_became_peered":"2023-12-13T22:25:57.854357+0000","last_unstale":"2023-12-13T22:55:50.957704+0000","last_undegraded":"2023-12-13T22:55:50.957704+0000","last_fullsized":"2023-12-13T22:55:50.957704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'265","last_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_deep_scrub":"31'265","last_deep_scrub_stamp":"2023-12-13T22:55:50.957478+0000","last_clean_scrub_stamp":"2023-12-13T22:55:50.957478+0000","objects_scrubbed":2,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:05:25.538846+0000","scrub_duration":0.01053072,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"31'87","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.731840+0000","last_change":"2023-12-13T22:56:12.731840+0000","last_active":"2023-12-13T22:56:12.731840+0000","last_peered":"2023-12-13T22:56:12.731840+0000","last_clean":"2023-12-13T22:56:12.731840+0000","last_became_active":"2023-12-13T22:26:05.936960+0000","last_became_peered":"2023-12-13T22:26:05.936960+0000","last_unstale":"2023-12-13T22:56:12.731840+0000","last_undegraded":"2023-12-13T22:56:12.731840+0000","last_fullsized":"2023-12-13T22:56:12.731840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-12-13T22:56:12.731398+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.731398+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:54.102853+0000","scrub_duration":0.0074439079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":9785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"31'36","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.912661+0000","last_change":"2023-12-13T22:55:53.912661+0000","last_active":"2023-12-13T22:55:53.912661+0000","last_peered":"2023-12-13T22:55:53.912661+0000","last_clean":"2023-12-13T22:55:53.912661+0000","last_became_active":"2023-12-13T22:26:00.418432+0000","last_became_peered":"2023-12-13T22:26:00.418432+0000","last_unstale":"2023-12-13T22:55:53.912661+0000","last_undegraded":"2023-12-13T22:55:53.912661+0000","last_fullsized":"2023-12-13T22:55:53.912661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:55:53.912416+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.912416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:42:01.014828+0000","scrub_duration":0.002904542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'268","reported_seq":311,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.722659+0000","last_change":"2023-12-13T22:56:02.722659+0000","last_active":"2023-12-13T22:56:02.722659+0000","last_peered":"2023-12-13T22:56:02.722659+0000","last_clean":"2023-12-13T22:56:02.722659+0000","last_became_active":"2023-12-13T22:25:57.853186+0000","last_became_peered":"2023-12-13T22:25:57.853186+0000","last_unstale":"2023-12-13T22:56:02.722659+0000","last_undegraded":"2023-12-13T22:56:02.722659+0000","last_fullsized":"2023-12-13T22:56:02.722659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'268","last_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_deep_scrub":"31'268","last_deep_scrub_stamp":"2023-12-13T22:56:02.722401+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.722401+0000","objects_scrubbed":8,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:57:04.531070+0000","scrub_duration":0.015955368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"31'73","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.424794+0000","last_change":"2023-12-13T22:56:11.424852+0000","last_active":"2023-12-13T22:56:11.424794+0000","last_peered":"2023-12-13T22:56:11.424794+0000","last_clean":"2023-12-13T22:56:11.424794+0000","last_became_active":"2023-12-13T22:26:05.936105+0000","last_became_peered":"2023-12-13T22:26:05.936105+0000","last_unstale":"2023-12-13T22:56:11.424794+0000","last_undegraded":"2023-12-13T22:56:11.424794+0000","last_fullsized":"2023-12-13T22:56:11.424794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2023-12-13T22:56:11.424585+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.424585+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:17:00.237813+0000","scrub_duration":0.0064149180000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":8139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'31","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.193654+0000","last_change":"2023-12-13T22:56:27.193813+0000","last_active":"2023-12-13T22:56:27.193654+0000","last_peered":"2023-12-13T22:56:27.193654+0000","last_clean":"2023-12-13T22:56:27.193654+0000","last_became_active":"2023-12-13T22:26:00.375754+0000","last_became_peered":"2023-12-13T22:26:00.375754+0000","last_unstale":"2023-12-13T22:56:27.193654+0000","last_undegraded":"2023-12-13T22:56:27.193654+0000","last_fullsized":"2023-12-13T22:56:27.193654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-12-13T22:56:27.193306+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.193306+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:44.761451+0000","scrub_duration":0.0042190769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"31'1021","reported_seq":1064,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.174135+0000","last_change":"2023-12-13T22:56:06.174135+0000","last_active":"2023-12-13T22:56:06.174135+0000","last_peered":"2023-12-13T22:56:06.174135+0000","last_clean":"2023-12-13T22:56:06.174135+0000","last_became_active":"2023-12-13T22:25:57.849951+0000","last_became_peered":"2023-12-13T22:25:57.849951+0000","last_unstale":"2023-12-13T22:56:06.174135+0000","last_undegraded":"2023-12-13T22:56:06.174135+0000","last_fullsized":"2023-12-13T22:56:06.174135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1021","last_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_deep_scrub":"31'1021","last_deep_scrub_stamp":"2023-12-13T22:56:06.173900+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.173900+0000","objects_scrubbed":2,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:43:30.653912+0000","scrub_duration":0.027900313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":4646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'88","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:52.242282+0000","last_change":"2023-12-13T22:56:52.242339+0000","last_active":"2023-12-13T22:56:52.242282+0000","last_peered":"2023-12-13T22:56:52.242282+0000","last_clean":"2023-12-13T22:56:52.242282+0000","last_became_active":"2023-12-13T22:26:06.552558+0000","last_became_peered":"2023-12-13T22:26:06.552558+0000","last_unstale":"2023-12-13T22:56:52.242282+0000","last_undegraded":"2023-12-13T22:56:52.242282+0000","last_fullsized":"2023-12-13T22:56:52.242282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-12-13T22:56:52.242066+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-12-13T22:56:52.242066+0000","last_clean_scrub_stamp":"2023-12-13T22:56:52.242066+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:20:42.255631+0000","scrub_duration":0.0070539900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":7333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'48","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.000650+0000","last_change":"2023-12-13T22:56:24.000702+0000","last_active":"2023-12-13T22:56:24.000650+0000","last_peered":"2023-12-13T22:56:24.000650+0000","last_clean":"2023-12-13T22:56:24.000650+0000","last_became_active":"2023-12-13T22:26:00.418532+0000","last_became_peered":"2023-12-13T22:26:00.418532+0000","last_unstale":"2023-12-13T22:56:24.000650+0000","last_undegraded":"2023-12-13T22:56:24.000650+0000","last_fullsized":"2023-12-13T22:56:24.000650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:24.000443+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.000443+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:43:37.900045+0000","scrub_duration":0.0024080159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.398798+0000","last_change":"2023-12-13T22:55:55.398798+0000","last_active":"2023-12-13T22:55:55.398798+0000","last_peered":"2023-12-13T22:55:55.398798+0000","last_clean":"2023-12-13T22:55:55.398798+0000","last_became_active":"2023-12-13T22:25:57.857377+0000","last_became_peered":"2023-12-13T22:25:57.857377+0000","last_unstale":"2023-12-13T22:55:55.398798+0000","last_undegraded":"2023-12-13T22:55:55.398798+0000","last_fullsized":"2023-12-13T22:55:55.398798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'7","last_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_deep_scrub":"31'7","last_deep_scrub_stamp":"2023-12-13T22:55:55.398473+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.398473+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:55:02.104213+0000","scrub_duration":0.0061603880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'94","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:47.177361+0000","last_change":"2023-12-13T22:56:47.177420+0000","last_active":"2023-12-13T22:56:47.177361+0000","last_peered":"2023-12-13T22:56:47.177361+0000","last_clean":"2023-12-13T22:56:47.177361+0000","last_became_active":"2023-12-13T22:27:03.567492+0000","last_became_peered":"2023-12-13T22:27:03.567492+0000","last_unstale":"2023-12-13T22:56:47.177361+0000","last_undegraded":"2023-12-13T22:56:47.177361+0000","last_fullsized":"2023-12-13T22:56:47.177361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-12-13T22:56:47.177160+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-12-13T22:56:47.177160+0000","last_clean_scrub_stamp":"2023-12-13T22:56:47.177160+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:06:07.871194+0000","scrub_duration":0.0074369700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'41","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:58.361680+0000","last_change":"2023-12-13T22:55:58.361680+0000","last_active":"2023-12-13T22:55:58.361680+0000","last_peered":"2023-12-13T22:55:58.361680+0000","last_clean":"2023-12-13T22:55:58.361680+0000","last_became_active":"2023-12-13T22:25:59.702703+0000","last_became_peered":"2023-12-13T22:25:59.702703+0000","last_unstale":"2023-12-13T22:55:58.361680+0000","last_undegraded":"2023-12-13T22:55:58.361680+0000","last_fullsized":"2023-12-13T22:55:58.361680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:55:58.361421+0000","last_clean_scrub_stamp":"2023-12-13T22:55:58.361421+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:57:39.970158+0000","scrub_duration":0.003149827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"31'12","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:49.403251+0000","last_change":"2023-12-13T22:55:49.403251+0000","last_active":"2023-12-13T22:55:49.403251+0000","last_peered":"2023-12-13T22:55:49.403251+0000","last_clean":"2023-12-13T22:55:49.403251+0000","last_became_active":"2023-12-13T22:25:57.856040+0000","last_became_peered":"2023-12-13T22:25:57.856040+0000","last_unstale":"2023-12-13T22:55:49.403251+0000","last_undegraded":"2023-12-13T22:55:49.403251+0000","last_fullsized":"2023-12-13T22:55:49.403251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-13T22:55:49.403136+0000","last_clean_scrub_stamp":"2023-12-13T22:55:49.403136+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:06:21.586077+0000","scrub_duration":0.0076955030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'76","reported_seq":114,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.349625+0000","last_change":"2023-12-13T22:56:22.349726+0000","last_active":"2023-12-13T22:56:22.349625+0000","last_peered":"2023-12-13T22:56:22.349625+0000","last_clean":"2023-12-13T22:56:22.349625+0000","last_became_active":"2023-12-13T22:26:06.550322+0000","last_became_peered":"2023-12-13T22:26:06.550322+0000","last_unstale":"2023-12-13T22:56:22.349625+0000","last_undegraded":"2023-12-13T22:56:22.349625+0000","last_fullsized":"2023-12-13T22:56:22.349625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'76","last_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_deep_scrub":"31'76","last_deep_scrub_stamp":"2023-12-13T22:56:22.349410+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.349410+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:35:11.433767+0000","scrub_duration":0.008386325,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":4001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.006958+0000","last_change":"2023-12-13T22:56:25.007013+0000","last_active":"2023-12-13T22:56:25.006958+0000","last_peered":"2023-12-13T22:56:25.006958+0000","last_clean":"2023-12-13T22:56:25.006958+0000","last_became_active":"2023-12-13T22:26:00.412356+0000","last_became_peered":"2023-12-13T22:26:00.412356+0000","last_unstale":"2023-12-13T22:56:25.006958+0000","last_undegraded":"2023-12-13T22:56:25.006958+0000","last_fullsized":"2023-12-13T22:56:25.006958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-12-13T22:56:25.006764+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.006764+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:46.182889+0000","scrub_duration":0.004328892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"31'1187","reported_seq":1230,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.224878+0000","last_change":"2023-12-13T22:55:53.224878+0000","last_active":"2023-12-13T22:55:53.224878+0000","last_peered":"2023-12-13T22:55:53.224878+0000","last_clean":"2023-12-13T22:55:53.224878+0000","last_became_active":"2023-12-13T22:25:57.840570+0000","last_became_peered":"2023-12-13T22:25:57.840570+0000","last_unstale":"2023-12-13T22:55:53.224878+0000","last_undegraded":"2023-12-13T22:55:53.224878+0000","last_fullsized":"2023-12-13T22:55:53.224878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1187","last_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_deep_scrub":"31'1187","last_deep_scrub_stamp":"2023-12-13T22:55:53.224528+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.224528+0000","objects_scrubbed":5,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:15:59.076548+0000","scrub_duration":0.029787111000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":4565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"31'78","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:24.822613+0000","last_change":"2023-12-13T22:56:24.822613+0000","last_active":"2023-12-13T22:56:24.822613+0000","last_peered":"2023-12-13T22:56:24.822613+0000","last_clean":"2023-12-13T22:56:24.822613+0000","last_became_active":"2023-12-13T22:26:05.938309+0000","last_became_peered":"2023-12-13T22:26:05.938309+0000","last_unstale":"2023-12-13T22:56:24.822613+0000","last_undegraded":"2023-12-13T22:56:24.822613+0000","last_fullsized":"2023-12-13T22:56:24.822613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'78","last_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_deep_scrub":"31'78","last_deep_scrub_stamp":"2023-12-13T22:56:24.822281+0000","last_clean_scrub_stamp":"2023-12-13T22:56:24.822281+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:20.279273+0000","scrub_duration":0.0075375160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:56.934053+0000","last_change":"2023-12-13T22:55:56.934053+0000","last_active":"2023-12-13T22:55:56.934053+0000","last_peered":"2023-12-13T22:55:56.934053+0000","last_clean":"2023-12-13T22:55:56.934053+0000","last_became_active":"2023-12-13T22:26:00.402596+0000","last_became_peered":"2023-12-13T22:26:00.402596+0000","last_unstale":"2023-12-13T22:55:56.934053+0000","last_undegraded":"2023-12-13T22:55:56.934053+0000","last_fullsized":"2023-12-13T22:55:56.934053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:55:56.933891+0000","last_clean_scrub_stamp":"2023-12-13T22:55:56.933891+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:27:43.656236+0000","scrub_duration":0.002368658,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"31'130","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.782407+0000","last_change":"2023-12-13T22:55:59.782469+0000","last_active":"2023-12-13T22:55:59.782407+0000","last_peered":"2023-12-13T22:55:59.782407+0000","last_clean":"2023-12-13T22:55:59.782407+0000","last_became_active":"2023-12-13T22:25:57.862478+0000","last_became_peered":"2023-12-13T22:25:57.862478+0000","last_unstale":"2023-12-13T22:55:59.782407+0000","last_undegraded":"2023-12-13T22:55:59.782407+0000","last_fullsized":"2023-12-13T22:55:59.782407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'130","last_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_deep_scrub":"31'130","last_deep_scrub_stamp":"2023-12-13T22:55:59.782224+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.782224+0000","objects_scrubbed":3,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:14.537967+0000","scrub_duration":0.0092044889999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'72","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.752082+0000","last_change":"2023-12-13T22:56:06.752082+0000","last_active":"2023-12-13T22:56:06.752082+0000","last_peered":"2023-12-13T22:56:06.752082+0000","last_clean":"2023-12-13T22:56:06.752082+0000","last_became_active":"2023-12-13T22:26:05.939137+0000","last_became_peered":"2023-12-13T22:26:05.939137+0000","last_unstale":"2023-12-13T22:56:06.752082+0000","last_undegraded":"2023-12-13T22:56:06.752082+0000","last_fullsized":"2023-12-13T22:56:06.752082+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'72","last_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_deep_scrub":"31'72","last_deep_scrub_stamp":"2023-12-13T22:56:06.751811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.751811+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T00:41:52.144373+0000","scrub_duration":0.0073970829999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":13248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:07.446914+0000","last_change":"2023-12-13T22:56:07.446965+0000","last_active":"2023-12-13T22:56:07.446914+0000","last_peered":"2023-12-13T22:56:07.446914+0000","last_clean":"2023-12-13T22:56:07.446914+0000","last_became_active":"2023-12-13T22:25:59.501208+0000","last_became_peered":"2023-12-13T22:25:59.501208+0000","last_unstale":"2023-12-13T22:56:07.446914+0000","last_undegraded":"2023-12-13T22:56:07.446914+0000","last_fullsized":"2023-12-13T22:56:07.446914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:56:07.446725+0000","last_clean_scrub_stamp":"2023-12-13T22:56:07.446725+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:18:14.638863+0000","scrub_duration":0.0036426369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:53.377308+0000","last_change":"2023-12-13T22:55:53.377429+0000","last_active":"2023-12-13T22:55:53.377308+0000","last_peered":"2023-12-13T22:55:53.377308+0000","last_clean":"2023-12-13T22:55:53.377308+0000","last_became_active":"2023-12-13T22:25:57.860214+0000","last_became_peered":"2023-12-13T22:25:57.860214+0000","last_unstale":"2023-12-13T22:55:53.377308+0000","last_undegraded":"2023-12-13T22:55:53.377308+0000","last_fullsized":"2023-12-13T22:55:53.377308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-12-13T22:55:53.377020+0000","last_clean_scrub_stamp":"2023-12-13T22:55:53.377020+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:08.132763+0000","scrub_duration":0.0054373049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"31'89","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:45.186045+0000","last_change":"2023-12-13T22:56:45.186165+0000","last_active":"2023-12-13T22:56:45.186045+0000","last_peered":"2023-12-13T22:56:45.186045+0000","last_clean":"2023-12-13T22:56:45.186045+0000","last_became_active":"2023-12-13T22:26:05.945563+0000","last_became_peered":"2023-12-13T22:26:05.945563+0000","last_unstale":"2023-12-13T22:56:45.186045+0000","last_undegraded":"2023-12-13T22:56:45.186045+0000","last_fullsized":"2023-12-13T22:56:45.186045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-12-13T22:56:45.185811+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-12-13T22:56:45.185811+0000","last_clean_scrub_stamp":"2023-12-13T22:56:45.185811+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:48:34.091715+0000","scrub_duration":0.010774687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":10109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.471767+0000","last_change":"2023-12-13T22:56:06.471822+0000","last_active":"2023-12-13T22:56:06.471767+0000","last_peered":"2023-12-13T22:56:06.471767+0000","last_clean":"2023-12-13T22:56:06.471767+0000","last_became_active":"2023-12-13T22:26:00.409725+0000","last_became_peered":"2023-12-13T22:26:00.409725+0000","last_unstale":"2023-12-13T22:56:06.471767+0000","last_undegraded":"2023-12-13T22:56:06.471767+0000","last_fullsized":"2023-12-13T22:56:06.471767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:06.471493+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.471493+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:53.672723+0000","scrub_duration":0.0040682790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"31'92","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:11.175160+0000","last_change":"2023-12-13T22:56:11.175209+0000","last_active":"2023-12-13T22:56:11.175160+0000","last_peered":"2023-12-13T22:56:11.175160+0000","last_clean":"2023-12-13T22:56:11.175160+0000","last_became_active":"2023-12-13T22:25:57.849909+0000","last_became_peered":"2023-12-13T22:25:57.849909+0000","last_unstale":"2023-12-13T22:56:11.175160+0000","last_undegraded":"2023-12-13T22:56:11.175160+0000","last_fullsized":"2023-12-13T22:56:11.175160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'92","last_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_deep_scrub":"31'92","last_deep_scrub_stamp":"2023-12-13T22:56:11.175043+0000","last_clean_scrub_stamp":"2023-12-13T22:56:11.175043+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:07:40.382392+0000","scrub_duration":0.0069995819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"31'50","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:27.116512+0000","last_change":"2023-12-13T22:56:27.116512+0000","last_active":"2023-12-13T22:56:27.116512+0000","last_peered":"2023-12-13T22:56:27.116512+0000","last_clean":"2023-12-13T22:56:27.116512+0000","last_became_active":"2023-12-13T22:26:06.553041+0000","last_became_peered":"2023-12-13T22:26:06.553041+0000","last_unstale":"2023-12-13T22:56:27.116512+0000","last_undegraded":"2023-12-13T22:56:27.116512+0000","last_fullsized":"2023-12-13T22:56:27.116512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:27.116244+0000","last_clean_scrub_stamp":"2023-12-13T22:56:27.116244+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:39:45.231694+0000","scrub_duration":0.0073969650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":7016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"31'71","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:10.461548+0000","last_change":"2023-12-13T22:56:10.461606+0000","last_active":"2023-12-13T22:56:10.461548+0000","last_peered":"2023-12-13T22:56:10.461548+0000","last_clean":"2023-12-13T22:56:10.461548+0000","last_became_active":"2023-12-13T22:26:06.553379+0000","last_became_peered":"2023-12-13T22:26:06.553379+0000","last_unstale":"2023-12-13T22:56:10.461548+0000","last_undegraded":"2023-12-13T22:56:10.461548+0000","last_fullsized":"2023-12-13T22:56:10.461548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'71","last_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_deep_scrub":"31'71","last_deep_scrub_stamp":"2023-12-13T22:56:10.461318+0000","last_clean_scrub_stamp":"2023-12-13T22:56:10.461318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:05:24.742614+0000","scrub_duration":0.007727856,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"31'45","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:47.617154+0000","last_change":"2023-12-13T22:55:47.617203+0000","last_active":"2023-12-13T22:55:47.617154+0000","last_peered":"2023-12-13T22:55:47.617154+0000","last_clean":"2023-12-13T22:55:47.617154+0000","last_became_active":"2023-12-13T22:26:00.411548+0000","last_became_peered":"2023-12-13T22:26:00.411548+0000","last_unstale":"2023-12-13T22:55:47.617154+0000","last_undegraded":"2023-12-13T22:55:47.617154+0000","last_fullsized":"2023-12-13T22:55:47.617154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:55:47.617039+0000","last_clean_scrub_stamp":"2023-12-13T22:55:47.617039+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T02:16:57.072541+0000","scrub_duration":0.0027396679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.453354+0000","last_change":"2023-12-13T22:56:01.453406+0000","last_active":"2023-12-13T22:56:01.453354+0000","last_peered":"2023-12-13T22:56:01.453354+0000","last_clean":"2023-12-13T22:56:01.453354+0000","last_became_active":"2023-12-13T22:25:57.860520+0000","last_became_peered":"2023-12-13T22:25:57.860520+0000","last_unstale":"2023-12-13T22:56:01.453354+0000","last_undegraded":"2023-12-13T22:56:01.453354+0000","last_fullsized":"2023-12-13T22:56:01.453354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-13T22:56:01.453158+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.453158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:13.446611+0000","scrub_duration":0.0027122370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'82","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:57:02.252938+0000","last_change":"2023-12-13T22:57:02.252991+0000","last_active":"2023-12-13T22:57:02.252938+0000","last_peered":"2023-12-13T22:57:02.252938+0000","last_clean":"2023-12-13T22:57:02.252938+0000","last_became_active":"2023-12-13T22:26:05.935806+0000","last_became_peered":"2023-12-13T22:26:05.935806+0000","last_unstale":"2023-12-13T22:57:02.252938+0000","last_undegraded":"2023-12-13T22:57:02.252938+0000","last_fullsized":"2023-12-13T22:57:02.252938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2023-12-13T22:57:02.252739+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2023-12-13T22:57:02.252739+0000","last_clean_scrub_stamp":"2023-12-13T22:57:02.252739+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T05:06:25.312278+0000","scrub_duration":0.0078964459999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":10203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:25.131057+0000","last_change":"2023-12-13T22:56:25.131109+0000","last_active":"2023-12-13T22:56:25.131057+0000","last_peered":"2023-12-13T22:56:25.131057+0000","last_clean":"2023-12-13T22:56:25.131057+0000","last_became_active":"2023-12-13T22:26:00.394067+0000","last_became_peered":"2023-12-13T22:26:00.394067+0000","last_unstale":"2023-12-13T22:56:25.131057+0000","last_undegraded":"2023-12-13T22:56:25.131057+0000","last_fullsized":"2023-12-13T22:56:25.131057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:25.130834+0000","last_clean_scrub_stamp":"2023-12-13T22:56:25.130834+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:47:07.106327+0000","scrub_duration":0.0032470709999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"31'211","reported_seq":453,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:02.108706+0000","last_change":"2023-12-13T22:56:02.108772+0000","last_active":"2023-12-13T22:56:02.108706+0000","last_peered":"2023-12-13T22:56:02.108706+0000","last_clean":"2023-12-13T22:56:02.108706+0000","last_became_active":"2023-12-13T22:25:57.860453+0000","last_became_peered":"2023-12-13T22:25:57.860453+0000","last_unstale":"2023-12-13T22:56:02.108706+0000","last_undegraded":"2023-12-13T22:56:02.108706+0000","last_fullsized":"2023-12-13T22:56:02.108706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'211","last_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_deep_scrub":"31'211","last_deep_scrub_stamp":"2023-12-13T22:56:02.108492+0000","last_clean_scrub_stamp":"2023-12-13T22:56:02.108492+0000","objects_scrubbed":2,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:16:43.479948+0000","scrub_duration":0.0095572120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":200,"num_read_kb":209,"num_write":203,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"31'307","reported_seq":645,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.204092+0000","last_change":"2023-12-13T22:56:15.204157+0000","last_active":"2023-12-13T22:56:15.204092+0000","last_peered":"2023-12-13T22:56:15.204092+0000","last_clean":"2023-12-13T22:56:15.204092+0000","last_became_active":"2023-12-13T22:25:57.849465+0000","last_became_peered":"2023-12-13T22:25:57.849465+0000","last_unstale":"2023-12-13T22:56:15.204092+0000","last_undegraded":"2023-12-13T22:56:15.204092+0000","last_fullsized":"2023-12-13T22:56:15.204092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'307","last_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_deep_scrub":"31'307","last_deep_scrub_stamp":"2023-12-13T22:56:15.203889+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.203889+0000","objects_scrubbed":2,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:27.197342+0000","scrub_duration":0.0078670609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56317,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":308,"num_write":299,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"31'46","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.377972+0000","last_change":"2023-12-13T22:55:51.377972+0000","last_active":"2023-12-13T22:55:51.377972+0000","last_peered":"2023-12-13T22:55:51.377972+0000","last_clean":"2023-12-13T22:55:51.377972+0000","last_became_active":"2023-12-13T22:25:59.493269+0000","last_became_peered":"2023-12-13T22:25:59.493269+0000","last_unstale":"2023-12-13T22:55:51.377972+0000","last_undegraded":"2023-12-13T22:55:51.377972+0000","last_fullsized":"2023-12-13T22:55:51.377972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:51.377829+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.377829+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:25:56.812795+0000","scrub_duration":0.002123673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'61","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.728227+0000","last_change":"2023-12-13T22:56:12.728337+0000","last_active":"2023-12-13T22:56:12.728227+0000","last_peered":"2023-12-13T22:56:12.728227+0000","last_clean":"2023-12-13T22:56:12.728227+0000","last_became_active":"2023-12-13T22:26:05.940037+0000","last_became_peered":"2023-12-13T22:26:05.940037+0000","last_unstale":"2023-12-13T22:56:12.728227+0000","last_undegraded":"2023-12-13T22:56:12.728227+0000","last_fullsized":"2023-12-13T22:56:12.728227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'61","last_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_deep_scrub":"31'61","last_deep_scrub_stamp":"2023-12-13T22:56:12.727919+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.727919+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:31:35.351976+0000","scrub_duration":0.0075005030000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":5241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'2405","reported_seq":2447,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:01.130328+0000","last_change":"2023-12-13T22:56:01.130400+0000","last_active":"2023-12-13T22:56:01.130328+0000","last_peered":"2023-12-13T22:56:01.130328+0000","last_clean":"2023-12-13T22:56:01.130328+0000","last_became_active":"2023-12-13T22:25:57.854671+0000","last_became_peered":"2023-12-13T22:25:57.854671+0000","last_unstale":"2023-12-13T22:56:01.130328+0000","last_undegraded":"2023-12-13T22:56:01.130328+0000","last_fullsized":"2023-12-13T22:56:01.130328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2405","last_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_deep_scrub":"31'2405","last_deep_scrub_stamp":"2023-12-13T22:56:01.130136+0000","last_clean_scrub_stamp":"2023-12-13T22:56:01.130136+0000","objects_scrubbed":4,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:22:59.381743+0000","scrub_duration":0.058223199000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10688457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2391,"num_write_kb":11532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'54","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.925504+0000","last_change":"2023-12-13T22:55:55.925504+0000","last_active":"2023-12-13T22:55:55.925504+0000","last_peered":"2023-12-13T22:55:55.925504+0000","last_clean":"2023-12-13T22:55:55.925504+0000","last_became_active":"2023-12-13T22:26:00.411432+0000","last_became_peered":"2023-12-13T22:26:00.411432+0000","last_unstale":"2023-12-13T22:55:55.925504+0000","last_undegraded":"2023-12-13T22:55:55.925504+0000","last_fullsized":"2023-12-13T22:55:55.925504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'54","last_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_deep_scrub":"31'54","last_deep_scrub_stamp":"2023-12-13T22:55:55.925325+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.925325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:56:05.665814+0000","scrub_duration":0.003351882,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'55","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:51.235379+0000","last_change":"2023-12-13T22:56:51.235505+0000","last_active":"2023-12-13T22:56:51.235379+0000","last_peered":"2023-12-13T22:56:51.235379+0000","last_clean":"2023-12-13T22:56:51.235379+0000","last_became_active":"2023-12-13T22:26:05.947546+0000","last_became_peered":"2023-12-13T22:26:05.947546+0000","last_unstale":"2023-12-13T22:56:51.235379+0000","last_undegraded":"2023-12-13T22:56:51.235379+0000","last_fullsized":"2023-12-13T22:56:51.235379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'55","last_scrub_stamp":"2023-12-13T22:56:51.235046+0000","last_deep_scrub":"31'55","last_deep_scrub_stamp":"2023-12-13T22:56:51.235046+0000","last_clean_scrub_stamp":"2023-12-13T22:56:51.235046+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:24:54.402322+0000","scrub_duration":0.010183459000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.141163+0000","last_change":"2023-12-13T22:56:17.141276+0000","last_active":"2023-12-13T22:56:17.141163+0000","last_peered":"2023-12-13T22:56:17.141163+0000","last_clean":"2023-12-13T22:56:17.141163+0000","last_became_active":"2023-12-13T22:26:00.375111+0000","last_became_peered":"2023-12-13T22:26:00.375111+0000","last_unstale":"2023-12-13T22:56:17.141163+0000","last_undegraded":"2023-12-13T22:56:17.141163+0000","last_fullsized":"2023-12-13T22:56:17.141163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:17.140931+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.140931+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:41.360729+0000","scrub_duration":0.0032991119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"31'50","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:06.686736+0000","last_change":"2023-12-13T22:56:06.686792+0000","last_active":"2023-12-13T22:56:06.686736+0000","last_peered":"2023-12-13T22:56:06.686736+0000","last_clean":"2023-12-13T22:56:06.686736+0000","last_became_active":"2023-12-13T22:26:00.419461+0000","last_became_peered":"2023-12-13T22:26:00.419461+0000","last_unstale":"2023-12-13T22:56:06.686736+0000","last_undegraded":"2023-12-13T22:56:06.686736+0000","last_fullsized":"2023-12-13T22:56:06.686736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'50","last_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_deep_scrub":"31'50","last_deep_scrub_stamp":"2023-12-13T22:56:06.686540+0000","last_clean_scrub_stamp":"2023-12-13T22:56:06.686540+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:12.538560+0000","scrub_duration":0.0033057130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.437283+0000","last_change":"2023-12-13T22:56:15.437335+0000","last_active":"2023-12-13T22:56:15.437283+0000","last_peered":"2023-12-13T22:56:15.437283+0000","last_clean":"2023-12-13T22:56:15.437283+0000","last_became_active":"2023-12-13T22:26:00.408664+0000","last_became_peered":"2023-12-13T22:26:00.408664+0000","last_unstale":"2023-12-13T22:56:15.437283+0000","last_undegraded":"2023-12-13T22:56:15.437283+0000","last_fullsized":"2023-12-13T22:56:15.437283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.437095+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.437095+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:08:36.613220+0000","scrub_duration":0.0030693510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"31'36","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.371452+0000","last_change":"2023-12-13T22:56:05.371573+0000","last_active":"2023-12-13T22:56:05.371452+0000","last_peered":"2023-12-13T22:56:05.371452+0000","last_clean":"2023-12-13T22:56:05.371452+0000","last_became_active":"2023-12-13T22:26:00.242217+0000","last_became_peered":"2023-12-13T22:26:00.242217+0000","last_unstale":"2023-12-13T22:56:05.371452+0000","last_undegraded":"2023-12-13T22:56:05.371452+0000","last_fullsized":"2023-12-13T22:56:05.371452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-12-13T22:56:05.371135+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.371135+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:26:38.933074+0000","scrub_duration":0.003783182,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'28","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:51.973818+0000","last_change":"2023-12-13T22:55:51.973818+0000","last_active":"2023-12-13T22:55:51.973818+0000","last_peered":"2023-12-13T22:55:51.973818+0000","last_clean":"2023-12-13T22:55:51.973818+0000","last_became_active":"2023-12-13T22:26:00.411397+0000","last_became_peered":"2023-12-13T22:26:00.411397+0000","last_unstale":"2023-12-13T22:55:51.973818+0000","last_undegraded":"2023-12-13T22:55:51.973818+0000","last_fullsized":"2023-12-13T22:55:51.973818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-12-13T22:55:51.973584+0000","last_clean_scrub_stamp":"2023-12-13T22:55:51.973584+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:38:03.967036+0000","scrub_duration":0.0031747279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:38.539396+0000","last_change":"2023-12-13T22:56:38.539449+0000","last_active":"2023-12-13T22:56:38.539396+0000","last_peered":"2023-12-13T22:56:38.539396+0000","last_clean":"2023-12-13T22:56:38.539396+0000","last_became_active":"2023-12-13T22:27:03.084269+0000","last_became_peered":"2023-12-13T22:27:03.084269+0000","last_unstale":"2023-12-13T22:56:38.539396+0000","last_undegraded":"2023-12-13T22:56:38.539396+0000","last_fullsized":"2023-12-13T22:56:38.539396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-12-13T22:56:38.539201+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-12-13T22:56:38.539201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:38.539201+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:51.814917+0000","scrub_duration":0.0029796639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"31'44","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:51.132282+0000","last_change":"2023-12-13T22:56:51.132336+0000","last_active":"2023-12-13T22:56:51.132282+0000","last_peered":"2023-12-13T22:56:51.132282+0000","last_clean":"2023-12-13T22:56:51.132282+0000","last_became_active":"2023-12-13T22:26:00.405597+0000","last_became_peered":"2023-12-13T22:26:00.405597+0000","last_unstale":"2023-12-13T22:56:51.132282+0000","last_undegraded":"2023-12-13T22:56:51.132282+0000","last_fullsized":"2023-12-13T22:56:51.132282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'44","last_scrub_stamp":"2023-12-13T22:56:51.132088+0000","last_deep_scrub":"31'44","last_deep_scrub_stamp":"2023-12-13T22:56:51.132088+0000","last_clean_scrub_stamp":"2023-12-13T22:56:51.132088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:56.155019+0000","scrub_duration":0.0028821760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"31'29","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:59.094675+0000","last_change":"2023-12-13T22:55:59.094675+0000","last_active":"2023-12-13T22:55:59.094675+0000","last_peered":"2023-12-13T22:55:59.094675+0000","last_clean":"2023-12-13T22:55:59.094675+0000","last_became_active":"2023-12-13T22:26:00.400115+0000","last_became_peered":"2023-12-13T22:26:00.400115+0000","last_unstale":"2023-12-13T22:55:59.094675+0000","last_undegraded":"2023-12-13T22:55:59.094675+0000","last_fullsized":"2023-12-13T22:55:59.094675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-12-13T22:55:59.094434+0000","last_clean_scrub_stamp":"2023-12-13T22:55:59.094434+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:42:46.295665+0000","scrub_duration":0.004669416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"31'48","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:03.444743+0000","last_change":"2023-12-13T22:56:03.444743+0000","last_active":"2023-12-13T22:56:03.444743+0000","last_peered":"2023-12-13T22:56:03.444743+0000","last_clean":"2023-12-13T22:56:03.444743+0000","last_became_active":"2023-12-13T22:26:00.402256+0000","last_became_peered":"2023-12-13T22:26:00.402256+0000","last_unstale":"2023-12-13T22:56:03.444743+0000","last_undegraded":"2023-12-13T22:56:03.444743+0000","last_fullsized":"2023-12-13T22:56:03.444743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2023-12-13T22:56:03.444479+0000","last_clean_scrub_stamp":"2023-12-13T22:56:03.444479+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:27.664278+0000","scrub_duration":0.0038001070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"31'53","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:12.060063+0000","last_change":"2023-12-13T22:56:12.060115+0000","last_active":"2023-12-13T22:56:12.060063+0000","last_peered":"2023-12-13T22:56:12.060063+0000","last_clean":"2023-12-13T22:56:12.060063+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:12.060063+0000","last_undegraded":"2023-12-13T22:56:12.060063+0000","last_fullsized":"2023-12-13T22:56:12.060063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'53","last_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_deep_scrub":"31'53","last_deep_scrub_stamp":"2023-12-13T22:56:12.059861+0000","last_clean_scrub_stamp":"2023-12-13T22:56:12.059861+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:58.603714+0000","scrub_duration":0.0032058569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"31'51","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:17.404719+0000","last_change":"2023-12-13T22:56:17.404772+0000","last_active":"2023-12-13T22:56:17.404719+0000","last_peered":"2023-12-13T22:56:17.404719+0000","last_clean":"2023-12-13T22:56:17.404719+0000","last_became_active":"2023-12-13T22:26:00.416729+0000","last_became_peered":"2023-12-13T22:26:00.416729+0000","last_unstale":"2023-12-13T22:56:17.404719+0000","last_undegraded":"2023-12-13T22:56:17.404719+0000","last_fullsized":"2023-12-13T22:56:17.404719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'51","last_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_deep_scrub":"31'51","last_deep_scrub_stamp":"2023-12-13T22:56:17.404502+0000","last_clean_scrub_stamp":"2023-12-13T22:56:17.404502+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:41:57.947441+0000","scrub_duration":0.0028916459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"31'43","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.419542+0000","last_change":"2023-12-13T22:56:08.419598+0000","last_active":"2023-12-13T22:56:08.419542+0000","last_peered":"2023-12-13T22:56:08.419542+0000","last_clean":"2023-12-13T22:56:08.419542+0000","last_became_active":"2023-12-13T22:25:59.702758+0000","last_became_peered":"2023-12-13T22:25:59.702758+0000","last_unstale":"2023-12-13T22:56:08.419542+0000","last_undegraded":"2023-12-13T22:56:08.419542+0000","last_fullsized":"2023-12-13T22:56:08.419542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:08.419342+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.419342+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:30:31.998132+0000","scrub_duration":0.0036186209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"31'39","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:29.143708+0000","last_change":"2023-12-13T22:56:29.143762+0000","last_active":"2023-12-13T22:56:29.143708+0000","last_peered":"2023-12-13T22:56:29.143708+0000","last_clean":"2023-12-13T22:56:29.143708+0000","last_became_active":"2023-12-13T22:26:00.399551+0000","last_became_peered":"2023-12-13T22:26:00.399551+0000","last_unstale":"2023-12-13T22:56:29.143708+0000","last_undegraded":"2023-12-13T22:56:29.143708+0000","last_fullsized":"2023-12-13T22:56:29.143708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:29.143490+0000","last_clean_scrub_stamp":"2023-12-13T22:56:29.143490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:27.395097+0000","scrub_duration":0.002849107,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"31'45","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:35.035831+0000","last_change":"2023-12-13T22:56:35.035939+0000","last_active":"2023-12-13T22:56:35.035831+0000","last_peered":"2023-12-13T22:56:35.035831+0000","last_clean":"2023-12-13T22:56:35.035831+0000","last_became_active":"2023-12-13T22:26:00.408249+0000","last_became_peered":"2023-12-13T22:26:00.408249+0000","last_unstale":"2023-12-13T22:56:35.035831+0000","last_undegraded":"2023-12-13T22:56:35.035831+0000","last_fullsized":"2023-12-13T22:56:35.035831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:56:35.035600+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:56:35.035600+0000","last_clean_scrub_stamp":"2023-12-13T22:56:35.035600+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:16:28.285193+0000","scrub_duration":0.00386243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"31'52","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:05.714541+0000","last_change":"2023-12-13T22:56:05.714541+0000","last_active":"2023-12-13T22:56:05.714541+0000","last_peered":"2023-12-13T22:56:05.714541+0000","last_clean":"2023-12-13T22:56:05.714541+0000","last_became_active":"2023-12-13T22:26:00.415446+0000","last_became_peered":"2023-12-13T22:26:00.415446+0000","last_unstale":"2023-12-13T22:56:05.714541+0000","last_undegraded":"2023-12-13T22:56:05.714541+0000","last_fullsized":"2023-12-13T22:56:05.714541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2023-12-13T22:56:05.714201+0000","last_clean_scrub_stamp":"2023-12-13T22:56:05.714201+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:34:46.397683+0000","scrub_duration":0.0032594479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"31'33","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:23.791895+0000","last_change":"2023-12-13T22:56:23.792009+0000","last_active":"2023-12-13T22:56:23.791895+0000","last_peered":"2023-12-13T22:56:23.791895+0000","last_clean":"2023-12-13T22:56:23.791895+0000","last_became_active":"2023-12-13T22:27:03.508624+0000","last_became_peered":"2023-12-13T22:27:03.508624+0000","last_unstale":"2023-12-13T22:56:23.791895+0000","last_undegraded":"2023-12-13T22:56:23.791895+0000","last_fullsized":"2023-12-13T22:56:23.791895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:23.791658+0000","last_clean_scrub_stamp":"2023-12-13T22:56:23.791658+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T10:30:19.976664+0000","scrub_duration":0.0052480870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"31'47","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:04.447837+0000","last_change":"2023-12-13T22:56:04.447837+0000","last_active":"2023-12-13T22:56:04.447837+0000","last_peered":"2023-12-13T22:56:04.447837+0000","last_clean":"2023-12-13T22:56:04.447837+0000","last_became_active":"2023-12-13T22:26:00.394485+0000","last_became_peered":"2023-12-13T22:26:00.394485+0000","last_unstale":"2023-12-13T22:56:04.447837+0000","last_undegraded":"2023-12-13T22:56:04.447837+0000","last_fullsized":"2023-12-13T22:56:04.447837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:04.447580+0000","last_clean_scrub_stamp":"2023-12-13T22:56:04.447580+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:29:45.101318+0000","scrub_duration":0.0029573310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"31'37","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.932165+0000","last_change":"2023-12-13T22:56:15.932165+0000","last_active":"2023-12-13T22:56:15.932165+0000","last_peered":"2023-12-13T22:56:15.932165+0000","last_clean":"2023-12-13T22:56:15.932165+0000","last_became_active":"2023-12-13T22:26:00.416411+0000","last_became_peered":"2023-12-13T22:26:00.416411+0000","last_unstale":"2023-12-13T22:56:15.932165+0000","last_undegraded":"2023-12-13T22:56:15.932165+0000","last_fullsized":"2023-12-13T22:56:15.932165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:15.931903+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.931903+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:44:33.500048+0000","scrub_duration":0.0045191739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"31'46","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:46.425498+0000","last_change":"2023-12-13T22:55:46.425498+0000","last_active":"2023-12-13T22:55:46.425498+0000","last_peered":"2023-12-13T22:55:46.425498+0000","last_clean":"2023-12-13T22:55:46.425498+0000","last_became_active":"2023-12-13T22:26:00.283364+0000","last_became_peered":"2023-12-13T22:26:00.283364+0000","last_unstale":"2023-12-13T22:55:46.425498+0000","last_undegraded":"2023-12-13T22:55:46.425498+0000","last_fullsized":"2023-12-13T22:55:46.425498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-12-13T22:55:46.425334+0000","last_clean_scrub_stamp":"2023-12-13T22:55:46.425334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:25:04.502584+0000","scrub_duration":0.0031700270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"31'40","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:55:55.045257+0000","last_change":"2023-12-13T22:55:55.045309+0000","last_active":"2023-12-13T22:55:55.045257+0000","last_peered":"2023-12-13T22:55:55.045257+0000","last_clean":"2023-12-13T22:55:55.045257+0000","last_became_active":"2023-12-13T22:26:00.389062+0000","last_became_peered":"2023-12-13T22:26:00.389062+0000","last_unstale":"2023-12-13T22:55:55.045257+0000","last_undegraded":"2023-12-13T22:55:55.045257+0000","last_fullsized":"2023-12-13T22:55:55.045257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:55:55.045057+0000","last_clean_scrub_stamp":"2023-12-13T22:55:55.045057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T09:27:19.264855+0000","scrub_duration":0.0059794330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"31'42","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.814231+0000","last_change":"2023-12-13T22:56:00.814334+0000","last_active":"2023-12-13T22:56:00.814231+0000","last_peered":"2023-12-13T22:56:00.814231+0000","last_clean":"2023-12-13T22:56:00.814231+0000","last_became_active":"2023-12-13T22:26:00.397404+0000","last_became_peered":"2023-12-13T22:26:00.397404+0000","last_unstale":"2023-12-13T22:56:00.814231+0000","last_undegraded":"2023-12-13T22:56:00.814231+0000","last_fullsized":"2023-12-13T22:56:00.814231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-12-13T22:56:00.814016+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.814016+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:00:25.005375+0000","scrub_duration":0.0031933970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"31'43","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:32.107940+0000","last_change":"2023-12-13T22:56:32.107990+0000","last_active":"2023-12-13T22:56:32.107940+0000","last_peered":"2023-12-13T22:56:32.107940+0000","last_clean":"2023-12-13T22:56:32.107940+0000","last_became_active":"2023-12-13T22:26:00.395915+0000","last_became_peered":"2023-12-13T22:26:00.395915+0000","last_unstale":"2023-12-13T22:56:32.107940+0000","last_undegraded":"2023-12-13T22:56:32.107940+0000","last_fullsized":"2023-12-13T22:56:32.107940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-12-13T22:56:32.107754+0000","last_clean_scrub_stamp":"2023-12-13T22:56:32.107754+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:13.479210+0000","scrub_duration":0.0060879649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"31'41","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:41.162939+0000","last_change":"2023-12-13T22:56:41.163043+0000","last_active":"2023-12-13T22:56:41.162939+0000","last_peered":"2023-12-13T22:56:41.162939+0000","last_clean":"2023-12-13T22:56:41.162939+0000","last_became_active":"2023-12-13T22:26:00.395741+0000","last_became_peered":"2023-12-13T22:26:00.395741+0000","last_unstale":"2023-12-13T22:56:41.162939+0000","last_undegraded":"2023-12-13T22:56:41.162939+0000","last_fullsized":"2023-12-13T22:56:41.162939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'41","last_scrub_stamp":"2023-12-13T22:56:41.162635+0000","last_deep_scrub":"31'41","last_deep_scrub_stamp":"2023-12-13T22:56:41.162635+0000","last_clean_scrub_stamp":"2023-12-13T22:56:41.162635+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:09:02.338760+0000","scrub_duration":0.0038309170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"31'37","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:49.090328+0000","last_change":"2023-12-13T22:56:49.090436+0000","last_active":"2023-12-13T22:56:49.090328+0000","last_peered":"2023-12-13T22:56:49.090328+0000","last_clean":"2023-12-13T22:56:49.090328+0000","last_became_active":"2023-12-13T22:26:00.420051+0000","last_became_peered":"2023-12-13T22:26:00.420051+0000","last_unstale":"2023-12-13T22:56:49.090328+0000","last_undegraded":"2023-12-13T22:56:49.090328+0000","last_fullsized":"2023-12-13T22:56:49.090328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:49.090081+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:49.090081+0000","last_clean_scrub_stamp":"2023-12-13T22:56:49.090081+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T01:13:50.411837+0000","scrub_duration":0.0036323039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"31'47","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:18.166004+0000","last_change":"2023-12-13T22:56:18.166056+0000","last_active":"2023-12-13T22:56:18.166004+0000","last_peered":"2023-12-13T22:56:18.166004+0000","last_clean":"2023-12-13T22:56:18.166004+0000","last_became_active":"2023-12-13T22:26:00.398117+0000","last_became_peered":"2023-12-13T22:26:00.398117+0000","last_unstale":"2023-12-13T22:56:18.166004+0000","last_undegraded":"2023-12-13T22:56:18.166004+0000","last_fullsized":"2023-12-13T22:56:18.166004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2023-12-13T22:56:18.165819+0000","last_clean_scrub_stamp":"2023-12-13T22:56:18.165819+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T07:52:05.012128+0000","scrub_duration":0.0031531789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'39","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:14.953679+0000","last_change":"2023-12-13T22:56:14.953804+0000","last_active":"2023-12-13T22:56:14.953679+0000","last_peered":"2023-12-13T22:56:14.953679+0000","last_clean":"2023-12-13T22:56:14.953679+0000","last_became_active":"2023-12-13T22:26:00.409674+0000","last_became_peered":"2023-12-13T22:26:00.409674+0000","last_unstale":"2023-12-13T22:56:14.953679+0000","last_undegraded":"2023-12-13T22:56:14.953679+0000","last_fullsized":"2023-12-13T22:56:14.953679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:14.953450+0000","last_clean_scrub_stamp":"2023-12-13T22:56:14.953450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:18:06.958901+0000","scrub_duration":0.0034872829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"31'33","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:15.746406+0000","last_change":"2023-12-13T22:56:15.746406+0000","last_active":"2023-12-13T22:56:15.746406+0000","last_peered":"2023-12-13T22:56:15.746406+0000","last_clean":"2023-12-13T22:56:15.746406+0000","last_became_active":"2023-12-13T22:27:03.069281+0000","last_became_peered":"2023-12-13T22:27:03.069281+0000","last_unstale":"2023-12-13T22:56:15.746406+0000","last_undegraded":"2023-12-13T22:56:15.746406+0000","last_fullsized":"2023-12-13T22:56:15.746406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-12-13T22:56:15.746151+0000","last_clean_scrub_stamp":"2023-12-13T22:56:15.746151+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T04:59:30.501894+0000","scrub_duration":0.0031168839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"31'34","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:22.011702+0000","last_change":"2023-12-13T22:56:22.011755+0000","last_active":"2023-12-13T22:56:22.011702+0000","last_peered":"2023-12-13T22:56:22.011702+0000","last_clean":"2023-12-13T22:56:22.011702+0000","last_became_active":"2023-12-13T22:26:00.407014+0000","last_became_peered":"2023-12-13T22:26:00.407014+0000","last_unstale":"2023-12-13T22:56:22.011702+0000","last_undegraded":"2023-12-13T22:56:22.011702+0000","last_fullsized":"2023-12-13T22:56:22.011702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-12-13T22:56:22.011507+0000","last_clean_scrub_stamp":"2023-12-13T22:56:22.011507+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T08:17:03.382963+0000","scrub_duration":0.0049321959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"31'39","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:08.390246+0000","last_change":"2023-12-13T22:56:08.390301+0000","last_active":"2023-12-13T22:56:08.390246+0000","last_peered":"2023-12-13T22:56:08.390246+0000","last_clean":"2023-12-13T22:56:08.390246+0000","last_became_active":"2023-12-13T22:26:00.408952+0000","last_became_peered":"2023-12-13T22:26:00.408952+0000","last_unstale":"2023-12-13T22:56:08.390246+0000","last_undegraded":"2023-12-13T22:56:08.390246+0000","last_fullsized":"2023-12-13T22:56:08.390246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-12-13T22:56:08.390048+0000","last_clean_scrub_stamp":"2023-12-13T22:56:08.390048+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:06.641655+0000","scrub_duration":0.0035378689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"31'40","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:00.329949+0000","last_change":"2023-12-13T22:56:00.329949+0000","last_active":"2023-12-13T22:56:00.329949+0000","last_peered":"2023-12-13T22:56:00.329949+0000","last_clean":"2023-12-13T22:56:00.329949+0000","last_became_active":"2023-12-13T22:26:00.249089+0000","last_became_peered":"2023-12-13T22:26:00.249089+0000","last_unstale":"2023-12-13T22:56:00.329949+0000","last_undegraded":"2023-12-13T22:56:00.329949+0000","last_fullsized":"2023-12-13T22:56:00.329949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2023-12-13T22:56:00.329685+0000","last_clean_scrub_stamp":"2023-12-13T22:56:00.329685+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T06:23:06.433638+0000","scrub_duration":0.003895417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"31'37","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:20.885365+0000","last_change":"2023-12-13T22:56:20.885454+0000","last_active":"2023-12-13T22:56:20.885365+0000","last_peered":"2023-12-13T22:56:20.885365+0000","last_clean":"2023-12-13T22:56:20.885365+0000","last_became_active":"2023-12-13T22:26:00.410000+0000","last_became_peered":"2023-12-13T22:26:00.410000+0000","last_unstale":"2023-12-13T22:56:20.885365+0000","last_undegraded":"2023-12-13T22:56:20.885365+0000","last_fullsized":"2023-12-13T22:56:20.885365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-12-13T22:56:20.885143+0000","last_clean_scrub_stamp":"2023-12-13T22:56:20.885143+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-15T03:23:19.136750+0000","scrub_duration":0.0032445460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"31'45","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-13T22:56:44.092087+0000","last_change":"2023-12-13T22:56:44.092132+0000","last_active":"2023-12-13T22:56:44.092087+0000","last_peered":"2023-12-13T22:56:44.092087+0000","last_clean":"2023-12-13T22:56:44.092087+0000","last_became_active":"2023-12-13T22:26:00.413772+0000","last_became_peered":"2023-12-13T22:26:00.413772+0000","last_unstale":"2023-12-13T22:56:44.092087+0000","last_undegraded":"2023-12-13T22:56:44.092087+0000","last_fullsized":"2023-12-13T22:56:44.092087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2023-12-13T22:56:44.091933+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2023-12-13T22:56:44.091933+0000","last_clean_scrub_stamp":"2023-12-13T22:56:44.091933+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-14T23:39:57.367649+0000","scrub_duration":0.0052186139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":251180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2676,"ondisk_log_size":2676,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":25507220,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":649,"num_read_kb":675,"num_write":8981,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51167232,"data_stored":51014440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8094,"ondisk_log_size":8094,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477125,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67688,"kb_used_data":14304,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94304152,"statfs":{"total":96636764160,"available":96567451648,"internally_reserved":0,"allocated":14647296,"data_stored":14433553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86099999999999999,"15min":0.873},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.38100000000000001},"max":{"1min":1.3200000000000001,"5min":1.73,"15min":1.73},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.94099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":1.3859999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":0.95599999999999996}]},{"osd":1,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90800000000000003,"15min":0.91600000000000004},"min":{"1min":0.46100000000000002,"5min":0.42999999999999999,"15min":0.40000000000000002},"max":{"1min":1.409,"5min":2.165,"15min":2.165},"last":0.88},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.002,"15min":0.98699999999999999},"min":{"1min":0.58699999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1910000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.137}]},{"osd":2,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97099999999999997,"15min":0.97799999999999998},"min":{"1min":0.64800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2789999999999999,"5min":1.4570000000000001,"15min":1.6240000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0449999999999999,"15min":1.032},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.472,"5min":1.55,"15min":2.1269999999999998},"last":1.1819999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95299999999999996,"15min":0.97999999999999998},"min":{"1min":0.73299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.3700000000000001,"15min":1.792},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.999,"15min":1.0209999999999999},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.46100000000000002},"max":{"1min":1.478,"5min":1.496,"15min":1.821},"last":1.2430000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97599999999999998,"15min":0.96699999999999997},"min":{"1min":0.76300000000000001,"5min":0.52100000000000002,"15min":0.39500000000000002},"max":{"1min":1.2170000000000001,"5min":1.847,"15min":1.8480000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.085,"15min":1.085},"min":{"1min":0.66900000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3779999999999999,"5min":1.464,"15min":1.8120000000000001},"last":1.2709999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.0409999999999999,"15min":1.044},"min":{"1min":0.57999999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.575,"5min":1.575,"15min":2.21},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.127,"15min":1.111},"min":{"1min":0.79600000000000004,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":1.5089999999999999,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.304}]},{"osd":6,"last update":"Wed Dec 13 22:56:32 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1359999999999999,"15min":1.141},"min":{"1min":0.61399999999999999,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.617,"5min":2.056,"15min":2.0590000000000002},"last":1.409},{"interface":"front","average":{"1min":1.159,"5min":1.1319999999999999,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.569,"5min":1.798,"15min":1.798},"last":1.107}]}]},{"osd":6,"up_from":16,"seq":68719477125,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62008,"kb_used_data":8624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309832,"statfs":{"total":96636764160,"available":96573267968,"internally_reserved":0,"allocated":8830976,"data_stored":8623553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.345,"5min":1.454,"15min":2.1970000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.93100000000000005},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.6419999999999999},"last":0.877}]},{"osd":1,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86899999999999999,"15min":0.89100000000000001},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.39500000000000002},"max":{"1min":1.109,"5min":1.319,"15min":1.5109999999999999},"last":1.232},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.002,"15min":1.006},"min":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.218,"5min":1.6579999999999999,"15min":2.0990000000000002},"last":0.94299999999999995}]},{"osd":2,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.01,"15min":1.026},"min":{"1min":0.56999999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.325,"5min":1.6839999999999999,"15min":2.3799999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.024,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.51700000000000002,"15min":0.505},"max":{"1min":1.2909999999999999,"5min":1.506,"15min":1.8540000000000001},"last":1.1359999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.034,"15min":1.056},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.44800000000000001},"max":{"1min":1.2150000000000001,"5min":1.587,"15min":1.841},"last":1.2889999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.002,"15min":1.018},"min":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.52400000000000002},"max":{"1min":1.321,"5min":1.405,"15min":1.784},"last":1.079}]},{"osd":4,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0489999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.375},"max":{"1min":1.4159999999999999,"5min":1.6279999999999999,"15min":2.504},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0840000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.33000000000000002},"max":{"1min":1.3380000000000001,"5min":1.6319999999999999,"15min":2.044},"last":1.4259999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.995,"15min":1.0149999999999999},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.36499999999999999},"max":{"1min":1.421,"5min":1.52,"15min":1.9239999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.165,"15min":1.1910000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44500000000000001},"max":{"1min":1.5,"5min":1.9410000000000001,"15min":3.0529999999999999},"last":1.032}]},{"osd":7,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.1519999999999999,"15min":1.181},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3620000000000001,"5min":1.7569999999999999,"15min":2.956},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1200000000000001,"15min":1.165},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.442},"max":{"1min":1.2410000000000001,"5min":1.788,"15min":1.9350000000000001},"last":1.4950000000000001}]}]},{"osd":5,"up_from":16,"seq":68719477125,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39836,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332004,"statfs":{"total":96636764160,"available":96595972096,"internally_reserved":0,"allocated":348160,"data_stored":136849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.85099999999999998,"15min":0.85399999999999998},"min":{"1min":0.57199999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2709999999999999,"5min":1.3220000000000001,"15min":1.4690000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90300000000000002,"15min":0.93100000000000005},"min":{"1min":0.54300000000000004,"5min":0.378,"15min":0.373},"max":{"1min":1.2030000000000001,"5min":1.4239999999999999,"15min":1.4750000000000001},"last":1.016}]},{"osd":1,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.56299999999999994,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.94899999999999995,"15min":0.96899999999999997},"min":{"1min":0.65500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.369,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.016,"15min":1.012},"min":{"1min":0.78600000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3049999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.67300000000000004,"5min":0.48999999999999999,"15min":0.41499999999999998},"max":{"1min":1.25,"5min":1.3089999999999999,"15min":1.5009999999999999},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.98199999999999998,"15min":1.016},"min":{"1min":0.754,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.341,"5min":1.4770000000000001,"15min":1.5820000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0760000000000001,"15min":1.089},"min":{"1min":0.90100000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.63200000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3180000000000001,"5min":1.482,"15min":1.53},"last":0.75},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.075,"15min":1.0680000000000001},"min":{"1min":0.86899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.2959999999999998,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.036,"15min":1.0609999999999999},"min":{"1min":0.81100000000000005,"5min":0.40999999999999998,"15min":0.35799999999999998},"max":{"1min":1.387,"5min":1.873,"15min":1.873},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0309999999999999,"15min":1.073},"min":{"1min":0.84699999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.349,"5min":1.55,"15min":1.8480000000000001},"last":0.88400000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:56:29 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":1.02,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.173,"15min":1.208},"min":{"1min":0.78800000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.49,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1140000000000001}]}]},{"osd":4,"up_from":16,"seq":68719477126,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60816,"kb_used_data":7432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":7610368,"data_stored":7404781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.88400000000000001,"15min":0.90700000000000003},"min":{"1min":0.67800000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.395,"5min":1.4630000000000001,"15min":1.5740000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.90600000000000003,"15min":0.90900000000000003},"min":{"1min":0.63500000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2130000000000001,"5min":1.373,"15min":1.488},"last":0.79000000000000004}]},{"osd":1,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.93999999999999995,"15min":0.95399999999999996},"min":{"1min":0.754,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2390000000000001,"5min":1.75,"15min":1.75},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.95299999999999996,"15min":0.98499999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.503},"max":{"1min":1.2589999999999999,"5min":1.387,"15min":1.831},"last":0.86499999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94999999999999996,"15min":0.97499999999999998},"min":{"1min":0.71499999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3240000000000001,"5min":1.347,"15min":1.645},"last":1.101},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.02,"15min":1.026},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.58299999999999996},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.75},"last":0.99399999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.94499999999999995,"15min":0.96199999999999997},"min":{"1min":0.66200000000000003,"5min":0.59699999999999998,"15min":0.50600000000000001},"max":{"1min":1.3700000000000001,"5min":1.5189999999999999,"15min":1.639},"last":1.02},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0760000000000001,"15min":1.111},"min":{"1min":0.81000000000000005,"5min":0.72799999999999998,"15min":0.70899999999999996},"max":{"1min":1.3049999999999999,"5min":1.4099999999999999,"15min":2.1070000000000002},"last":1.052}]},{"osd":5,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.0229999999999999,"15min":1.0069999999999999},"min":{"1min":0.57799999999999996,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.4410000000000001,"5min":2.218,"15min":2.218},"last":1.127},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.999,"15min":1.0309999999999999},"min":{"1min":0.54000000000000004,"5min":0.52200000000000002,"15min":0.45900000000000002},"max":{"1min":1.484,"5min":1.5,"15min":1.643},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.026,"15min":1.0620000000000001},"min":{"1min":0.67900000000000005,"5min":0.55300000000000005,"15min":0.48299999999999998},"max":{"1min":1.323,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.149,"15min":1.1519999999999999},"min":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5049999999999999,"5min":2.137,"15min":2.137},"last":1.0780000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:57:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1020000000000001,"15min":1.113},"min":{"1min":0.73899999999999999,"5min":0.628,"15min":0.504},"max":{"1min":1.554,"5min":1.8049999999999999,"15min":1.857},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.204},"min":{"1min":0.84399999999999997,"5min":0.58199999999999996,"15min":0.52100000000000002},"max":{"1min":1.6080000000000001,"5min":1.927,"15min":2.3079999999999998},"last":0.96899999999999997}]}]},{"osd":3,"up_from":16,"seq":68719477125,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85424,"kb_used_data":18152,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94286416,"statfs":{"total":96636764160,"available":96549289984,"internally_reserved":0,"allocated":18587648,"data_stored":18371197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69999999999999996,"15min":0.71499999999999997},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.878,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":1.171,"5min":1.3149999999999999,"15min":1.524},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.26500000000000001},"max":{"1min":1.23,"5min":1.4279999999999999,"15min":1.5820000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.86299999999999999,"15min":0.86099999999999999},"min":{"1min":0.434,"5min":0.376,"15min":0.32300000000000001},"max":{"1min":1.264,"5min":1.3120000000000001,"15min":1.4379999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.3029999999999999,"15min":5.085},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.92800000000000005},"min":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2589999999999999,"5min":1.647,"15min":1.647},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.53600000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.228,"5min":1.633,"15min":1.77},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.995,"5min":1.0569999999999999,"15min":1.0549999999999999},"min":{"1min":0.68200000000000005,"5min":0.59399999999999997,"15min":0.38700000000000001},"max":{"1min":1.3700000000000001,"5min":1.6719999999999999,"15min":1.8480000000000001},"last":0.873}]},{"osd":5,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.72299999999999998,"5min":0.48799999999999999,"15min":0.433},"max":{"1min":1.466,"5min":1.532,"15min":1.8400000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1539999999999999,"15min":1.173},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.38200000000000001},"max":{"1min":1.2689999999999999,"5min":1.7330000000000001,"15min":2.2290000000000001},"last":1.2130000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2,"15min":1.202},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.47199999999999998},"max":{"1min":1.325,"5min":1.8149999999999999,"15min":2.181},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.121,"15min":1.1879999999999999},"min":{"1min":0.61099999999999999,"5min":0.50700000000000001,"15min":0.39500000000000002},"max":{"1min":1.337,"5min":1.7270000000000001,"15min":2.1230000000000002},"last":1.075}]},{"osd":7,"last update":"Wed Dec 13 22:56:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1539999999999999,"15min":1.2190000000000001},"min":{"1min":0.76400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3680000000000001,"5min":1.841,"15min":2.1779999999999999},"last":1.133},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1519999999999999,"15min":1.1870000000000001},"min":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.55600000000000005},"max":{"1min":1.5640000000000001,"5min":1.7909999999999999,"15min":1.948},"last":1.048}]}]},{"osd":1,"up_from":16,"seq":68719477126,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":352256,"data_stored":136415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0940000000000001,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.40200000000000002,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":0.98599999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.401,"15min":1.5580000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":0.85399999999999998},"min":{"1min":0.39100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.98599999999999999}]},{"osd":3,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.876,"15min":0.89700000000000002},"min":{"1min":0.49299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.0149999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.83099999999999996,"15min":0.85799999999999998},"min":{"1min":0.45300000000000001,"5min":0.375,"15min":0.308},"max":{"1min":1.111,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.68000000000000005,"5min":0.48499999999999999,"15min":0.42799999999999999},"max":{"1min":1.2430000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.65400000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2509999999999999,"5min":1.5529999999999999,"15min":1.6359999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.67800000000000005,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":1.2350000000000001,"5min":1.629,"15min":1.6599999999999999},"last":1.018},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1479999999999999,"15min":1.169},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.64100000000000001},"max":{"1min":1.528,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.0409999999999999}]},{"osd":6,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.071,"15min":1.109},"min":{"1min":0.65100000000000002,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":1.331,"5min":1.706,"15min":1.7649999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.069,"5min":1.161,"15min":1.202},"min":{"1min":0.85899999999999999,"5min":0.57099999999999995,"15min":0.501},"max":{"1min":1.585,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1020000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:56:24 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1200000000000001,"15min":1.169},"min":{"1min":0.77600000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4059999999999999,"5min":1.8,"15min":1.8520000000000001},"last":1.123},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1160000000000001,"15min":1.161},"min":{"1min":0.78800000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1990000000000001,"5min":2.774,"15min":2.774},"last":0.95599999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509828,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39868,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331972,"statfs":{"total":96636764160,"available":96595939328,"internally_reserved":0,"allocated":380928,"data_stored":168151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 13 22:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.46100000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0760000000000001,"5min":1.24,"15min":2.8730000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.754,"15min":0.76300000000000001},"min":{"1min":0.45900000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":1.206,"5min":1.4930000000000001,"15min":2.3639999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.754,"15min":0.77500000000000002},"min":{"1min":0.53800000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0209999999999999,"5min":1.47,"15min":1.47},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.85499999999999998,"15min":0.88300000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.33500000000000002},"max":{"1min":1.0800000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83099999999999996}]},{"osd":3,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.57499999999999996,"5min":0.39000000000000001,"15min":0.29399999999999998},"max":{"1min":1.306,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.76200000000000001,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":1.2729999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.91800000000000004}]},{"osd":4,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.70299999999999996,"5min":0.54800000000000004,"15min":0.442},"max":{"1min":1.2689999999999999,"5min":1.718,"15min":1.782},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0429999999999999,"15min":1.069},"min":{"1min":0.80300000000000005,"5min":0.64500000000000002,"15min":0.58599999999999997},"max":{"1min":1.327,"5min":1.635,"15min":1.8340000000000001},"last":0.97599999999999998}]},{"osd":5,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0680000000000001,"15min":1.0960000000000001},"min":{"1min":0.83399999999999996,"5min":0.60999999999999999,"15min":0.55900000000000005},"max":{"1min":1.5329999999999999,"5min":1.772,"15min":2.1030000000000002},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0489999999999999,"15min":1.0800000000000001},"min":{"1min":0.88700000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.635,"15min":2.0779999999999998},"last":1.254}]},{"osd":6,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1080000000000001,"15min":1.1519999999999999},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.56799999999999995},"max":{"1min":1.393,"5min":1.5640000000000001,"15min":1.835},"last":1.169},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.111,"15min":1.147},"min":{"1min":0.83599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.736,"5min":1.8779999999999999,"15min":2.6120000000000001},"last":1.1910000000000001}]},{"osd":7,"last update":"Wed Dec 13 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.147,"15min":1.1930000000000001},"min":{"1min":0.69799999999999995,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4299999999999999,"5min":1.6899999999999999,"15min":2.5640000000000001},"last":1.091},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.153,"15min":1.21},"min":{"1min":0.84799999999999998,"5min":0.72099999999999997,"15min":0.56999999999999995},"max":{"1min":1.6459999999999999,"5min":1.986,"15min":5.3310000000000004},"last":1.008}]}]},{"osd":0,"up_from":14,"seq":60129542532,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31136,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340704,"statfs":{"total":96636764160,"available":96604880896,"internally_reserved":0,"allocated":4218880,"data_stored":4004445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.25700000000000001},"max":{"1min":0.98799999999999999,"5min":1.897,"15min":1.897},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.20300000000000001},"max":{"1min":1.089,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.1599999999999999}]},{"osd":2,"last update":"Wed Dec 13 22:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94599999999999995,"5min":1.3560000000000001,"15min":2.2839999999999998},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.626,"5min":0.33200000000000002,"15min":0.223},"max":{"1min":1.181,"5min":1.79,"15min":1.9099999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.88500000000000001,"15min":0.91000000000000003},"min":{"1min":0.41699999999999998,"5min":0.35299999999999998,"15min":0.26400000000000001},"max":{"1min":1.151,"5min":1.8129999999999999,"15min":2.6320000000000001},"last":1.02},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.90200000000000002,"15min":0.88300000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.284,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.86699999999999999}]},{"osd":4,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.99399999999999999},"min":{"1min":0.59299999999999997,"5min":0.54100000000000004,"15min":0.51300000000000001},"max":{"1min":1.248,"5min":1.399,"15min":2.0659999999999998},"last":1.26},{"interface":"front","average":{"1min":1.028,"5min":1.0860000000000001,"15min":1.0980000000000001},"min":{"1min":0.58599999999999997,"5min":0.372,"15min":0.372},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.129}]},{"osd":5,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0760000000000001,"15min":1.075},"min":{"1min":0.755,"5min":0.57499999999999996,"15min":0.52600000000000002},"max":{"1min":1.4099999999999999,"5min":1.554,"15min":1.625},"last":1.4350000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.0800000000000001,"15min":1.1040000000000001},"min":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.46800000000000003},"max":{"1min":1.306,"5min":1.5609999999999999,"15min":2.1539999999999999},"last":1.0920000000000001}]},{"osd":6,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.103,"15min":1.1359999999999999},"min":{"1min":0.69599999999999995,"5min":0.58499999999999996,"15min":0.48199999999999998},"max":{"1min":1.28,"5min":1.599,"15min":2.2250000000000001},"last":1.401},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1919999999999999,"15min":1.2090000000000001},"min":{"1min":0.67500000000000004,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3540000000000001,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.214}]},{"osd":7,"last update":"Wed Dec 13 22:56:22 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.171,"15min":1.163},"min":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.55400000000000005},"max":{"1min":1.577,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1970000000000001,"15min":1.22},"min":{"1min":0.89900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3839999999999999,"5min":1.841,"15min":2.339},"last":1.4690000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3297280,"data_stored":3278606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":32680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18259968,"data_stored":18235726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7282688,"data_stored":7269310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":8488082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13725696,"data_stored":13707714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-13T22:57:16.739 DEBUG:teuthology.orchestra.run.smithi091:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-13T22:57:16.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 Processor -- start 2023-12-13T22:57:16.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 -- start start 2023-12-13T22:57:16.893 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafec0c4630 0x7fafec0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fafec159c00 0x7fafec14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec0c4f40 con 0x7fafec0c4630 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec15a6c0 con 0x7fafec159c00 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff3aee640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec1560d0 con 0x7fafec0c4a10 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff188a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafec0c4630 0x7fafec0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.894 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff188a640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7fafec0c4630 0x7fafec0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38242/0 (socket says 172.21.15.91:38242) 2023-12-13T22:57:16.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff188a640 1 -- 172.21.15.91:0/3227776673 learned_addr learned my addr 172.21.15.91:0/3227776673 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:16.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff208b640 1 --2- 172.21.15.91:0/3227776673 >> v2:172.21.15.152:3300/0 conn(0x7fafec159c00 0x7fafec14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.895 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.896+0000 7faff1089640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.900+0000 7faff188a640 1 -- 172.21.15.91:0/3227776673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 msgr2=0x7fafec1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:16.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.900+0000 7faff188a640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.900+0000 7faff188a640 1 -- 172.21.15.91:0/3227776673 >> v2:172.21.15.152:3300/0 conn(0x7fafec159c00 msgr2=0x7fafec14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:16.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.900+0000 7faff188a640 1 --2- 172.21.15.91:0/3227776673 >> v2:172.21.15.152:3300/0 conn(0x7fafec159c00 0x7fafec14fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.898 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.900+0000 7faff188a640 1 -- 172.21.15.91:0/3227776673 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0c72b0 con 0x7fafec0c4630 2023-12-13T22:57:16.903 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.904+0000 7faff188a640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec0c6d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098a0 tx=0x7fafdc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd8d01c892c860b server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.905 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff0888640 1 -- 172.21.15.91:0/3227776673 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0a8990 con 0x7fafec0c4630 2023-12-13T22:57:16.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff0888640 1 -- 172.21.15.91:0/3227776673 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0a8af0 con 0x7fafec0c4630 2023-12-13T22:57:16.907 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff0888640 1 -- 172.21.15.91:0/3227776673 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0a8e80 con 0x7fafec0c4630 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 -- 172.21.15.91:0/3227776673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 msgr2=0x7fafec0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec0c6d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098a0 tx=0x7fafdc01ecd0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 -- 172.21.15.91:0/3227776673 shutdown_connections 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 --2- 172.21.15.91:0/3227776673 >> v2:172.21.15.152:3300/0 conn(0x7fafec159c00 0x7fafec14fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 --2- 172.21.15.91:0/3227776673 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec0c6d70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 -- 172.21.15.91:0/3227776673 >> 172.21.15.91:0/3227776673 conn(0x7fafec06c6a0 msgr2=0x7fafec06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 -- 172.21.15.91:0/3227776673 shutdown_connections 2023-12-13T22:57:16.908 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.908+0000 7faff3aee640 1 -- 172.21.15.91:0/3227776673 wait complete. 2023-12-13T22:57:16.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 Processor -- start 2023-12-13T22:57:16.909 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 -- start start 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafec159c00 0x7fafec154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0c88d0 con 0x7fafec0c4630 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec14bc20 con 0x7fafec159c00 2023-12-13T22:57:16.910 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff3aee640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec144420 con 0x7fafec0c4a10 2023-12-13T22:57:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff188a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff188a640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:38252/0 (socket says 172.21.15.91:38252) 2023-12-13T22:57:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff188a640 1 -- 172.21.15.91:0/1378035049 learned_addr learned my addr 172.21.15.91:0/1378035049 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:16.911 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff208b640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafec159c00 0x7fafec154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.912 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.912+0000 7faff1089640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.916+0000 7faff188a640 1 -- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 msgr2=0x7fafec154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.916+0000 7faff188a640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.916+0000 7faff188a640 1 -- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafec159c00 msgr2=0x7fafec154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:16.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.916+0000 7faff188a640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafec159c00 0x7fafec154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:16.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.916+0000 7faff188a640 1 -- 172.21.15.91:0/1378035049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0094d0 con 0x7fafec0c4630 2023-12-13T22:57:16.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.920+0000 7faff188a640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fafdc01d380 tx=0x7fafdc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0b0d40 con 0x7fafec0c4630 2023-12-13T22:57:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0bb460 con 0x7fafec0c4630 2023-12-13T22:57:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0b0ea0 con 0x7fafec0c4630 2023-12-13T22:57:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec14adc0 con 0x7fafec0c4630 2023-12-13T22:57:16.921 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec14b380 con 0x7fafec0c4630 2023-12-13T22:57:16.922 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.924+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec156580 con 0x7fafec0c4630 2023-12-13T22:57:16.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.944+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fafdc0b83f0 con 0x7fafec0c4630 2023-12-13T22:57:16.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.944+0000 7fafe27fc640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 0x7fafd0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:16.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.944+0000 7faff1089640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 0x7fafd0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:16.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.944+0000 7faff1089640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 0x7fafd0068d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fafec1ede70 tx=0x7fafe800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:16.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:16.948+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fafdc0f2e60 con 0x7fafec0c4630 2023-12-13T22:57:17.208 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.208+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fafdc0ef1a0 con 0x7fafec0c4630 2023-12-13T22:57:17.367 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.368+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fafec067520 con 0x7fafec0c4630 2023-12-13T22:57:17.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.592+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fafdc0b5070 con 0x7fafec0c4630 2023-12-13T22:57:17.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.592+0000 7fafe27fc640 1 -- 172.21.15.91:0/1378035049 <== mon.0 v2:172.21.15.91:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fafdc0ef1a0 con 0x7fafec0c4630 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 msgr2=0x7fafd0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 0x7fafd0068d30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fafec1ede70 tx=0x7fafe800d040 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 msgr2=0x7fafec146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fafdc01d380 tx=0x7fafdc01ba70 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 shutdown_connections 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fafd0066870 0x7fafd0068d30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafec159c00 0x7fafec154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafec0c4a10 0x7fafec154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 --2- 172.21.15.91:0/1378035049 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fafec0c4630 0x7fafec146eb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 >> 172.21.15.91:0/1378035049 conn(0x7fafec06c6a0 msgr2=0x7fafec0c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 shutdown_connections 2023-12-13T22:57:17.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.596+0000 7faff3aee640 1 -- 172.21.15.91:0/1378035049 wait complete. 2023-12-13T22:57:17.618 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-13T22:57:17.618 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:57:17.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 Processor -- start 2023-12-13T22:57:17.742 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 -- start start 2023-12-13T22:57:17.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f4e64151670 0x7f4e640c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6415b240 con 0x7f4e640c8dd0 2023-12-13T22:57:17.743 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e64157ab0 con 0x7f4e64151670 2023-12-13T22:57:17.744 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.744+0000 7f4e6be88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640c6ea0 con 0x7f4e640c5290 2023-12-13T22:57:17.761 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.764+0000 7f4e6a425640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:17.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.764+0000 7f4e6a425640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45314/0 (socket says 172.21.15.91:45314) 2023-12-13T22:57:17.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.764+0000 7f4e6a425640 1 -- 172.21.15.91:0/1104311153 learned_addr learned my addr 172.21.15.91:0/1104311153 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:17.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.772+0000 7f4e69c24640 1 --2- 172.21.15.91:0/1104311153 >> v2:172.21.15.91:3300/0 conn(0x7f4e64151670 0x7f4e640c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:17.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.772+0000 7f4e6a425640 1 -- 172.21.15.91:0/1104311153 >> v2:172.21.15.91:3300/0 conn(0x7f4e64151670 msgr2=0x7f4e640c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:17.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.772+0000 7f4e6a425640 1 --2- 172.21.15.91:0/1104311153 >> v2:172.21.15.91:3300/0 conn(0x7f4e64151670 0x7f4e640c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.772+0000 7f4e6a425640 1 -- 172.21.15.91:0/1104311153 >> v1:172.21.15.152:6789/0 conn(0x7f4e640c8dd0 legacy=0x7f4e641573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:17.772 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.772+0000 7f4e6a425640 1 -- 172.21.15.91:0/1104311153 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640c7180 con 0x7f4e640c5290 2023-12-13T22:57:17.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.780+0000 7f4e6a425640 1 --2- 172.21.15.91:0/1104311153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6001f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9eaa114ce7e17 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:17.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.788+0000 7f4e68c22640 1 -- 172.21.15.91:0/1104311153 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600af400 con 0x7f4e640c5290 2023-12-13T22:57:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.788+0000 7f4e68c22640 1 -- 172.21.15.91:0/1104311153 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e600ab050 con 0x7f4e640c5290 2023-12-13T22:57:17.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.788+0000 7f4e68c22640 1 -- 172.21.15.91:0/1104311153 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600af7a0 con 0x7f4e640c5290 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- 172.21.15.91:0/1104311153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 msgr2=0x7f4e640c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- 172.21.15.91:0/1104311153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6001f1c0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- 172.21.15.91:0/1104311153 shutdown_connections 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- 172.21.15.91:0/1104311153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e640c5290 0x7f4e640c5720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- 172.21.15.91:0/1104311153 >> v2:172.21.15.91:3300/0 conn(0x7f4e64151670 0x7f4e640c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- 172.21.15.91:0/1104311153 >> 172.21.15.91:0/1104311153 conn(0x7f4e64070160 msgr2=0x7f4e6406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- 172.21.15.91:0/1104311153 shutdown_connections 2023-12-13T22:57:17.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- 172.21.15.91:0/1104311153 wait complete. 2023-12-13T22:57:17.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 Processor -- start 2023-12-13T22:57:17.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- start start 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e640c5290 0x7f4e64156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e640c8dd0 0x7f4e64149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641e0590 con 0x7f4e640c8dd0 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64157420 con 0x7f4e640c5290 2023-12-13T22:57:17.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.792+0000 7f4e6be88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641e2160 con 0x7f4e64151670 2023-12-13T22:57:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.796+0000 7f4e6a425640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.796+0000 7f4e6a425640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:45320/0 (socket says 172.21.15.91:45320) 2023-12-13T22:57:17.793 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.796+0000 7f4e6a425640 1 -- 172.21.15.91:0/21647533 learned_addr learned my addr 172.21.15.91:0/21647533 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:17.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.804+0000 7f4e69c24640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e640c5290 0x7f4e64156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:17.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.804+0000 7f4e6a425640 1 -- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e640c5290 msgr2=0x7f4e64156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:17.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.808+0000 7f4e6a425640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e640c5290 0x7f4e64156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.808+0000 7f4e6a425640 1 -- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e640c8dd0 msgr2=0x7f4e64149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:17.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.808+0000 7f4e6a425640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e640c8dd0 0x7f4e64149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:17.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.808+0000 7f4e6a425640 1 -- 172.21.15.91:0/21647533 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60009b30 con 0x7f4e64151670 2023-12-13T22:57:17.810 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.812+0000 7f4e6a425640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e6001d870 tx=0x7f4e6001bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.820+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600afcd0 con 0x7f4e64151670 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.820+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e600afe30 con 0x7f4e64151670 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.820+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e64157180 con 0x7f4e64151670 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.820+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600b9650 con 0x7f4e64151670 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.820+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e641e1850 con 0x7f4e64151670 2023-12-13T22:57:17.821 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.824+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64073e70 con 0x7f4e64151670 2023-12-13T22:57:17.870 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.872+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4e600b6070 con 0x7f4e64151670 2023-12-13T22:57:17.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.872+0000 7f4e5a7fc640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 0x7f4e48068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:17.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.872+0000 7f4e69c24640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 0x7f4e48068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:17.871 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.872+0000 7f4e69c24640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 0x7f4e48068d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009a50 tx=0x7f4e5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:17.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:17.876+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e600f43b0 con 0x7f4e64151670 2023-12-13T22:57:18.230 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.232+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4e600efff0 con 0x7f4e64151670 2023-12-13T22:57:18.452 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.456+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e641e22a0 con 0x7f4e64151670 2023-12-13T22:57:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.764+0000 7f4e5a7fc640 1 -- 172.21.15.91:0/21647533 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+6529 (secure 0 0 0) 0x7f4e600b4030 con 0x7f4e64151670 2023-12-13T22:57:18.764 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:57:18.764 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:57:08.746710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:57:18.764 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 56 2023-12-13T22:57:18.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 msgr2=0x7f4e48068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 0x7f4e48068d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009a50 tx=0x7f4e5c008040 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 msgr2=0x7f4e64147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e6001d870 tx=0x7f4e6001bf60 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 shutdown_connections 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f4e48066840 0x7f4e48068d00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4e64151670 0x7f4e64147450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f4e640c8dd0 0x7f4e64149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 --2- 172.21.15.91:0/21647533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e640c5290 0x7f4e64156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.768 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 >> 172.21.15.91:0/21647533 conn(0x7f4e64070160 msgr2=0x7f4e6414f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:18.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 shutdown_connections 2023-12-13T22:57:18.769 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.768+0000 7f4e6be88640 1 -- 172.21.15.91:0/21647533 wait complete. 2023-12-13T22:57:18.791 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-13T22:57:18.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.916+0000 7f9aabc7b640 1 Processor -- start 2023-12-13T22:57:18.916 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.916+0000 7f9aabc7b640 1 -- start start 2023-12-13T22:57:18.917 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aabc7b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aabc7b640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9aa40c40e0 0x7f9aa40c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aabc7b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa406f4a0 con 0x7f9aa4151340 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aabc7b640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa4072570 con 0x7f9aa40c40e0 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aabc7b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4070be0 con 0x7f9aa4151720 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aaa218640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9aa40c40e0 0x7f9aa40c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aa9216640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aaa218640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f9aa40c40e0 0x7f9aa40c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50062/0 (socket says 172.21.15.91:50062) 2023-12-13T22:57:18.918 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.920+0000 7f9aaa218640 1 -- 172.21.15.91:0/1716239269 learned_addr learned my addr 172.21.15.91:0/1716239269 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.928+0000 7f9aaa218640 1 -- 172.21.15.91:0/1716239269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 msgr2=0x7f9aa406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.928+0000 7f9aaa218640 1 --2- 172.21.15.91:0/1716239269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa406ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.928+0000 7f9aaa218640 1 -- 172.21.15.91:0/1716239269 >> v1:172.21.15.91:6789/0 conn(0x7f9aa4151340 legacy=0x7f9aa4157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.925 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.928+0000 7f9aaa218640 1 -- 172.21.15.91:0/1716239269 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa4070e80 con 0x7f9aa40c40e0 2023-12-13T22:57:18.933 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.932+0000 7f9aaa218640 1 --2- 172.21.15.91:0/1716239269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa40c40e0 0x7f9aa40c4590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b0c990265b0f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:18.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aa8a15640 1 -- 172.21.15.91:0/1716239269 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940aa670 con 0x7f9aa40c40e0 2023-12-13T22:57:18.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aa8a15640 1 -- 172.21.15.91:0/1716239269 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9a940aa7d0 con 0x7f9aa40c40e0 2023-12-13T22:57:18.937 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aa8a15640 1 -- 172.21.15.91:0/1716239269 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940aab80 con 0x7f9aa40c40e0 2023-12-13T22:57:18.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- 172.21.15.91:0/1716239269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa40c40e0 msgr2=0x7f9aa40c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/1716239269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa40c40e0 0x7f9aa40c4590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9401c510 comp rx=0 tx=0).stop 2023-12-13T22:57:18.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- 172.21.15.91:0/1716239269 shutdown_connections 2023-12-13T22:57:18.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/1716239269 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa40c40e0 0x7f9aa40c4590 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.938 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/1716239269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- 172.21.15.91:0/1716239269 >> 172.21.15.91:0/1716239269 conn(0x7f9aa406c6a0 msgr2=0x7f9aa406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:18.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- 172.21.15.91:0/1716239269 shutdown_connections 2023-12-13T22:57:18.939 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- 172.21.15.91:0/1716239269 wait complete. 2023-12-13T22:57:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 Processor -- start 2023-12-13T22:57:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.940+0000 7f9aabc7b640 1 -- start start 2023-12-13T22:57:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa40c40e0 0x7f9aa414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.942 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa41f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c67e0 con 0x7f9aa4151340 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4145150 con 0x7f9aa40c40e0 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aabc7b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa41f00c0 con 0x7f9aa4151720 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aa9216640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aa9216640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50072/0 (socket says 172.21.15.91:50072) 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aa9216640 1 -- 172.21.15.91:0/2803116112 learned_addr learned my addr 172.21.15.91:0/2803116112 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:18.943 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aaa218640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa41f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.944 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.944+0000 7f9aa9a17640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa40c40e0 0x7f9aa414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.945 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 -- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 msgr2=0x7f9aa41f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa41f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 -- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa40c40e0 msgr2=0x7f9aa414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa40c40e0 0x7f9aa414f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:18.946 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 -- 172.21.15.91:0/2803116112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940094d0 con 0x7f9aa4151340 2023-12-13T22:57:18.947 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.948+0000 7f9aa9216640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009db0 tx=0x7f9aa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:18.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.952+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0014480 con 0x7f9aa4151340 2023-12-13T22:57:18.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.952+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9aa000f040 con 0x7f9aa4151340 2023-12-13T22:57:18.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.952+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa4140270 con 0x7f9aa4151340 2023-12-13T22:57:18.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.952+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0014820 con 0x7f9aa4151340 2023-12-13T22:57:18.952 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.952+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa41453a0 con 0x7f9aa4151340 2023-12-13T22:57:18.953 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.956+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa4067520 con 0x7f9aa4151340 2023-12-13T22:57:18.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.976+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9aa0014980 con 0x7f9aa4151340 2023-12-13T22:57:18.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.976+0000 7f9a9a7fc640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 0x7f9a90068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:18.973 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.976+0000 7f9aa9a17640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 0x7f9a90068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:18.974 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.976+0000 7f9aa9a17640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 0x7f9a90068d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c001770 tx=0x7f9a9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:18.976 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:18.976+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9aa0056440 con 0x7f9aa4151340 2023-12-13T22:57:19.241 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.244+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9aa0052780 con 0x7f9aa4151340 2023-12-13T22:57:19.440 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.440+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aa40c9910 con 0x7f9aa4151340 2023-12-13T22:57:19.472 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.472+0000 7f9a9a7fc640 1 -- 172.21.15.91:0/2803116112 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+6529 (secure 0 0 0) 0x7f9aa0055da0 con 0x7f9aa4151340 2023-12-13T22:57:19.472 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:57:19.472 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6835/4241129656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6834","nonce":4241129656},{"type":"v1","addr":"172.21.15.91:6835","nonce":4241129656}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.91:6839/1315977320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6838","nonce":1315977320},{"type":"v1","addr":"172.21.15.91:6839","nonce":1315977320}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/187912976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":187912976},{"type":"v1","addr":"172.21.15.152:6837","nonce":187912976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-13T22:25:58.517400+0000","modified":"2023-12-13T22:57:08.746710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4258,"mds_1":4255,"mds_2":4226},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4226":{"gid":4226,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":14,"addr":"172.21.15.91:6837/757899957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6836","nonce":757899957},{"type":"v1","addr":"172.21.15.91:6837","nonce":757899957}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4255":{"gid":4255,"name":"b","rank":1,"incarnation":11,"state":"up:active","state_seq":15,"addr":"172.21.15.152:6833/1277096500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1277096500},{"type":"v1","addr":"172.21.15.152:6833","nonce":1277096500}]},"join_fscid":-1,"export_targets":[0],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4258":{"gid":4258,"name":"f","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.152:6835/3409704443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3409704443},{"type":"v1","addr":"172.21.15.152:6835","nonce":3409704443}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-13T22:57:19.473 INFO:teuthology.orchestra.run.smithi091.stderr:dumped fsmap epoch 56 2023-12-13T22:57:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 msgr2=0x7f9a90068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 0x7f9a90068d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c001770 tx=0x7f9a9c009040 comp rx=0 tx=0).stop 2023-12-13T22:57:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 msgr2=0x7f9aa41500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009db0 tx=0x7f9aa000c490 comp rx=0 tx=0).stop 2023-12-13T22:57:19.474 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 shutdown_connections 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f9a90066870 0x7f9a90068d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa4151720 0x7f9aa41f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f9aa4151340 0x7f9aa41500a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 --2- 172.21.15.91:0/2803116112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa40c40e0 0x7f9aa414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 >> 172.21.15.91:0/2803116112 conn(0x7f9aa406c6a0 msgr2=0x7f9aa4145770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 shutdown_connections 2023-12-13T22:57:19.475 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.476+0000 7f9aabc7b640 1 -- 172.21.15.91:0/2803116112 wait complete. 2023-12-13T22:57:19.493 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-13T22:57:19.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 Processor -- start 2023-12-13T22:57:19.609 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 -- start start 2023-12-13T22:57:19.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa8f80ce0c0 0x7fa8f80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:19.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f80cd9a0 con 0x7fa8f815a280 2023-12-13T22:57:19.610 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f81596c0 con 0x7fa8f80cc3c0 2023-12-13T22:57:19.611 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8fda1d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80ca550 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8effff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa8f80cc3c0 0x7fa8f8159b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:36714/0 (socket says 172.21.15.91:36714) 2023-12-13T22:57:19.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8effff640 1 -- 172.21.15.91:0/3274634164 learned_addr learned my addr 172.21.15.91:0/3274634164 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:57:19.612 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.612+0000 7fa8f6ffd640 1 --2- 172.21.15.91:0/3274634164 >> v2:172.21.15.152:3300/0 conn(0x7fa8f80ce0c0 0x7fa8f80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:19.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.628+0000 7fa8f6ffd640 1 -- 172.21.15.91:0/3274634164 >> v1:172.21.15.152:6789/0 conn(0x7fa8f80cc3c0 legacy=0x7fa8f8159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.628+0000 7fa8f6ffd640 1 -- 172.21.15.91:0/3274634164 >> v1:172.21.15.91:6789/0 conn(0x7fa8f815a280 legacy=0x7fa8f8163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:19.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.628+0000 7fa8f6ffd640 1 -- 172.21.15.91:0/3274634164 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80cd6c0 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.674 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.676+0000 7fa8f6ffd640 1 --2- 172.21.15.91:0/3274634164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80ce4a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80097c0 tx=0x7fa8e801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52f3cff8be12765 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:19.789 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8f67fc640 1 -- 172.21.15.91:0/3274634164 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8004230 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8f67fc640 1 -- 172.21.15.91:0/3274634164 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa8e80a7050 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.790 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8f67fc640 1 -- 172.21.15.91:0/3274634164 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8003620 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 -- 172.21.15.91:0/3274634164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80ce0c0 msgr2=0x7fa8f80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/3274634164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80ce4a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80097c0 tx=0x7fa8e801c440 comp rx=0 tx=0).stop 2023-12-13T22:57:19.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 -- 172.21.15.91:0/3274634164 shutdown_connections 2023-12-13T22:57:19.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/3274634164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80ce4a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 -- 172.21.15.91:0/3274634164 >> 172.21.15.91:0/3274634164 conn(0x7fa8f80b07c0 msgr2=0x7fa8f80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:19.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 -- 172.21.15.91:0/3274634164 shutdown_connections 2023-12-13T22:57:19.792 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.792+0000 7fa8fda1d640 1 -- 172.21.15.91:0/3274634164 wait complete. 2023-12-13T22:57:19.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 Processor -- start 2023-12-13T22:57:19.796 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 -- start start 2023-12-13T22:57:19.798 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80cc3c0 0x7fa8f8156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f81f7260 con 0x7fa8f80ce0c0 2023-12-13T22:57:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f81f2fb0 con 0x7fa8f80cc3c0 2023-12-13T22:57:19.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8fda1d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f81f3290 con 0x7fa8f815a280 2023-12-13T22:57:19.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.800+0000 7fa8f77fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:19.801 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.804+0000 7fa8f77fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:48282/0 (socket says 172.21.15.91:48282) 2023-12-13T22:57:19.802 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.804+0000 7fa8f77fe640 1 -- 172.21.15.91:0/2252436830 learned_addr learned my addr 172.21.15.91:0/2252436830 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:19.804 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.804+0000 7fa8effff640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:19.805 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f6ffd640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80cc3c0 0x7fa8f8156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f77fe640 1 -- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80cc3c0 msgr2=0x7fa8f8156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f77fe640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80cc3c0 0x7fa8f8156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f77fe640 1 -- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f80ce0c0 msgr2=0x7fa8f80b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f77fe640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:19.806 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.808+0000 7fa8f77fe640 1 -- 172.21.15.91:0/2252436830 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009420 con 0x7fa8f815a280 2023-12-13T22:57:19.809 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.812+0000 7fa8f77fe640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c780 tx=0x7fa8f000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:19.816 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0003d90 con 0x7fa8f815a280 2023-12-13T22:57:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa8f000ce90 con 0x7fa8f815a280 2023-12-13T22:57:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00052d0 con 0x7fa8f815a280 2023-12-13T22:57:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f81f3570 con 0x7fa8f815a280 2023-12-13T22:57:19.817 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f81f3b30 con 0x7fa8f815a280 2023-12-13T22:57:19.818 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:19.820+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f81f3d50 con 0x7fa8f815a280 2023-12-13T22:57:20.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.124+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa8f0005430 con 0x7fa8f815a280 2023-12-13T22:57:20.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.124+0000 7fa8f4ff9640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 0x7fa8d8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.123 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.124+0000 7fa8f6ffd640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 0x7fa8d8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.124 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.124+0000 7fa8f6ffd640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 0x7fa8d8068d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ad000 tx=0x7fa8e80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:20.131 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.132+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8f0013e70 con 0x7fa8f815a280 2023-12-13T22:57:20.170 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.172+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa8f0051070 con 0x7fa8f815a280 2023-12-13T22:57:20.354 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.356+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8f81f33d0 con 0x7fa8f815a280 2023-12-13T22:57:20.453 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.456+0000 7fa8f4ff9640 1 -- 172.21.15.91:0/2252436830 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18712 (secure 0 0 0) 0x7fa8f81f33d0 con 0x7fa8f815a280 2023-12-13T22:57:20.454 INFO:teuthology.orchestra.run.smithi091.stdout: 2023-12-13T22:57:20.454 INFO:teuthology.orchestra.run.smithi091.stdout:{"epoch":31,"fsid":"94ef47bf-5c6b-4a6a-817c-50fb411636d9","created":"2023-12-13T22:24:53.183378+0000","modified":"2023-12-13T22:27:02.661258+0000","last_up_change":"2023-12-13T22:25:16.697777+0000","last_in_change":"2023-12-13T22:25:05.351199+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-13T22:25:17.301016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-13T22:25:55.336057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-13T22:25:56.963208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-13T22:26:03.245007+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5fed0772-ab6b-4bab-ac40-e2979b535120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6818","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6819","nonce":2717992016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6820","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6821","nonce":2717992016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6824","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6825","nonce":2717992016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6822","nonce":2717992016},{"type":"v1","addr":"172.21.15.91:6823","nonce":2717992016}]},"public_addr":"172.21.15.91:6819/2717992016","cluster_addr":"172.21.15.91:6821/2717992016","heartbeat_back_addr":"172.21.15.91:6825/2717992016","heartbeat_front_addr":"172.21.15.91:6823/2717992016","state":["exists","up"]},{"osd":1,"uuid":"b9b73726-3d11-403e-95c1-8ba6887cb4a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6810","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6811","nonce":4169058440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6812","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6813","nonce":4169058440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6816","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6817","nonce":4169058440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6814","nonce":4169058440},{"type":"v1","addr":"172.21.15.91:6815","nonce":4169058440}]},"public_addr":"172.21.15.91:6811/4169058440","cluster_addr":"172.21.15.91:6813/4169058440","heartbeat_back_addr":"172.21.15.91:6817/4169058440","heartbeat_front_addr":"172.21.15.91:6815/4169058440","state":["exists","up"]},{"osd":2,"uuid":"b7cda291-66eb-4d55-baea-1280ff39ceb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6826","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6827","nonce":4024773626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6828","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6829","nonce":4024773626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6832","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6833","nonce":4024773626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6830","nonce":4024773626},{"type":"v1","addr":"172.21.15.91:6831","nonce":4024773626}]},"public_addr":"172.21.15.91:6827/4024773626","cluster_addr":"172.21.15.91:6829/4024773626","heartbeat_back_addr":"172.21.15.91:6833/4024773626","heartbeat_front_addr":"172.21.15.91:6831/4024773626","state":["exists","up"]},{"osd":3,"uuid":"a903b56a-614d-4b1d-b0a1-671042c0fa25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6802","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6803","nonce":470541736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6804","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6805","nonce":470541736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6808","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6809","nonce":470541736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.91:6806","nonce":470541736},{"type":"v1","addr":"172.21.15.91:6807","nonce":470541736}]},"public_addr":"172.21.15.91:6803/470541736","cluster_addr":"172.21.15.91:6805/470541736","heartbeat_back_addr":"172.21.15.91:6809/470541736","heartbeat_front_addr":"172.21.15.91:6807/470541736","state":["exists","up"]},{"osd":4,"uuid":"f1f42c7e-a9a6-4f47-bc6b-4daba8f3c67c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6809","nonce":501453671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6811","nonce":501453671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6815","nonce":501453671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":501453671},{"type":"v1","addr":"172.21.15.152:6813","nonce":501453671}]},"public_addr":"172.21.15.152:6809/501453671","cluster_addr":"172.21.15.152:6811/501453671","heartbeat_back_addr":"172.21.15.152:6815/501453671","heartbeat_front_addr":"172.21.15.152:6813/501453671","state":["exists","up"]},{"osd":5,"uuid":"1b97d340-0bc2-4553-8e25-565240473dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6825","nonce":489484286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6827","nonce":489484286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6831","nonce":489484286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":489484286},{"type":"v1","addr":"172.21.15.152:6829","nonce":489484286}]},"public_addr":"172.21.15.152:6825/489484286","cluster_addr":"172.21.15.152:6827/489484286","heartbeat_back_addr":"172.21.15.152:6831/489484286","heartbeat_front_addr":"172.21.15.152:6829/489484286","state":["exists","up"]},{"osd":6,"uuid":"207e09a7-b5d9-4ac8-a427-691dc7cb5b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6801","nonce":3653290810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6803","nonce":3653290810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6807","nonce":3653290810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3653290810},{"type":"v1","addr":"172.21.15.152:6805","nonce":3653290810}]},"public_addr":"172.21.15.152:6801/3653290810","cluster_addr":"172.21.15.152:6803/3653290810","heartbeat_back_addr":"172.21.15.152:6807/3653290810","heartbeat_front_addr":"172.21.15.152:6805/3653290810","state":["exists","up"]},{"osd":7,"uuid":"e26377f0-5278-484e-bb33-75f036813b3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6817","nonce":1599476558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6819","nonce":1599476558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6823","nonce":1599476558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1599476558},{"type":"v1","addr":"172.21.15.152:6821","nonce":1599476558}]},"public_addr":"172.21.15.152:6817/1599476558","cluster_addr":"172.21.15.152:6819/1599476558","heartbeat_back_addr":"172.21.15.152:6823/1599476558","heartbeat_front_addr":"172.21.15.152:6821/1599476558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.110077+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.273479+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.375776+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.253219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.394399+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.355695+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.267155+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-12-13T22:25:11.206290+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-13T22:57:20.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 msgr2=0x7fa8d8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:20.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 0x7fa8d8068d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ad000 tx=0x7fa8e80a6000 comp rx=0 tx=0).stop 2023-12-13T22:57:20.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 msgr2=0x7fa8f80b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:20.457 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c780 tx=0x7fa8f000cc40 comp rx=0 tx=0).stop 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 shutdown_connections 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7fa8d8066840 0x7fa8d8068d00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8f815a280 0x7fa8f80b1e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7fa8f80ce0c0 0x7fa8f80b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 --2- 172.21.15.91:0/2252436830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8f80cc3c0 0x7fa8f8156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 >> 172.21.15.91:0/2252436830 conn(0x7fa8f80b07c0 msgr2=0x7fa8f8158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 shutdown_connections 2023-12-13T22:57:20.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.460+0000 7fa8fda1d640 1 -- 172.21.15.91:0/2252436830 wait complete. 2023-12-13T22:57:20.477 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-13T22:57:20.603 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 Processor -- start 2023-12-13T22:57:20.604 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 -- start start 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f357c153460 0x7f357c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c0c5ab0 0x7f357c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f357c0c79a0 0x7f357c0c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c15d730 con 0x7f357c153460 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c15a3e0 con 0x7f357c0c79a0 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.604+0000 7f3583e74640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c153b70 con 0x7f357c0c5ab0 2023-12-13T22:57:20.605 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f357c153460 0x7f357c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7f357c153460 0x7f357c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50100/0 (socket says 172.21.15.91:50100) 2023-12-13T22:57:20.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 -- 172.21.15.91:0/3495735679 learned_addr learned my addr 172.21.15.91:0/3495735679 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:20.606 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f358140f640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c0c5ab0 0x7f357c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3582411640 1 --2- 172.21.15.91:0/3495735679 >> v2:172.21.15.152:3300/0 conn(0x7f357c0c79a0 0x7f357c0c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.607 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 -- 172.21.15.91:0/3495735679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c0c5ab0 msgr2=0x7f357c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:20.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c0c5ab0 0x7f357c0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 -- 172.21.15.91:0/3495735679 >> v2:172.21.15.152:3300/0 conn(0x7f357c0c79a0 msgr2=0x7f357c0c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:20.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 --2- 172.21.15.91:0/3495735679 >> v2:172.21.15.152:3300/0 conn(0x7f357c0c79a0 0x7f357c0c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.608 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.608+0000 7f3581c10640 1 -- 172.21.15.91:0/3495735679 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c153840 con 0x7f357c153460 2023-12-13T22:57:20.615 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.616+0000 7f3581c10640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c153460 0x7f357c159ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f357c0c69c0 tx=0x7f357801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265a4ab0ca529328 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:20.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3580c0e640 1 -- 172.21.15.91:0/3495735679 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780a89b0 con 0x7f357c153460 2023-12-13T22:57:20.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3580c0e640 1 -- 172.21.15.91:0/3495735679 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f35780a8b10 con 0x7f357c153460 2023-12-13T22:57:20.623 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3580c0e640 1 -- 172.21.15.91:0/3495735679 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780b0440 con 0x7f357c153460 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 -- 172.21.15.91:0/3495735679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c153460 msgr2=0x7f357c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c153460 0x7f357c159ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f357c0c69c0 tx=0x7f357801ecf0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 -- 172.21.15.91:0/3495735679 shutdown_connections 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 --2- 172.21.15.91:0/3495735679 >> v2:172.21.15.152:3300/0 conn(0x7f357c0c79a0 0x7f357c0c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c0c5ab0 0x7f357c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 --2- 172.21.15.91:0/3495735679 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c153460 0x7f357c159ea0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.624 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.624+0000 7f3583e74640 1 -- 172.21.15.91:0/3495735679 >> 172.21.15.91:0/3495735679 conn(0x7f357c06c6a0 msgr2=0x7f357c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:20.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- 172.21.15.91:0/3495735679 shutdown_connections 2023-12-13T22:57:20.625 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- 172.21.15.91:0/3495735679 wait complete. 2023-12-13T22:57:20.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 Processor -- start 2023-12-13T22:57:20.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- start start 2023-12-13T22:57:20.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.626 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c0c79a0 0x7f357c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c143940 0x7f357c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:20.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1f0140 con 0x7f357c0c5ab0 2023-12-13T22:57:20.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1ef530 con 0x7f357c0c79a0 2023-12-13T22:57:20.627 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.628+0000 7f3583e74640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c1ef810 con 0x7f357c143940 2023-12-13T22:57:20.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.632+0000 7f3581c10640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.628 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.632+0000 7f3581c10640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50112/0 (socket says 172.21.15.91:50112) 2023-12-13T22:57:20.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.632+0000 7f3581c10640 1 -- 172.21.15.91:0/2135942371 learned_addr learned my addr 172.21.15.91:0/2135942371 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:20.629 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.632+0000 7f3582411640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c143940 0x7f357c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.630 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.632+0000 7f358140f640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c0c79a0 0x7f357c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:20.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 -- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c143940 msgr2=0x7f357c06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:20.632 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c143940 0x7f357c06e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 -- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c0c79a0 msgr2=0x7f357c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:20.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c0c79a0 0x7f357c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:20.633 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 -- 172.21.15.91:0/2135942371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780094d0 con 0x7f357c0c5ab0 2023-12-13T22:57:20.635 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.636+0000 7f3581c10640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f357801c920 tx=0x7f357801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:20.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780b1db0 con 0x7f357c0c5ab0 2023-12-13T22:57:20.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f35780b9440 con 0x7f357c0c5ab0 2023-12-13T22:57:20.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780b9810 con 0x7f357c0c5ab0 2023-12-13T22:57:20.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c1efaf0 con 0x7f357c0c5ab0 2023-12-13T22:57:20.726 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c1ef1e0 con 0x7f357c0c5ab0 2023-12-13T22:57:20.727 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:20.728+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c067520 con 0x7f357c0c5ab0 2023-12-13T22:57:21.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.016+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f35780b7070 con 0x7f357c0c5ab0 2023-12-13T22:57:21.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.016+0000 7f35727fc640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 0x7f3560068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.014 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.016+0000 7f358140f640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 0x7f3560068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:21.015 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.016+0000 7f358140f640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 0x7f3560068ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f357c149c00 tx=0x7f356c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:21.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.056+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35780f3a90 con 0x7f357c0c5ab0 2023-12-13T22:57:21.055 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.056+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f35780ef6d0 con 0x7f357c0c5ab0 2023-12-13T22:57:21.287 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.288+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f357c147620 con 0x7f357c0c5ab0 2023-12-13T22:57:21.596 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.596+0000 7f35727fc640 1 -- 172.21.15.91:0/2135942371 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35780b5070 con 0x7f357c0c5ab0 2023-12-13T22:57:21.596 INFO:teuthology.orchestra.run.smithi091.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 msgr2=0x7f3560068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 0x7f3560068ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f357c149c00 tx=0x7f356c008040 comp rx=0 tx=0).stop 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 msgr2=0x7f357c148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f357801c920 tx=0x7f357801ba90 comp rx=0 tx=0).stop 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 shutdown_connections 2023-12-13T22:57:21.600 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3560066820 0x7f3560068ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f357c143940 0x7f357c06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f357c0c79a0 0x7f357c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 --2- 172.21.15.91:0/2135942371 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f357c0c5ab0 0x7f357c148580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 >> 172.21.15.91:0/2135942371 conn(0x7f357c06c6a0 msgr2=0x7f357c158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 shutdown_connections 2023-12-13T22:57:21.601 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.600+0000 7f3583e74640 1 -- 172.21.15.91:0/2135942371 wait complete. 2023-12-13T22:57:21.622 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-13T22:57:21.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 Processor -- start 2023-12-13T22:57:21.755 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 -- start start 2023-12-13T22:57:21.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f521c0722f0 0x7f521c0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c15a130 0x7f521c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c159590 con 0x7f521c0c66d0 2023-12-13T22:57:21.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c155fa0 con 0x7f521c0722f0 2023-12-13T22:57:21.756 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.756+0000 7f522456d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c072c10 con 0x7f521c15a130 2023-12-13T22:57:21.757 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.760+0000 7f5222309640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f521c0722f0 0x7f521c0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:21.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.760+0000 7f5221b08640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f521c0c66d0 0x7f521c159a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.91:36722/0 (socket says 172.21.15.91:36722) 2023-12-13T22:57:21.758 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.760+0000 7f5221b08640 1 -- 172.21.15.91:0/2603926475 learned_addr learned my addr 172.21.15.91:0/2603926475 (peer_addr_for_me v1:172.21.15.91:0/0) 2023-12-13T22:57:21.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.764+0000 7f5222309640 1 -- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c15a130 msgr2=0x7f521c0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:21.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.764+0000 7f5222309640 1 --2- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c15a130 0x7f521c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.764+0000 7f5222309640 1 -- 172.21.15.91:0/2603926475 >> v1:172.21.15.152:6789/0 conn(0x7f521c0c66d0 legacy=0x7f521c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:21.762 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.764+0000 7f5222309640 1 -- 172.21.15.91:0/2603926475 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c156190 con 0x7f521c0722f0 2023-12-13T22:57:21.767 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.768+0000 7f5222309640 1 --2- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0722f0 0x7f521c0726d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52180097c0 tx=0x7f521801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a0dd14dba1ffef server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:21.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.776+0000 7f5221307640 1 -- 172.21.15.91:0/2603926475 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180ab600 con 0x7f521c0722f0 2023-12-13T22:57:21.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.776+0000 7f5221307640 1 -- 172.21.15.91:0/2603926475 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f52180a7050 con 0x7f521c0722f0 2023-12-13T22:57:21.776 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.776+0000 7f5221307640 1 -- 172.21.15.91:0/2603926475 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180ab9a0 con 0x7f521c0722f0 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0722f0 msgr2=0x7f521c0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0722f0 0x7f521c0726d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52180097c0 tx=0x7f521801c380 comp rx=0 tx=0).stop 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- 172.21.15.91:0/2603926475 shutdown_connections 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c15a130 0x7f521c0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- 172.21.15.91:0/2603926475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0722f0 0x7f521c0726d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- 172.21.15.91:0/2603926475 >> 172.21.15.91:0/2603926475 conn(0x7f521c06b670 msgr2=0x7f521c06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- 172.21.15.91:0/2603926475 shutdown_connections 2023-12-13T22:57:21.777 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- 172.21.15.91:0/2603926475 wait complete. 2023-12-13T22:57:21.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 Processor -- start 2023-12-13T22:57:21.778 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- start start 2023-12-13T22:57:21.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c0722f0 0x7f521c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.779 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f521c15a130 0x7f521c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c1f1c00 con 0x7f521c15a130 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c144a70 con 0x7f521c0c66d0 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.780+0000 7f522456d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c144140 con 0x7f521c0722f0 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.784+0000 7f5221b08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:21.780 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.784+0000 7f5221b08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:59680/0 (socket says 172.21.15.91:59680) 2023-12-13T22:57:21.781 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.784+0000 7f5221b08640 1 -- 172.21.15.91:0/3823535153 learned_addr learned my addr 172.21.15.91:0/3823535153 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:21.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.788+0000 7f5221b08640 1 -- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c0722f0 msgr2=0x7f521c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:21.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.788+0000 7f5221b08640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c0722f0 0x7f521c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.788+0000 7f5221b08640 1 -- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f521c15a130 msgr2=0x7f521c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:21.787 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.788+0000 7f5221b08640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f521c15a130 0x7f521c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:21.788 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.788+0000 7f5221b08640 1 -- 172.21.15.91:0/3823535153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009420 con 0x7f521c0c66d0 2023-12-13T22:57:21.791 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.792+0000 7f5221b08640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f520c00b430 tx=0x7f520c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:21.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.800+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011830 con 0x7f521c0c66d0 2023-12-13T22:57:21.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.800+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f520c0119b0 con 0x7f521c0c66d0 2023-12-13T22:57:21.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.800+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c011d80 con 0x7f521c0c66d0 2023-12-13T22:57:21.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.800+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c1f1ea0 con 0x7f521c0c66d0 2023-12-13T22:57:21.799 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.800+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c144390 con 0x7f521c0c66d0 2023-12-13T22:57:21.800 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:21.804+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c073e70 con 0x7f521c0c66d0 2023-12-13T22:57:22.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.112+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f520c01a400 con 0x7f521c0c66d0 2023-12-13T22:57:22.109 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.112+0000 7f5212ffd640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 0x7f5200068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:22.110 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.112+0000 7f5222309640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 0x7f5200068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:22.111 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.112+0000 7f5222309640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 0x7f5200068d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f521c06f140 tx=0x7f52180ad040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:22.115 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.116+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f520c055f70 con 0x7f521c0c66d0 2023-12-13T22:57:22.153 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.156+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f520c051bb0 con 0x7f521c0c66d0 2023-12-13T22:57:22.357 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:22.360+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f521c1f2030 con 0x7f521c0c66d0 2023-12-13T22:57:23.543 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.544+0000 7f5212ffd640 1 -- 172.21.15.91:0/3823535153 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f520c0150a0 con 0x7f521c0c66d0 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 msgr2=0x7f5200068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 0x7f5200068d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f521c06f140 tx=0x7f52180ad040 comp rx=0 tx=0).stop 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 msgr2=0x7f521c1f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f520c00b430 tx=0x7f520c00b8f0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 shutdown_connections 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f5200066840 0x7f5200068d00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f521c15a130 0x7f521c142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f521c0c66d0 0x7f521c1f2330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 --2- 172.21.15.91:0/3823535153 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f521c0722f0 0x7f521c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 >> 172.21.15.91:0/3823535153 conn(0x7f521c06b670 msgr2=0x7f521c142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 shutdown_connections 2023-12-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.548+0000 7f522456d640 1 -- 172.21.15.91:0/3823535153 wait complete. 2023-12-13T22:57:23.562 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-13T22:57:23.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.680+0000 7f305265b640 1 Processor -- start 2023-12-13T22:57:23.679 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.680+0000 7f305265b640 1 -- start start 2023-12-13T22:57:23.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f305265b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:23.680 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f305265b640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0c9aa0 con 0x7f304c15a830 2023-12-13T22:57:23.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f305265b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c15adb0 con 0x7f304c1572c0 2023-12-13T22:57:23.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f305265b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c157730 con 0x7f304c0ccfb0 2023-12-13T22:57:23.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f304bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:23.681 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f304bfff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.91:48328/0 (socket says 172.21.15.91:48328) 2023-12-13T22:57:23.682 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.684+0000 7f304bfff640 1 -- 172.21.15.91:0/4230082174 learned_addr learned my addr 172.21.15.91:0/4230082174 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:23.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.688+0000 7f304bfff640 1 -- 172.21.15.91:0/4230082174 >> v1:172.21.15.152:6789/0 conn(0x7f304c1572c0 legacy=0x7f304c161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:23.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.688+0000 7f304bfff640 1 -- 172.21.15.91:0/4230082174 >> v1:172.21.15.91:6789/0 conn(0x7f304c15a830 legacy=0x7f304c151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:23.685 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.688+0000 7f304bfff640 1 -- 172.21.15.91:0/4230082174 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c15b050 con 0x7f304c0ccfb0 2023-12-13T22:57:23.688 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.692+0000 7f304bfff640 1 --2- 172.21.15.91:0/4230082174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f303c0098a0 tx=0x7f303c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c7b98e1baf698ab server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:23.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f304affd640 1 -- 172.21.15.91:0/4230082174 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0a8990 con 0x7f304c0ccfb0 2023-12-13T22:57:23.694 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f304affd640 1 -- 172.21.15.91:0/4230082174 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f303c0a8af0 con 0x7f304c0ccfb0 2023-12-13T22:57:23.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f304affd640 1 -- 172.21.15.91:0/4230082174 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0a8ea0 con 0x7f304c0ccfb0 2023-12-13T22:57:23.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 -- 172.21.15.91:0/4230082174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 msgr2=0x7f304c0cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:23.695 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 --2- 172.21.15.91:0/4230082174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f303c0098a0 tx=0x7f303c01ecd0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 -- 172.21.15.91:0/4230082174 shutdown_connections 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 --2- 172.21.15.91:0/4230082174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c0ccfb0 0x7f304c0cc470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 -- 172.21.15.91:0/4230082174 >> 172.21.15.91:0/4230082174 conn(0x7f304c061400 msgr2=0x7f304c061810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 -- 172.21.15.91:0/4230082174 shutdown_connections 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.696+0000 7f305265b640 1 -- 172.21.15.91:0/4230082174 wait complete. 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 Processor -- start 2023-12-13T22:57:23.696 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 -- start start 2023-12-13T22:57:23.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:23.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c1572c0 0x7f304c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:23.697 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f304c15a830 0x7f304c0c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:23.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c6300 con 0x7f304c0ccfb0 2023-12-13T22:57:23.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c06ba70 con 0x7f304c15a830 2023-12-13T22:57:23.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f305265b640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c06bd50 con 0x7f304c1572c0 2023-12-13T22:57:23.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f304bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:23.698 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f3050bf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f304c15a830 0x7f304c0c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:23.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f304bfff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50130/0 (socket says 172.21.15.91:50130) 2023-12-13T22:57:23.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f304bfff640 1 -- 172.21.15.91:0/946360363 learned_addr learned my addr 172.21.15.91:0/946360363 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:23.699 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.700+0000 7f304b7fe640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c1572c0 0x7f304c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:23.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 -- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c1572c0 msgr2=0x7f304c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:23.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c1572c0 0x7f304c14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 -- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f304c15a830 msgr2=0x7f304c0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:23.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f304c15a830 0x7f304c0c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:23.702 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 -- 172.21.15.91:0/946360363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094d0 con 0x7f304c0ccfb0 2023-12-13T22:57:23.704 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.704+0000 7f304bfff640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b3040 tx=0x7f303c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:23.707 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.708+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0bf070 con 0x7f304c0ccfb0 2023-12-13T22:57:23.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.708+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f303c0b0cc0 con 0x7f304c0ccfb0 2023-12-13T22:57:23.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.708+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c06c030 con 0x7f304c0ccfb0 2023-12-13T22:57:23.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.708+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0bb6e0 con 0x7f304c0ccfb0 2023-12-13T22:57:23.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.708+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c0c4420 con 0x7f304c0ccfb0 2023-12-13T22:57:23.708 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.712+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c06c550 con 0x7f304c0ccfb0 2023-12-13T22:57:23.729 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.732+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f303c0bb840 con 0x7f304c0ccfb0 2023-12-13T22:57:23.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.732+0000 7f3048ff9640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 0x7f3038068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:23.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.732+0000 7f304b7fe640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 0x7f3038068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:23.730 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:23.732+0000 7f304b7fe640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 0x7f3038068d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b2f20 tx=0x7f3040009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:24.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.016+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f303c0b0e30 con 0x7f304c0ccfb0 2023-12-13T22:57:24.016 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.016+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f303c0f0000 con 0x7f304c0ccfb0 2023-12-13T22:57:24.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-13T22:57:24.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-12-13T22:57:24.180 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.184+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f304c0c4280 con 0x7f304c0ccfb0 2023-12-13T22:57:24.924 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.924+0000 7f3048ff9640 1 -- 172.21.15.91:0/946360363 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f304c0c4280 con 0x7f304c0ccfb0 2023-12-13T22:57:24.924 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_metadata' removed 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 msgr2=0x7f3038068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 0x7f3038068d00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b2f20 tx=0x7f3040009040 comp rx=0 tx=0).stop 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 msgr2=0x7f304c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b3040 tx=0x7f303c01ba70 comp rx=0 tx=0).stop 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 shutdown_connections 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f3038066840 0x7f3038068d00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:24.928 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f304c15a830 0x7f304c0c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:24.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f304c1572c0 0x7f304c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:24.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 --2- 172.21.15.91:0/946360363 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f304c0ccfb0 0x7f304c06d150 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:24.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.928+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 >> 172.21.15.91:0/946360363 conn(0x7f304c061400 msgr2=0x7f304c1557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:24.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.932+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 shutdown_connections 2023-12-13T22:57:24.929 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:24.932+0000 7f305265b640 1 -- 172.21.15.91:0/946360363 wait complete. 2023-12-13T22:57:24.948 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-13T22:57:25.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 Processor -- start 2023-12-13T22:57:25.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 -- start start 2023-12-13T22:57:25.075 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc150210 0x7f54cc156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc1505f0 0x7f54cc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc0c1320 con 0x7f54cc0c8610 2023-12-13T22:57:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0c1600 con 0x7f54cc1505f0 2023-12-13T22:57:25.076 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.076+0000 7f54d0aac640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c18e0 con 0x7f54cc150210 2023-12-13T22:57:25.100 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.104+0000 7f54c3fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc1505f0 0x7f54cc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:25.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.104+0000 7f54c3fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54cc1505f0 0x7f54cc06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:59706/0 (socket says 172.21.15.91:59706) 2023-12-13T22:57:25.101 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.104+0000 7f54c3fff640 1 -- 172.21.15.91:0/2946888658 learned_addr learned my addr 172.21.15.91:0/2946888658 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:25.105 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.108+0000 7f54c3fff640 1 -- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc150210 msgr2=0x7f54cc156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:25.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.108+0000 7f54c3fff640 1 --2- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc150210 0x7f54cc156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:25.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.108+0000 7f54c3fff640 1 -- 172.21.15.91:0/2946888658 >> v1:172.21.15.152:6789/0 conn(0x7f54cc0c8610 legacy=0x7f54cc071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:25.106 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.108+0000 7f54c3fff640 1 -- 172.21.15.91:0/2946888658 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc156200 con 0x7f54cc1505f0 2023-12-13T22:57:25.113 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.116+0000 7f54c3fff640 1 --2- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc1505f0 0x7f54cc06fba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bb10 tx=0x7f54bc021400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ab756ae8a9842a server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:25.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54c9d9b640 1 -- 172.21.15.91:0/2946888658 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0b1600 con 0x7f54cc1505f0 2023-12-13T22:57:25.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54c9d9b640 1 -- 172.21.15.91:0/2946888658 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54bc0ad050 con 0x7f54cc1505f0 2023-12-13T22:57:25.117 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54c9d9b640 1 -- 172.21.15.91:0/2946888658 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0b19a0 con 0x7f54cc1505f0 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc1505f0 msgr2=0x7f54cc06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc1505f0 0x7f54cc06fba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bb10 tx=0x7f54bc021400 comp rx=0 tx=0).stop 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- 172.21.15.91:0/2946888658 shutdown_connections 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc1505f0 0x7f54cc06fba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2946888658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc150210 0x7f54cc156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- 172.21.15.91:0/2946888658 >> 172.21.15.91:0/2946888658 conn(0x7f54cc06b670 msgr2=0x7f54cc06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- 172.21.15.91:0/2946888658 shutdown_connections 2023-12-13T22:57:25.118 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- 172.21.15.91:0/2946888658 wait complete. 2023-12-13T22:57:25.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 Processor -- start 2023-12-13T22:57:25.119 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.120+0000 7f54d0aac640 1 -- start start 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c8610 0x7f54cc14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc14c810 0x7f54cc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc1ef150 con 0x7f54cc14c810 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc14b490 con 0x7f54cc150210 2023-12-13T22:57:25.121 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54d0aac640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc1ee5d0 con 0x7f54cc0c8610 2023-12-13T22:57:25.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54cad9d640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc14c810 0x7f54cc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:25.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:25.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.91:59712/0 (socket says 172.21.15.91:59712) 2023-12-13T22:57:25.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54c3fff640 1 -- 172.21.15.91:0/2936355647 learned_addr learned my addr 172.21.15.91:0/2936355647 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:25.122 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.124+0000 7f54ca59c640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c8610 0x7f54cc14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:25.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.128+0000 7f54c3fff640 1 -- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c8610 msgr2=0x7f54cc14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:25.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.128+0000 7f54c3fff640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c8610 0x7f54cc14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:25.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.128+0000 7f54c3fff640 1 -- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc14c810 msgr2=0x7f54cc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:25.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.128+0000 7f54c3fff640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc14c810 0x7f54cc154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:25.126 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.128+0000 7f54c3fff640 1 -- 172.21.15.91:0/2936355647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc00b770 con 0x7f54cc150210 2023-12-13T22:57:25.129 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.132+0000 7f54c3fff640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54bc01f030 tx=0x7f54bc01e1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:25.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0ba810 con 0x7f54cc150210 2023-12-13T22:57:25.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54bc0ba990 con 0x7f54cc150210 2023-12-13T22:57:25.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0bad60 con 0x7f54cc150210 2023-12-13T22:57:25.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc1ee8b0 con 0x7f54cc150210 2023-12-13T22:57:25.134 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc1eee70 con 0x7f54cc150210 2023-12-13T22:57:25.135 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.136+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc073e70 con 0x7f54cc150210 2023-12-13T22:57:25.449 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.452+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f54bc0b8040 con 0x7f54cc150210 2023-12-13T22:57:25.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.452+0000 7f54c2ffd640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:25.450 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.452+0000 7f54ca59c640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:25.451 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.452+0000 7f54ca59c640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009990 tx=0x7f54b4009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:25.458 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.460+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f54bc0f6220 con 0x7f54cc150210 2023-12-13T22:57:25.485 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.488+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f54bc0f2560 con 0x7f54cc150210 2023-12-13T22:57:25.652 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:25.656+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54cc153a10 con 0x7f54cc150210 2023-12-13T22:57:26.414 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.416+0000 7f54c2ffd640 1 -- 172.21.15.91:0/2936355647 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54bc0b6020 con 0x7f54cc150210 2023-12-13T22:57:26.414 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data' removed 2023-12-13T22:57:26.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 msgr2=0x7f54ac068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:26.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009990 tx=0x7f54b4009110 comp rx=0 tx=0).stop 2023-12-13T22:57:26.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 msgr2=0x7f54cc1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:26.417 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54bc01f030 tx=0x7f54bc01e1a0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 shutdown_connections 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7f54ac066870 0x7f54ac068d30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7f54cc14c810 0x7f54cc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54cc150210 0x7f54cc1545c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 --2- 172.21.15.91:0/2936355647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54cc0c8610 0x7f54cc14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 >> 172.21.15.91:0/2936355647 conn(0x7f54cc06b670 msgr2=0x7f54cc06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 shutdown_connections 2023-12-13T22:57:26.418 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.420+0000 7f54d0aac640 1 -- 172.21.15.91:0/2936355647 wait complete. 2023-12-13T22:57:26.445 DEBUG:teuthology.orchestra.run.smithi091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-13T22:57:26.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 Processor -- start 2023-12-13T22:57:26.571 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 -- start start 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff7640cc3c0 0x7ff7640ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff76415a280 0x7ff764163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 -- --> v1:172.21.15.91:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640cd9a0 con 0x7ff7640ce0c0 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 -- --> v2:172.21.15.91:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640ca550 con 0x7ff76415a280 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.572+0000 7ff769bb9640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640ce9e0 con 0x7ff7640cc3c0 2023-12-13T22:57:26.572 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.576+0000 7ff763fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff76415a280 0x7ff764163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.576+0000 7ff763fff640 1 --2- >> v2:172.21.15.91:3300/0 conn(0x7ff76415a280 0x7ff764163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50146/0 (socket says 172.21.15.91:50146) 2023-12-13T22:57:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.576+0000 7ff763fff640 1 -- 172.21.15.91:0/1482292948 learned_addr learned my addr 172.21.15.91:0/1482292948 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:26.573 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.576+0000 7ff762ffd640 1 --2- 172.21.15.91:0/1482292948 >> v2:172.21.15.152:3300/0 conn(0x7ff7640cc3c0 0x7ff7640ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.580+0000 7ff763fff640 1 -- 172.21.15.91:0/1482292948 >> v2:172.21.15.152:3300/0 conn(0x7ff7640cc3c0 msgr2=0x7ff7640ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:26.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.580+0000 7ff763fff640 1 --2- 172.21.15.91:0/1482292948 >> v2:172.21.15.152:3300/0 conn(0x7ff7640cc3c0 0x7ff7640ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.580+0000 7ff763fff640 1 -- 172.21.15.91:0/1482292948 >> v1:172.21.15.91:6789/0 conn(0x7ff7640ce0c0 legacy=0x7ff764159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-13T22:57:26.576 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.580+0000 7ff763fff640 1 -- 172.21.15.91:0/1482292948 --> v2:172.21.15.91:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7641596c0 con 0x7ff76415a280 2023-12-13T22:57:26.581 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.584+0000 7ff763fff640 1 --2- 172.21.15.91:0/1482292948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff764163e50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff76415dbc0 tx=0x7ff75c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6969ca8e9b3d2d10 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:26.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff7627fc640 1 -- 172.21.15.91:0/1482292948 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0a5850 con 0x7ff76415a280 2023-12-13T22:57:26.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff7627fc640 1 -- 172.21.15.91:0/1482292948 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff75c0a59b0 con 0x7ff76415a280 2023-12-13T22:57:26.585 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff7627fc640 1 -- 172.21.15.91:0/1482292948 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0a5d60 con 0x7ff76415a280 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- 172.21.15.91:0/1482292948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 msgr2=0x7ff764163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- 172.21.15.91:0/1482292948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff764163e50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff76415dbc0 tx=0x7ff75c01c990 comp rx=0 tx=0).stop 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- 172.21.15.91:0/1482292948 shutdown_connections 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- 172.21.15.91:0/1482292948 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff764163e50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- 172.21.15.91:0/1482292948 >> v2:172.21.15.152:3300/0 conn(0x7ff7640cc3c0 0x7ff7640ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- 172.21.15.91:0/1482292948 >> 172.21.15.91:0/1482292948 conn(0x7ff7640b07c0 msgr2=0x7ff7640b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:26.586 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- 172.21.15.91:0/1482292948 shutdown_connections 2023-12-13T22:57:26.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- 172.21.15.91:0/1482292948 wait complete. 2023-12-13T22:57:26.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 Processor -- start 2023-12-13T22:57:26.587 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- start start 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7640cc3c0 0x7ff7640b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7640ce0c0 0x7ff7640b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764147560 con 0x7ff76415a280 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764145bf0 con 0x7ff7640cc3c0 2023-12-13T22:57:26.588 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.588+0000 7ff769bb9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff764145eb0 con 0x7ff7640ce0c0 2023-12-13T22:57:26.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.592+0000 7ff763fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.592+0000 7ff763fff640 1 --2- >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.91:3300/0 says I am v2:172.21.15.91:50160/0 (socket says 172.21.15.91:50160) 2023-12-13T22:57:26.589 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.592+0000 7ff763fff640 1 -- 172.21.15.91:0/2779165261 learned_addr learned my addr 172.21.15.91:0/2779165261 (peer_addr_for_me v2:172.21.15.91:0/0) 2023-12-13T22:57:26.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.592+0000 7ff7637fe640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7640cc3c0 0x7ff7640b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.590 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.592+0000 7ff762ffd640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7640ce0c0 0x7ff7640b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.592 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 -- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7640ce0c0 msgr2=0x7ff7640b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:26.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7640ce0c0 0x7ff7640b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 -- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7640cc3c0 msgr2=0x7ff7640b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:26.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7640cc3c0 0x7ff7640b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:26.593 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 -- 172.21.15.91:0/2779165261 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009b30 con 0x7ff76415a280 2023-12-13T22:57:26.595 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.596+0000 7ff763fff640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0af040 tx=0x7ff75c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b8670 con 0x7ff76415a280 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff75c0b8810 con 0x7ff76415a280 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b8be0 con 0x7ff76415a280 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7641477d0 con 0x7ff76415a280 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7640b3650 con 0x7ff76415a280 2023-12-13T22:57:26.599 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.600+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640b3840 con 0x7ff76415a280 2023-12-13T22:57:26.618 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.620+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff75c0b8d40 con 0x7ff76415a280 2023-12-13T22:57:26.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.620+0000 7ff74bfff640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 0x7ff750068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-13T22:57:26.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.620+0000 7ff7637fe640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 0x7ff750068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-13T22:57:26.619 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.620+0000 7ff7637fe640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 0x7ff750068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff754007fd0 tx=0x7ff754007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-13T22:57:26.874 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.876+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5953+0+0 (secure 0 0 0) 0x7ff75c0f1160 con 0x7ff76415a280 2023-12-13T22:57:26.875 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:26.876+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff75c0ed410 con 0x7ff76415a280 2023-12-13T22:57:27.040 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.040+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 --> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7640b3840 con 0x7ff76415a280 2023-12-13T22:57:27.216 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.220+0000 7ff74bfff640 1 -- 172.21.15.91:0/2779165261 <== mon.0 v2:172.21.15.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff75c0ef340 con 0x7ff76415a280 2023-12-13T22:57:27.217 INFO:teuthology.orchestra.run.smithi091.stderr:pool 'cephfs_data_ec' removed 2023-12-13T22:57:27.220 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 msgr2=0x7ff750068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 0x7ff750068d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff754007fd0 tx=0x7ff754007e40 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 msgr2=0x7ff7641f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0af040 tx=0x7ff75c019730 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 shutdown_connections 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:6800/3723397605,v1:172.21.15.91:6801/3723397605] conn(0x7ff750066840 0x7ff750068d00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.91:3300/0,v1:172.21.15.91:6789/0] conn(0x7ff76415a280 0x7ff7641f6380 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7640ce0c0 0x7ff7640b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 --2- 172.21.15.91:0/2779165261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7640cc3c0 0x7ff7640b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 >> 172.21.15.91:0/2779165261 conn(0x7ff7640b07c0 msgr2=0x7ff764157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 shutdown_connections 2023-12-13T22:57:27.221 INFO:teuthology.orchestra.run.smithi091.stderr:2023-12-13T22:57:27.224+0000 7ff769bb9640 1 -- 172.21.15.91:0/2779165261 wait complete. 2023-12-13T22:57:27.246 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-13T22:57:27.247 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-13T22:57:27.247 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:27.268 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-12-13T22:57:27.252+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 43771) UID: 0 2023-12-13T22:57:27.269 INFO:tasks.ceph.mds.a.smithi091.stderr:2023-12-13T22:57:27.256+0000 b9ac640 -1 mds.a *** got signal Terminated *** 2023-12-13T22:57:30.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-12-13T22:57:30.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2023-12-13T22:57:30.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2023-12-13T22:57:33.349 INFO:tasks.ceph.mds.a:Stopped 2023-12-13T22:57:33.350 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-13T22:57:33.350 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:33.387 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-12-13T22:57:33.360+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 43773) UID: 0 2023-12-13T22:57:33.388 INFO:tasks.ceph.mds.c.smithi091.stderr:2023-12-13T22:57:33.364+0000 b9ac640 -1 mds.c *** got signal Terminated *** 2023-12-13T22:57:36.138 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:57:36.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:57:37.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2023-12-13T22:57:37.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2023-12-13T22:57:37.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~13s 2023-12-13T22:57:39.452 INFO:tasks.ceph.mds.c:Stopped 2023-12-13T22:57:39.452 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-13T22:57:39.452 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:39.452 INFO:tasks.ceph.mds.e:Stopped 2023-12-13T22:57:39.452 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-13T22:57:39.452 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:39.452 INFO:tasks.ceph.mds.b:Stopped 2023-12-13T22:57:39.453 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-13T22:57:39.453 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:39.495 INFO:tasks.ceph.mds.d.smithi152.stderr:2023-12-13T22:57:39.467+0000 b9ac640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 44204) UID: 0 2023-12-13T22:57:39.496 INFO:tasks.ceph.mds.d.smithi152.stderr:2023-12-13T22:57:39.471+0000 b9ac640 -1 mds.d *** got signal Terminated *** 2023-12-13T22:57:43.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-13T22:57:43.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2023-12-13T22:57:43.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-13T22:57:43.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-12-13T22:57:45.555 INFO:tasks.ceph.mds.d:Stopped 2023-12-13T22:57:45.555 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-13T22:57:45.556 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:45.556 INFO:tasks.ceph.mds.f:Stopped 2023-12-13T22:57:45.556 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-13T22:57:45.557 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-13T22:57:45.557 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:45.558 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:57:45.559+0000 7f3a5abf5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 38646) UID: 0 2023-12-13T22:57:45.558 INFO:tasks.ceph.osd.0.smithi091.stderr:2023-12-13T22:57:45.559+0000 7f3a5abf5640 -1 osd.0 38 *** Got signal Terminated *** 2023-12-13T22:57:49.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-13T22:57:49.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-12-13T22:57:49.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-13T22:57:51.659 INFO:tasks.ceph.osd.0:Stopped 2023-12-13T22:57:51.660 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-13T22:57:51.660 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:51.661 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:57:51.663+0000 7fe76a6e4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 38648) UID: 0 2023-12-13T22:57:51.662 INFO:tasks.ceph.osd.1.smithi091.stderr:2023-12-13T22:57:51.663+0000 7fe76a6e4640 -1 osd.1 40 *** Got signal Terminated *** 2023-12-13T22:57:55.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-13T22:57:55.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-13T22:57:57.761 INFO:tasks.ceph.osd.1:Stopped 2023-12-13T22:57:57.761 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-13T22:57:57.762 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:57:57.763 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:57:57.763+0000 7fba37f85640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 38650) UID: 0 2023-12-13T22:57:57.763 INFO:tasks.ceph.osd.2.smithi091.stderr:2023-12-13T22:57:57.763+0000 7fba37f85640 -1 osd.2 41 *** Got signal Terminated *** 2023-12-13T22:58:01.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-13T22:58:01.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-13T22:58:03.863 INFO:tasks.ceph.osd.2:Stopped 2023-12-13T22:58:03.863 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-13T22:58:03.863 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:03.864 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:58:03.867+0000 7fedced4d640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 38653) UID: 0 2023-12-13T22:58:03.864 INFO:tasks.ceph.osd.3.smithi091.stderr:2023-12-13T22:58:03.867+0000 7fedced4d640 -1 osd.3 42 *** Got signal Terminated *** 2023-12-13T22:58:06.209 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:06.212 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:07.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-13T22:58:07.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-13T22:58:08.123 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:33:32.281 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.142 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:33:32.300 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.257 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:33:32.366 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.271 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:33:32.380 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.315 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:33:32.424 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.316 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:33:32.425 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.414 INFO:tasks.ceph.mon.a.smithi091.stderr:==00:00:33:32.572 38451== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.661 INFO:tasks.ceph.mon.c.smithi152.stderr:==00:00:33:32.769 38456== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:08.740 INFO:tasks.ceph.mon.b.smithi152.stderr:==00:00:33:32.848 38457== Warning: unimplemented fcntl command: 1036 2023-12-13T22:58:09.965 INFO:tasks.ceph.osd.3:Stopped 2023-12-13T22:58:09.966 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-13T22:58:09.966 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:09.966 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:58:09.967+0000 7fc59e7a1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 38777) UID: 0 2023-12-13T22:58:09.967 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-12-13T22:58:09.967+0000 7fc59e7a1640 -1 osd.4 43 *** Got signal Terminated *** 2023-12-13T22:58:13.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-13T22:58:13.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-13T22:58:16.067 INFO:tasks.ceph.osd.4:Stopped 2023-12-13T22:58:16.067 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-13T22:58:16.067 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:16.068 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:58:16.071+0000 7f0bc18b5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 38779) UID: 0 2023-12-13T22:58:16.068 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-12-13T22:58:16.071+0000 7f0bc18b5640 -1 osd.5 44 *** Got signal Terminated *** 2023-12-13T22:58:19.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-13T22:58:19.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-13T22:58:22.169 INFO:tasks.ceph.osd.5:Stopped 2023-12-13T22:58:22.169 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-13T22:58:22.169 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:22.170 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:58:22.171+0000 7f591f25c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 38782) UID: 0 2023-12-13T22:58:22.170 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-12-13T22:58:22.171+0000 7f591f25c640 -1 osd.6 45 *** Got signal Terminated *** 2023-12-13T22:58:24.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-13T22:58:24.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-13T22:58:28.271 INFO:tasks.ceph.osd.6:Stopped 2023-12-13T22:58:28.271 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-13T22:58:28.271 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:28.273 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:58:28.275+0000 7fede28bc640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 38781) UID: 0 2023-12-13T22:58:28.273 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-12-13T22:58:28.275+0000 7fede28bc640 -1 osd.7 45 *** Got signal Terminated *** 2023-12-13T22:58:30.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-13T22:58:30.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-13T22:58:34.373 INFO:tasks.ceph.osd.7:Stopped 2023-12-13T22:58:34.373 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-13T22:58:34.374 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-13T22:58:34.374 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:34.375 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:58:34.378+0000 7f2ff6475640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 38453) UID: 0 2023-12-13T22:58:34.376 INFO:tasks.ceph.mgr.y.smithi091.stderr:2023-12-13T22:58:34.378+0000 7f2ff6475640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-13T22:58:34.404 INFO:tasks.ceph.mgr.y:Stopped 2023-12-13T22:58:34.404 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-13T22:58:34.404 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:34.433 INFO:tasks.ceph.mgr.x:Stopped 2023-12-13T22:58:34.433 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-13T22:58:34.434 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-13T22:58:34.434 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:34.467 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-12-13T22:58:34.458+0000 a347640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 38448) UID: 0 2023-12-13T22:58:34.468 INFO:tasks.ceph.mon.a.smithi091.stderr:2023-12-13T22:58:34.458+0000 a347640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-13T22:58:35.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-13T22:58:35.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-13T22:58:36.349 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:36.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:40.535 INFO:tasks.ceph.mon.a:Stopped 2023-12-13T22:58:40.536 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-13T22:58:40.536 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:40.558 INFO:tasks.ceph.mon.b.smithi152.stderr:2023-12-13T22:58:40.542+0000 a347640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 38450) UID: 0 2023-12-13T22:58:40.559 INFO:tasks.ceph.mon.b.smithi152.stderr:2023-12-13T22:58:40.542+0000 a347640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-13T22:58:40.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-13T22:58:45.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-13T22:58:46.637 INFO:tasks.ceph.mon.b:Stopped 2023-12-13T22:58:46.638 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-13T22:58:46.638 INFO:teuthology.orchestra.run:waiting for 300 2023-12-13T22:58:46.676 INFO:tasks.ceph.mon.c.smithi152.stderr:2023-12-13T22:58:46.650+0000 a347640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 38452) UID: 0 2023-12-13T22:58:46.677 INFO:tasks.ceph.mon.c.smithi152.stderr:2023-12-13T22:58:46.654+0000 a347640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-12-13T22:58:50.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-13T22:58:50.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-13T22:58:52.740 INFO:tasks.ceph.mon.c:Stopped 2023-12-13T22:58:52.741 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-13T22:58:52.741 DEBUG:teuthology.orchestra.run.smithi091:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-13T22:58:52.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:58:52.760 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-13T22:58:53.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:58:53.040 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-13T22:58:53.253 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:58:53.253 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-13T22:58:53.445 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:58:53.445 DEBUG:teuthology.orchestra.run.smithi091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-13T22:58:53.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:58:53.607 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-13T22:58:53.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:58:53.805 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-13T22:58:53.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:58:53.991 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-13T22:58:54.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:58:54.159 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-13T22:58:54.294 INFO:tasks.ceph:Archiving mon data... 2023-12-13T22:58:54.295 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/data/mon.a.tgz 2023-12-13T22:58:54.296 DEBUG:teuthology.orchestra.run.smithi091:> mktemp 2023-12-13T22:58:54.301 INFO:teuthology.orchestra.run.smithi091.stdout:/tmp/tmp.iE0ul7zyl9 2023-12-13T22:58:54.302 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iE0ul7zyl9 2023-12-13T22:58:54.426 DEBUG:teuthology.orchestra.run.smithi091:> sudo chmod 0666 /tmp/tmp.iE0ul7zyl9 2023-12-13T22:58:54.489 DEBUG:teuthology.orchestra.remote:smithi091:/tmp/tmp.iE0ul7zyl9 is 323KB 2023-12-13T22:58:54.551 DEBUG:teuthology.orchestra.run.smithi091:> rm -fr /tmp/tmp.iE0ul7zyl9 2023-12-13T22:58:54.556 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/data/mon.b.tgz 2023-12-13T22:58:54.556 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-12-13T22:58:54.563 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.RG8QCPpHyV 2023-12-13T22:58:54.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RG8QCPpHyV 2023-12-13T22:58:54.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.RG8QCPpHyV 2023-12-13T22:58:54.755 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.RG8QCPpHyV is 326KB 2023-12-13T22:58:54.854 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.RG8QCPpHyV 2023-12-13T22:58:54.859 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/data/mon.c.tgz 2023-12-13T22:58:54.860 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-12-13T22:58:54.908 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.bRsfFdMykJ 2023-12-13T22:58:54.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bRsfFdMykJ 2023-12-13T22:58:55.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.bRsfFdMykJ 2023-12-13T22:58:55.099 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.bRsfFdMykJ is 326KB 2023-12-13T22:58:55.161 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.bRsfFdMykJ 2023-12-13T22:58:55.167 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-13T22:58:55.167 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-13T22:58:55.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-13T22:58:55.439 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-13T22:58:55.731 INFO:tasks.ceph:Archiving crash dumps... 2023-12-13T22:58:55.733 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi091/crash 2023-12-13T22:58:55.734 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-13T22:58:55.749 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi152/crash 2023-12-13T22:58:55.750 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-13T22:58:55.763 INFO:tasks.ceph:Shutting down logrotate 2023-12-13T22:58:55.763 DEBUG:teuthology.orchestra.run.smithi091:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:55.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:55.866 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:55.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-13T22:58:55.906 INFO:tasks.ceph:Compressing logs... 2023-12-13T22:58:55.906 DEBUG:teuthology.orchestra.run.smithi091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-13T22:58:55.922 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-13T22:58:55.969 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2023-12-13T22:58:55.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45752.log 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-13T22:58:55.971 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45752.log: /var/log/ceph/ceph-client.admin.47435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2023-12-13T22:58:55.973 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2023-12-13T22:58:55.973 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2023-12-13T22:58:55.973 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45752.log.gz 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2023-12-13T22:58:55.974 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-osd.0.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38726.log 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38675.log 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38624.log 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38726.log: /var/log/ceph/ceph-client.admin.38675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38699.log 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38675.log.gz 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38624.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38726.log.gz 2023-12-13T22:58:55.991 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38624.log.gz 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38699.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.5.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38699.log.gz 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38750.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38750.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38750.log.gz 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-13T22:58:55.992 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/valgrind/mon.c.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/valgrind/mds.f.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/valgrind/mds.b.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/valgrind/mds.d.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38651.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz/var/log/ceph/valgrind/mon.b.log: 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38651.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38651.log.gz 2023-12-13T22:58:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-13T22:58:56.005 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.b.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-13T22:58:56.006 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2023-12-13T22:58:56.010 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47075.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45260.log: /var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47539.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2023-12-13T22:58:56.011 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47539.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46121.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45210.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44076.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45248.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45248.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45210.log.gz 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2023-12-13T22:58:56.012 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44941.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45248.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47409.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44915.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 88.6% 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45834.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2023-12-13T22:58:56.013 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45834.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46997.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44804.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47154.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz -5 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5/var/log/ceph/ceph-client.admin.46997.log: --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46997.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47800.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47331.log 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2023-12-13T22:58:56.014 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47331.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47800.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48040.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44104.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48040.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46534.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2023-12-13T22:58:56.015 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.0.46534.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48118.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48118.log: /var/log/ceph/ceph-client.admin.45509.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48118.log.gz 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45019.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz/var/log/ceph/ceph-client.admin.45259.log: 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48144.log 2023-12-13T22:58:56.016 INFO:teuthology.orchestra.run.smithi091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48144.log: /var/log/ceph/ceph-osd.3.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48144.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46253.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46095.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45913.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43733.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45698.log 2023-12-13T22:58:56.017 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47826.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45698.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45913.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45698.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47357.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47826.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45965.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr: 88.5%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45252.log 2023-12-13T22:58:56.018 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47938.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2023-12-13T22:58:56.019 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45252.log.gz 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44726.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47565.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44830.log 2023-12-13T22:58:56.023 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48014.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43889.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44830.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44830.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43889.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43889.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46227.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47101.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44595.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46227.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46227.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44595.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44595.log.gz 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45656.log 2023-12-13T22:58:56.024 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46303.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2023-12-13T22:58:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38569.log 2023-12-13T22:58:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38593.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2023-12-13T22:58:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.38569.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38569.log.gz 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45656.log.gz 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44286.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44752.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2023-12-13T22:58:56.027 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2023-12-13T22:58:56.028 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46147.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2023-12-13T22:58:56.028 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2023-12-13T22:58:56.029 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47644.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2023-12-13T22:58:56.030 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-13T22:58:56.030 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2023-12-13T22:58:56.031 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47748.log 2023-12-13T22:58:56.035 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-13T22:58:56.036 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45464.log 2023-12-13T22:58:56.036 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47748.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47748.log.gz 2023-12-13T22:58:56.037 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2023-12-13T22:58:56.038 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45464.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45464.log.gz 2023-12-13T22:58:56.038 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2023-12-13T22:58:56.039 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43919.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2023-12-13T22:58:56.039 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2023-12-13T22:58:56.040 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44699.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2023-12-13T22:58:56.041 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45253.log 2023-12-13T22:58:56.042 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47962.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2023-12-13T22:58:56.042 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2023-12-13T22:58:56.043 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45253.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45253.log.gz 2023-12-13T22:58:56.043 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2023-12-13T22:58:56.044 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47206.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2023-12-13T22:58:56.044 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2023-12-13T22:58:56.045 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2023-12-13T22:58:56.045 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2023-12-13T22:58:56.046 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46175.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2023-12-13T22:58:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2023-12-13T22:58:56.047 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46414.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2023-12-13T22:58:56.048 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2023-12-13T22:58:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44621.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2023-12-13T22:58:56.049 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2023-12-13T22:58:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47232.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2023-12-13T22:58:56.050 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2023-12-13T22:58:56.051 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2023-12-13T22:58:56.051 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2023-12-13T22:58:56.052 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44234.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2023-12-13T22:58:56.053 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2023-12-13T22:58:56.053 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44260.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2023-12-13T22:58:56.054 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2023-12-13T22:58:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45045.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2023-12-13T22:58:56.055 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2023-12-13T22:58:56.056 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45460.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2023-12-13T22:58:56.056 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47461.log 2023-12-13T22:58:56.057 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43946.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2023-12-13T22:58:56.057 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33647.log 2023-12-13T22:58:56.058 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47461.log.gz 2023-12-13T22:58:56.059 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48092.log 2023-12-13T22:58:56.059 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.tmp-client.admin.33647.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33647.log.gz 2023-12-13T22:58:56.060 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2023-12-13T22:58:56.060 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48092.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48092.log.gz 2023-12-13T22:58:56.061 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44312.log 2023-12-13T22:58:56.061 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44967.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2023-12-13T22:58:56.062 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2023-12-13T22:58:56.063 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44312.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44312.log.gz 2023-12-13T22:58:56.063 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2023-12-13T22:58:56.064 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47305.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2023-12-13T22:58:56.064 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47128.log 2023-12-13T22:58:56.065 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2023-12-13T22:58:56.065 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-13T22:58:56.066 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47128.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47128.log.gz 2023-12-13T22:58:56.067 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44778.log 2023-12-13T22:58:56.068 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-13T22:58:56.069 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-13T22:58:56.069 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44778.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44778.log.gz 2023-12-13T22:58:56.070 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-13T22:58:56.078 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-13T22:58:56.079 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45502.log 2023-12-13T22:58:56.086 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-13T22:58:56.087 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45991.log 2023-12-13T22:58:56.087 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45502.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45502.log.gz 2023-12-13T22:58:56.088 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47881.log 2023-12-13T22:58:56.089 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45991.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45991.log.gz 2023-12-13T22:58:56.089 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2023-12-13T22:58:56.090 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47881.log.gz 2023-12-13T22:58:56.090 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2023-12-13T22:58:56.091 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44673.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2023-12-13T22:58:56.092 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2023-12-13T22:58:56.092 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45459.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2023-12-13T22:58:56.093 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47774.log 2023-12-13T22:58:56.095 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44511.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2023-12-13T22:58:56.095 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-13T22:58:56.096 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47774.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47774.log.gz 2023-12-13T22:58:56.096 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-13T22:58:56.097 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-13T22:58:56.097 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-13T22:58:56.098 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.a.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-13T22:58:56.098 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-13T22:58:56.100 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mon.a.log: 93.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-13T22:58:56.101 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-13T22:58:56.102 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.c.log: 57.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-13T22:58:56.102 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47910.log 2023-12-13T22:58:56.105 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/valgrind/mds.e.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-13T22:58:56.105 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38657.log 2023-12-13T22:58:56.106 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47910.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47910.log.gz 2023-12-13T22:58:56.106 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47855.log 2023-12-13T22:58:56.107 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38657.log.gz 2023-12-13T22:58:56.107 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45704.log 2023-12-13T22:58:56.108 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47855.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47855.log.gz 2023-12-13T22:58:56.109 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-12-13T22:58:56.109 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45704.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2023-12-13T22:58:56.110 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2023-12-13T22:58:56.111 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46353.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-12-13T22:58:56.112 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2023-12-13T22:58:56.112 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44569.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2023-12-13T22:58:56.112 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2023-12-13T22:58:56.113 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44993.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2023-12-13T22:58:56.114 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2023-12-13T22:58:56.114 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47988.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2023-12-13T22:58:56.115 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2023-12-13T22:58:56.116 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45886.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2023-12-13T22:58:56.116 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2023-12-13T22:58:56.117 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44889.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2023-12-13T22:58:56.117 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46069.log 2023-12-13T22:58:56.118 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45157.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2023-12-13T22:58:56.118 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2023-12-13T22:58:56.120 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46069.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46069.log.gz 2023-12-13T22:58:56.120 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45261.log 2023-12-13T22:58:56.120 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47722.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2023-12-13T22:58:56.120 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2023-12-13T22:58:56.121 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2023-12-13T22:58:56.121 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45808.log 2023-12-13T22:58:56.122 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44130.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2023-12-13T22:58:56.122 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2023-12-13T22:58:56.123 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45808.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45808.log.gz 2023-12-13T22:58:56.124 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43998.log 2023-12-13T22:58:56.124 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44156.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2023-12-13T22:58:56.125 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2023-12-13T22:58:56.127 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.43998.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43998.log.gz 2023-12-13T22:58:56.127 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 2023-12-13T22:58:56.127 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2023-12-13T22:58:56.127 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48066.log 2023-12-13T22:58:56.128 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.47180.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2023-12-13T22:58:56.128 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2023-12-13T22:58:56.129 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.48066.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48066.log.gz 2023-12-13T22:58:56.130 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45426.log 2023-12-13T22:58:56.134 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.46043.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2023-12-13T22:58:56.135 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2023-12-13T22:58:56.135 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45426.log.gz 2023-12-13T22:58:56.135 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-12-13T22:58:56.135 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45939.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2023-12-13T22:58:56.135 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44338.log 2023-12-13T22:58:56.149 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38768.log 2023-12-13T22:58:56.149 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.44338.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44338.log.gz 2023-12-13T22:58:56.165 INFO:teuthology.orchestra.run.smithi091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2023-12-13T22:58:56.165 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.38768.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38768.log.gz 2023-12-13T22:58:56.166 INFO:teuthology.orchestra.run.smithi091.stderr:/var/log/ceph/ceph-client.admin.45738.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2023-12-13T22:58:56.277 INFO:teuthology.orchestra.run.smithi091.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-13T22:58:56.570 INFO:teuthology.orchestra.run.smithi152.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-13T22:58:56.597 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-13T22:58:57.457 INFO:teuthology.orchestra.run.smithi091.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-13T22:58:58.494 INFO:teuthology.orchestra.run.smithi091.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-13T22:58:58.647 INFO:teuthology.orchestra.run.smithi091.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-13T22:58:58.791 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-13T22:58:59.001 INFO:teuthology.orchestra.run.smithi091.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-13T22:58:59.093 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-13T22:58:59.369 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-13T22:58:59.775 INFO:teuthology.orchestra.run.smithi152.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-13T22:59:00.259 INFO:teuthology.orchestra.run.smithi152.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-13T22:59:00.421 INFO:teuthology.orchestra.run.smithi091.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-13T22:59:00.685 INFO:teuthology.orchestra.run.smithi091.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-13T22:59:02.425 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-13T22:59:02.426 INFO:teuthology.orchestra.run.smithi152.stderr: 2023-12-13T22:59:02.426 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m6.475s 2023-12-13T22:59:02.426 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m24.303s 2023-12-13T22:59:02.426 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.763s 2023-12-13T22:59:02.603 INFO:teuthology.orchestra.run.smithi091.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46534.log.gz 2023-12-13T22:59:02.604 INFO:teuthology.orchestra.run.smithi091.stderr: 2023-12-13T22:59:02.604 INFO:teuthology.orchestra.run.smithi091.stderr:real 0m6.680s 2023-12-13T22:59:02.604 INFO:teuthology.orchestra.run.smithi091.stderr:user 0m24.961s 2023-12-13T22:59:02.604 INFO:teuthology.orchestra.run.smithi091.stderr:sys 0m0.800s 2023-12-13T22:59:02.605 INFO:tasks.ceph:Archiving logs... 2023-12-13T22:59:02.605 DEBUG:teuthology.misc:Transferring archived files from smithi091:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi091/log 2023-12-13T22:59:02.606 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-13T22:59:05.725 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi152/log 2023-12-13T22:59:05.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-13T22:59:08.504 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-13T22:59:08.506 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-13T22:59:08.515 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_021ac1670a21c19759080c6da90baaeb42e7d175/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-13T22:59:08.515 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-13T22:59:08.516 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-13T22:59:08.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-13T22:59:08.582 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-13T22:59:08.594 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-13T22:59:08.595 DEBUG:teuthology.orchestra.run.smithi091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T22:59:08.597 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-13T22:59:08.607 INFO:teuthology.orchestra.run.smithi091.stdout: remote refid st t when poll reach delay offset jitter 2023-12-13T22:59:08.608 INFO:teuthology.orchestra.run.smithi091.stdout:============================================================================== 2023-12-13T22:59:08.608 INFO:teuthology.orchestra.run.smithi091.stdout:*hv01.front.sepi 44.4.53.2 2 u 15 64 377 0.080 -2.502 1.417 2023-12-13T22:59:08.608 INFO:teuthology.orchestra.run.smithi091.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 64 377 0.100 -3.862 1.550 2023-12-13T22:59:08.608 INFO:teuthology.orchestra.run.smithi091.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 64 377 0.088 -5.004 1.322 2023-12-13T22:59:08.608 INFO:teuthology.orchestra.run.smithi091.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout:*hv01.front.sepi 44.4.53.2 2 u 5 128 377 0.137 -0.123 0.597 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout:+hv02.front.sepi 63.231.80.2 3 u 118 128 377 0.174 -1.005 0.461 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout:+hv03.front.sepi 74.6.168.72 3 u 5 128 377 0.187 -2.074 0.841 2023-12-13T22:59:08.610 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-13T22:59:08.611 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-13T22:59:08.631 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-13T22:59:08.631 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-13T22:59:08.641 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-13T22:59:08.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-13T22:59:08.658 INFO:teuthology.task.internal:Duration was 3116.194125 seconds 2023-12-13T22:59:08.659 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-13T22:59:08.668 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-13T22:59:08.669 DEBUG:teuthology.orchestra.run.smithi091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-13T22:59:08.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-13T22:59:08.711 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-13T22:59:08.711 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi091.front.sepia.ceph.com 2023-12-13T22:59:08.711 DEBUG:teuthology.orchestra.run.smithi091:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-13T22:59:08.766 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-12-13T22:59:08.766 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-13T22:59:08.776 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-13T22:59:08.776 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-13T22:59:08.810 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-13T22:59:08.844 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-13T22:59:08.845 DEBUG:teuthology.orchestra.run.smithi091:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-13T22:59:08.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-13T22:59:08.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-13T22:59:08.951 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-13T22:59:08.951 DEBUG:teuthology.orchestra.run.smithi091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-13T22:59:08.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-13T22:59:08.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-13T22:59:08.985 DEBUG:teuthology.orchestra.run.smithi091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-13T22:59:09.006 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-13T22:59:09.016 INFO:teuthology.orchestra.run.smithi091.stdout:kernel.core_pattern = core 2023-12-13T22:59:09.027 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-12-13T22:59:09.054 DEBUG:teuthology.orchestra.run.smithi091:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-13T22:59:09.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:59:09.076 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-13T22:59:09.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-13T22:59:09.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-13T22:59:09.114 INFO:teuthology.task.internal:Transferring archived files... 2023-12-13T22:59:09.115 DEBUG:teuthology.misc:Transferring archived files from smithi091:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi091 2023-12-13T22:59:09.115 DEBUG:teuthology.orchestra.run.smithi091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-13T22:59:09.139 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529/remote/smithi152 2023-12-13T22:59:09.139 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-13T22:59:09.165 INFO:teuthology.task.internal:Removing archive directory... 2023-12-13T22:59:09.165 DEBUG:teuthology.orchestra.run.smithi091:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-13T22:59:09.182 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-13T22:59:09.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-13T22:59:09.221 INFO:teuthology.task.internal:Not uploading archives. 2023-12-13T22:59:09.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-13T22:59:09.231 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-13T22:59:09.232 DEBUG:teuthology.orchestra.run.smithi091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-13T22:59:09.234 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-13T22:59:09.237 INFO:teuthology.orchestra.run.smithi091.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 13 22:59 /home/ubuntu/cephtest 2023-12-13T22:59:09.256 INFO:teuthology.orchestra.run.smithi152.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 13 22:59 /home/ubuntu/cephtest 2023-12-13T22:59:09.258 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-13T22:59:09.269 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-13T22:59:09.280 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2023-12-13T22:59:09.280 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T22:59:09.307 DEBUG:teuthology.nuke:shortname: smithi091 2023-12-13T22:59:09.308 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:59:09.335 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-13T22:59:09.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T22:59:09.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi091.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:57:45.090675', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMAnY8NZ8rmG2fQtWRB96YYhFduGIFCtjp3tlo7ef+U/+RYsWnnoGH3a9C225VwUAJyfAd2a/pDKcjBH9rM9tQI='} 2023-12-13T22:59:09.359 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490529', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 21:57:45.092504', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAQegAzKZeY9WGY5Wo7dp/9hw6qdPMo5p6ZZJY4vLjPGWufyxKJFGkt6UARQVfEnBrlfPACkfQ6Rf6p8t68/C2Y='} 2023-12-13T22:59:09.395 INFO:teuthology.orchestra.console.smithi091:Power off 2023-12-13T22:59:09.395 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:59:09.419 DEBUG:teuthology.orchestra.console.smithi091:power off output: Chassis Power Control: Down/Off 2023-12-13T22:59:09.420 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:09.439 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-13T22:59:09.439 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T22:59:09.449 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-13T22:59:09.464 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-13T22:59:09.465 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:09.488 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-13T22:59:13.451 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:13.489 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:13.562 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-13T22:59:13.599 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-13T22:59:17.564 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:17.600 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:17.674 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is on 2023-12-13T22:59:17.710 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-13T22:59:17.811 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-13T22:59:21.676 DEBUG:teuthology.orchestra.console.smithi091:pexpect command: ipmitool -H smithi091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T22:59:21.786 DEBUG:teuthology.orchestra.console.smithi091:check power output: Chassis Power is off 2023-12-13T22:59:21.886 INFO:teuthology.orchestra.console.smithi091:Power off completed 2023-12-13T22:59:21.991 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} duration: 3116.194125175476 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-13T22:59:21.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T22:59:22.080 INFO:teuthology.run:FAIL